Sep 10 22:01:33.997532 ip-10-0-130-67 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 22:01:34.384533 ip-10-0-130-67 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 22:01:34.384533 ip-10-0-130-67 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 22:01:34.384533 ip-10-0-130-67 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 22:01:34.384533 ip-10-0-130-67 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 22:01:34.384533 ip-10-0-130-67 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 22:01:34.385492 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.385367    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 22:01:34.391064 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391029    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:01:34.391064 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391057    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:01:34.391064 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391062    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:01:34.391064 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391067    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:01:34.391064 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391070    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:01:34.391474 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391075    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:01:34.391474 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391080    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:01:34.391474 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391087    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:01:34.391474 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391093    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:01:34.391474 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391098    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:01:34.391474 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391103    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:01:34.391474 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391109    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:01:34.391474 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391113    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:01:34.391474 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391117    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:01:34.391474 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391121    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:01:34.391474 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391124    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:01:34.391474 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391128    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:01:34.391474 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391132    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:01:34.391474 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391136    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:01:34.391474 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391139    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:01:34.391474 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391143    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:01:34.391474 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391147    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:01:34.391474 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391150    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:01:34.391474 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391175    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:01:34.392267 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391180    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:01:34.392267 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391184    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:01:34.392267 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391188    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:01:34.392267 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391192    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:01:34.392267 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391196    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:01:34.392267 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391199    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:01:34.392267 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391203    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:01:34.392267 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391207    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:01:34.392267 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391211    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:01:34.392267 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391215    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:01:34.392267 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391218    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:01:34.392267 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391222    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:01:34.392267 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391226    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:01:34.392267 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391230    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:01:34.392267 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391235    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:01:34.392267 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391239    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:01:34.392267 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391244    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:01:34.392267 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391248    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:01:34.392267 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391253    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:01:34.392267 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391256    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:01:34.393123 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391260    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:01:34.393123 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391264    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:01:34.393123 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391269    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:01:34.393123 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391273    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:01:34.393123 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391277    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:01:34.393123 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391281    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:01:34.393123 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391285    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:01:34.393123 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391290    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:01:34.393123 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391294    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:01:34.393123 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391298    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:01:34.393123 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391302    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:01:34.393123 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391306    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:01:34.393123 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391310    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:01:34.393123 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391315    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:01:34.393123 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391319    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:01:34.393123 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391323    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:01:34.393123 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391327    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:01:34.393123 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391331    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:01:34.393123 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391335    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:01:34.393903 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391339    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:01:34.393903 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391343    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:01:34.393903 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391348    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:01:34.393903 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391352    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:01:34.393903 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391356    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:01:34.393903 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391361    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:01:34.393903 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391365    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:01:34.393903 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391373    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:01:34.393903 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391379    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:01:34.393903 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391385    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:01:34.393903 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391389    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:01:34.393903 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391394    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:01:34.393903 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391402    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:01:34.393903 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391407    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:01:34.393903 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391412    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:01:34.393903 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391417    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:01:34.393903 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391422    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:01:34.393903 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391426    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:01:34.393903 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391431    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:01:34.393903 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391435    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:01:34.394885 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391441    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:01:34.394885 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391445    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:01:34.394885 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391449    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:01:34.394885 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391454    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:01:34.394885 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391457    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:01:34.394885 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391461    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:01:34.394885 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391466    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:01:34.394885 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391469    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:01:34.394885 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391473    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:01:34.394885 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391477    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:01:34.394885 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391481    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:01:34.394885 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391485    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:01:34.394885 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391489    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:01:34.394885 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391493    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:01:34.394885 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391497    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:01:34.394885 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.391501    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:01:34.394885 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392702    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:01:34.394885 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392712    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:01:34.394885 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392717    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:01:34.394885 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392722    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:01:34.395753 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392726    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:01:34.395753 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392731    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:01:34.395753 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392736    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:01:34.395753 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392740    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:01:34.395753 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392744    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:01:34.395753 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392749    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:01:34.395753 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392753    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:01:34.395753 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392758    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:01:34.395753 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392762    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:01:34.395753 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392767    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:01:34.395753 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392771    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:01:34.395753 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392775    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:01:34.395753 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392780    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:01:34.395753 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392785    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:01:34.395753 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392789    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:01:34.395753 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392793    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:01:34.395753 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392798    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:01:34.395753 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392802    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:01:34.395753 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392806    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:01:34.395753 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392810    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:01:34.396428 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392814    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:01:34.396428 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392819    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:01:34.396428 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392823    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:01:34.396428 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392828    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:01:34.396428 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392832    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:01:34.396428 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392836    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:01:34.396428 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392840    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:01:34.396428 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392844    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:01:34.396428 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392851    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:01:34.396428 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392858    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:01:34.396428 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392863    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:01:34.396428 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392868    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:01:34.396428 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392872    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:01:34.396428 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392877    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:01:34.396428 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392881    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:01:34.396428 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392887    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:01:34.396428 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392891    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:01:34.396428 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392894    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:01:34.396428 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392899    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:01:34.396428 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392913    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:01:34.396982 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392918    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:01:34.396982 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392922    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:01:34.396982 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392926    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:01:34.396982 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392930    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:01:34.396982 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392934    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:01:34.396982 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392938    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:01:34.396982 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392943    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:01:34.396982 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392947    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:01:34.396982 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392952    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:01:34.396982 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392957    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:01:34.396982 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392960    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:01:34.396982 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392965    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:01:34.396982 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392969    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:01:34.396982 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392973    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:01:34.396982 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392977    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:01:34.396982 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392982    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:01:34.396982 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392986    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:01:34.396982 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392991    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:01:34.396982 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392995    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:01:34.396982 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.392999    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:01:34.397601 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393003    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:01:34.397601 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393010    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:01:34.397601 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393016    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:01:34.397601 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393025    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:01:34.397601 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393029    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:01:34.397601 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393034    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:01:34.397601 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393038    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:01:34.397601 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393043    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:01:34.397601 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393047    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:01:34.397601 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393052    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:01:34.397601 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393056    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:01:34.397601 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393060    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:01:34.397601 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393064    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:01:34.397601 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393068    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:01:34.397601 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393072    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:01:34.397601 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393076    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:01:34.397601 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393079    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:01:34.397601 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393085    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:01:34.397601 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393089    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:01:34.398193 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393095    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:01:34.398193 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393100    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:01:34.398193 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393104    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:01:34.398193 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393108    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:01:34.398193 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393112    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:01:34.398193 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393116    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:01:34.398193 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393120    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:01:34.398193 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393123    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:01:34.398193 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393128    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:01:34.398193 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393132    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:01:34.398193 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393136    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:01:34.398193 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393140    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:01:34.398193 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393144    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:01:34.398193 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393148    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:01:34.398193 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393171    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:01:34.398193 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393179    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:01:34.398193 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393882    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:01:34.398193 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393891    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:01:34.398193 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393897    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:01:34.398772 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393902    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:01:34.398772 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393906    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:01:34.398772 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393910    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:01:34.398772 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393915    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:01:34.398772 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393919    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:01:34.398772 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393925    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:01:34.398772 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393931    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:01:34.398772 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393936    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:01:34.398772 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393941    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:01:34.398772 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393946    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:01:34.398772 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393951    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:01:34.398772 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393956    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:01:34.398772 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393960    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:01:34.398772 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393966    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:01:34.398772 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393971    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:01:34.398772 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393975    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:01:34.398772 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393980    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:01:34.398772 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393985    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:01:34.398772 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393990    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:01:34.399325 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.393994    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:01:34.399325 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394000    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:01:34.399325 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394005    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:01:34.399325 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394009    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:01:34.399325 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394013    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:01:34.399325 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394017    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:01:34.399325 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394021    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:01:34.399325 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394025    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:01:34.399325 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394032    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:01:34.399325 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394043    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:01:34.399325 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394049    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:01:34.399325 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394054    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:01:34.399325 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394059    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:01:34.399325 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394063    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:01:34.399325 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394067    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:01:34.399325 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394071    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:01:34.399325 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394075    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:01:34.399325 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394079    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:01:34.399325 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394083    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:01:34.399325 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394087    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:01:34.399900 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394091    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:01:34.399900 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394095    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:01:34.399900 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394099    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:01:34.399900 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394102    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:01:34.399900 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394107    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:01:34.399900 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394111    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:01:34.399900 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394116    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:01:34.399900 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394125    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:01:34.399900 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394129    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:01:34.399900 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394133    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:01:34.399900 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394137    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:01:34.399900 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394143    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:01:34.399900 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394149    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:01:34.399900 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394152    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:01:34.399900 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394175    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:01:34.399900 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394179    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:01:34.399900 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394183    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:01:34.399900 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394187    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:01:34.399900 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394191    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:01:34.399900 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394194    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:01:34.400436 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394198    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:01:34.400436 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394201    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:01:34.400436 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394205    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:01:34.400436 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394209    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:01:34.400436 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394213    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:01:34.400436 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394220    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:01:34.400436 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394224    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:01:34.400436 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394228    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:01:34.400436 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394231    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:01:34.400436 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394235    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:01:34.400436 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394239    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:01:34.400436 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394243    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:01:34.400436 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394247    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:01:34.400436 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394250    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:01:34.400436 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394254    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:01:34.400436 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394257    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:01:34.400436 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394261    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:01:34.400436 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394265    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:01:34.400436 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394270    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:01:34.400436 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394273    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:01:34.400969 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394287    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:01:34.400969 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394292    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:01:34.400969 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394296    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:01:34.400969 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394300    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:01:34.400969 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394304    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:01:34.400969 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394309    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:01:34.400969 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394313    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:01:34.400969 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394317    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:01:34.400969 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394321    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:01:34.400969 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394324    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:01:34.400969 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394328    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:01:34.400969 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394332    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:01:34.400969 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394336    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:01:34.400969 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394340    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:01:34.400969 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394345    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:01:34.400969 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394349    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:01:34.400969 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.394353    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:01:34.400969 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394469    2577 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 22:01:34.400969 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394531    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 22:01:34.400969 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394542    2577 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 22:01:34.400969 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394549    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394556    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394561    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394571    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394578    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394583    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394588    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394594    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394599    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394604    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394609    2577 flags.go:64] FLAG: --cgroup-root=""
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394614    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394619    2577 flags.go:64] FLAG: --client-ca-file=""
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394625    2577 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394629    2577 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394635    2577 flags.go:64] FLAG: --cluster-domain=""
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394640    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394645    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394650    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394655    2577 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394661    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394666    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394671    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 22:01:34.401488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394676    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394681    2577 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394685    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394690    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394696    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394700    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394707    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394712    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394717    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394721    2577 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394726    2577 flags.go:64] FLAG: --enable-server="true"
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394731    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394741    2577 flags.go:64] FLAG: --event-burst="100"
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394746    2577 flags.go:64] FLAG: --event-qps="50"
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394750    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394755    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394760    2577 flags.go:64] FLAG: --eviction-hard=""
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394766    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394770    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394775    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394780    2577 flags.go:64] FLAG: --eviction-soft=""
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394785    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394789    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394795    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394800    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 22:01:34.402030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394804    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394809    2577 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394813    2577 flags.go:64] FLAG: --feature-gates=""
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394820    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394825    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394829    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394834    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394839    2577 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394844    2577 flags.go:64] FLAG: --help="false"
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394848    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-130-67.ec2.internal"
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394856    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394861    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394865    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394871    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394876    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394881    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394886    2577 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394890    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394894    2577 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394903    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394908    2577 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394912    2577 flags.go:64] FLAG: --kube-reserved=""
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394917    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394922    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 22:01:34.402803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394927    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394932    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394937    2577 flags.go:64] FLAG: --lock-file=""
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394941    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394946    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394951    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394960    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394973    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394979    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394984    2577 flags.go:64] FLAG: --logging-format="text"
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394988    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394994    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.394998    2577 flags.go:64] FLAG: --manifest-url=""
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395003    2577 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395010    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395015    2577 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395022    2577 flags.go:64] FLAG: --max-pods="110"
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395026    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395032    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395037    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395042    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395047    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395053    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395058    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395069    2577 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 22:01:34.403844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395074    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395079    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395085    2577 flags.go:64] FLAG: --pod-cidr=""
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395090    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395099    2577 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395103    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395108    2577 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395113    2577 flags.go:64] FLAG: --port="10250"
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395117    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395122    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-099b6f2aa44392015"
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395128    2577 flags.go:64] FLAG: --qos-reserved=""
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395133    2577 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395138    2577 flags.go:64] FLAG: --register-node="true"
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395142    2577 flags.go:64] FLAG: --register-with-taints=""
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395148    2577 flags.go:64] FLAG: --registry-burst="10"
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395181    2577 flags.go:64] FLAG: --registry-qps="5"
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395187    2577 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395192    2577 flags.go:64] FLAG: --reserved-memory=""
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395198    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395204    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395209    2577 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395214    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395218    2577 flags.go:64] FLAG: --runonce="false"
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395223    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395228    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 22:01:34.404938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395233    2577 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395239    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395244    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395249    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395254    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395259    2577 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395263    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395268    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395272    2577 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395279    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395284    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395289    2577 flags.go:64] FLAG: --system-cgroups=""
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395293    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395316    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395321    2577 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395325    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395336    2577 flags.go:64] FLAG: --tls-min-version=""
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395341    2577 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395345    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395350    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395354    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395359    2577 flags.go:64] FLAG: --v="2"
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395366    2577 flags.go:64] FLAG: --version="false"
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395380    2577 flags.go:64] FLAG: --vmodule=""
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395387    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 22:01:34.405819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.395392    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 22:01:34.406640 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395577    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:01:34.406640 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395583    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:01:34.406640 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395588    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:01:34.406640 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395592    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:01:34.406640 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395597    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:01:34.406640 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395601    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:01:34.406640 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395605    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:01:34.406640 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395612    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:01:34.406640 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395616    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:01:34.406640 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395620    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:01:34.406640 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395625    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:01:34.406640 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395629    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:01:34.406640 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395633    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:01:34.406640 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395637    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:01:34.406640 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395641    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:01:34.406640 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395648    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:01:34.406640 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395652    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:01:34.406640 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395656    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:01:34.406640 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395660    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:01:34.406640 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395664    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:01:34.407552 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395668    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:01:34.407552 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395675    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:01:34.407552 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395680    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:01:34.407552 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395685    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:01:34.407552 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395690    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:01:34.407552 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395695    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:01:34.407552 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395700    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:01:34.407552 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395704    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:01:34.407552 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395709    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:01:34.407552 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395714    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:01:34.407552 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395724    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:01:34.407552 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395729    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:01:34.407552 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395734    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:01:34.407552 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395738    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:01:34.407552 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395742    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:01:34.407552 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395746    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:01:34.407552 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395750    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:01:34.407552 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395754    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:01:34.407552 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395757    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:01:34.408206 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395763    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:01:34.408206 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395766    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:01:34.408206 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395770    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:01:34.408206 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395774    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:01:34.408206 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395778    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:01:34.408206 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395782    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:01:34.408206 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395786    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:01:34.408206 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395790    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:01:34.408206 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395796    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:01:34.408206 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395800    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:01:34.408206 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395827    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:01:34.408206 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395834    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:01:34.408206 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395839    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:01:34.408206 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395844    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:01:34.408206 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395848    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:01:34.408206 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395853    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:01:34.408206 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395858    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:01:34.408206 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395862    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:01:34.408206 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395866    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:01:34.408206 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395870    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:01:34.408925 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395875    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:01:34.408925 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395879    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:01:34.408925 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395883    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:01:34.408925 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395887    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:01:34.408925 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395899    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:01:34.408925 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395904    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:01:34.408925 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395908    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:01:34.408925 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395912    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:01:34.408925 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395916    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:01:34.408925 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395920    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:01:34.408925 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395925    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:01:34.408925 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395929    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:01:34.408925 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395934    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:01:34.408925 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395938    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:01:34.408925 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395942    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:01:34.408925 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395947    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:01:34.408925 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395951    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:01:34.408925 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395955    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:01:34.408925 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395959    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:01:34.409820 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395963    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:01:34.409820 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395969    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:01:34.409820 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395974    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:01:34.409820 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395978    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:01:34.409820 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395982    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:01:34.409820 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395988    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:01:34.409820 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395994    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:01:34.409820 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.395999    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:01:34.409820 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.396004    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:01:34.409820 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.396008    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:01:34.409820 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.396012    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:01:34.409820 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.396016    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:01:34.409820 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.396020    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:01:34.409820 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.396025    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:01:34.409820 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.396029    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:01:34.409820 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.396033    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:01:34.409820 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.396036    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:01:34.409820 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.396041    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:01:34.409820 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.396046    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:01:34.410461 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.396052    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:01:34.410461 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.396058    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:01:34.410461 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.396849    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 22:01:34.410461 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.405284    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 22:01:34.410461 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.405505    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 22:01:34.410461 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.406250    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 22:01:34.410461 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.406264    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 22:01:34.410461 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406371    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:01:34.410461 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406381    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:01:34.410461 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406386    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:01:34.410461 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406390    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:01:34.410461 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406395    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:01:34.410461 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406399    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:01:34.410461 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406404    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:01:34.410961 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406409    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:01:34.410961 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406414    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:01:34.410961 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406418    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:01:34.410961 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406422    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:01:34.410961 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406426    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:01:34.410961 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406430    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:01:34.410961 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406435    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:01:34.410961 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406439    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:01:34.410961 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406443    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:01:34.410961 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406447    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:01:34.410961 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406451    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:01:34.410961 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406456    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:01:34.410961 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406460    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:01:34.410961 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406464    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:01:34.410961 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406468    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:01:34.410961 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406472    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:01:34.410961 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406476    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:01:34.410961 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406480    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:01:34.410961 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406484    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:01:34.410961 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406488    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:01:34.411480 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406492    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:01:34.411480 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406497    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:01:34.411480 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406502    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:01:34.411480 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406506    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:01:34.411480 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406510    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:01:34.411480 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406515    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:01:34.411480 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406520    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:01:34.411480 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406524    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:01:34.411480 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406528    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:01:34.411480 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406533    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:01:34.411480 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406537    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:01:34.411480 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406541    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:01:34.411480 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406546    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:01:34.411480 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406553    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:01:34.411480 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406559    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:01:34.411480 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406564    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:01:34.411480 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406569    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:01:34.411480 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406574    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:01:34.411480 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406578    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:01:34.412021 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406583    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:01:34.412021 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406587    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:01:34.412021 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406591    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:01:34.412021 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406595    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:01:34.412021 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406599    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:01:34.412021 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406603    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:01:34.412021 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406607    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:01:34.412021 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406612    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:01:34.412021 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406618    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:01:34.412021 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406623    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:01:34.412021 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406628    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:01:34.412021 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406632    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:01:34.412021 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406636    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:01:34.412021 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406640    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:01:34.412021 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406646    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:01:34.412021 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406651    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:01:34.412021 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406668    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:01:34.412021 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406674    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:01:34.412021 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406678    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:01:34.412557 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406683    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:01:34.412557 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406687    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:01:34.412557 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406691    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:01:34.412557 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406695    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:01:34.412557 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406699    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:01:34.412557 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406704    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:01:34.412557 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406708    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:01:34.412557 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406712    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:01:34.412557 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406717    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:01:34.412557 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406722    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:01:34.412557 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406726    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:01:34.412557 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406731    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:01:34.412557 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406735    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:01:34.412557 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406739    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:01:34.412557 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406744    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:01:34.412557 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406748    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:01:34.412557 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406751    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:01:34.412557 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406756    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:01:34.412557 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406760    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:01:34.412557 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406764    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:01:34.413077 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406768    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:01:34.413077 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406772    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:01:34.413077 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406776    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:01:34.413077 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406780    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:01:34.413077 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406784    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:01:34.413077 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406788    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:01:34.413077 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406793    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:01:34.413077 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406797    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:01:34.413077 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406800    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:01:34.413077 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406805    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:01:34.413077 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406816    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:01:34.413077 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406822    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:01:34.413077 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406826    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:01:34.413077 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.406830    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:01:34.413077 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.406838    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 22:01:34.413501 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407070    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:01:34.413501 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407080    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:01:34.413501 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407085    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:01:34.413501 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407090    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:01:34.413501 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407095    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:01:34.413501 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407100    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:01:34.413501 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407105    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:01:34.413501 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407109    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:01:34.413501 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407113    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:01:34.413501 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407118    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:01:34.413501 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407122    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:01:34.413501 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407126    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:01:34.413501 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407130    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:01:34.413501 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407134    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:01:34.413501 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407139    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:01:34.413501 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407143    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:01:34.413501 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407149    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:01:34.413501 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407174    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:01:34.413501 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407178    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:01:34.414069 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407183    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:01:34.414069 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407188    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:01:34.414069 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407192    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:01:34.414069 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407196    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:01:34.414069 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407200    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:01:34.414069 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407205    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:01:34.414069 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407209    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:01:34.414069 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407213    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:01:34.414069 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407218    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:01:34.414069 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407231    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:01:34.414069 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407236    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:01:34.414069 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407241    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:01:34.414069 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407245    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:01:34.414069 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407249    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:01:34.414069 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407253    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:01:34.414069 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407257    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:01:34.414069 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407261    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:01:34.414069 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407265    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:01:34.414069 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407269    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:01:34.414069 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407274    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:01:34.414899 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407278    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:01:34.414899 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407282    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:01:34.414899 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407286    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:01:34.414899 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407290    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:01:34.414899 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407294    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:01:34.414899 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407298    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:01:34.414899 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407302    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:01:34.414899 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407306    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:01:34.414899 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407310    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:01:34.414899 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407314    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:01:34.414899 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407318    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:01:34.414899 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407322    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:01:34.414899 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407326    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:01:34.414899 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407330    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:01:34.414899 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407334    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:01:34.414899 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407338    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:01:34.414899 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407343    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:01:34.414899 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407349    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:01:34.414899 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407354    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:01:34.414899 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407358    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:01:34.415747 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407362    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:01:34.415747 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407367    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:01:34.415747 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407380    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:01:34.415747 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407386    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:01:34.415747 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407390    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:01:34.415747 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407394    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:01:34.415747 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407401    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:01:34.415747 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407406    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:01:34.415747 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407411    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:01:34.415747 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407415    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:01:34.415747 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407419    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:01:34.415747 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407423    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:01:34.415747 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407427    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:01:34.415747 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407432    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:01:34.415747 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407436    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:01:34.415747 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407440    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:01:34.415747 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407444    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:01:34.415747 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407450    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:01:34.415747 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407455    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:01:34.415747 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407459    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:01:34.416628 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407463    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:01:34.416628 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407467    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:01:34.416628 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407470    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:01:34.416628 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407477    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:01:34.416628 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407483    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:01:34.416628 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407487    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:01:34.416628 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407492    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:01:34.416628 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407496    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:01:34.416628 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407501    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:01:34.416628 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407505    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:01:34.416628 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407509    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:01:34.416628 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407513    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:01:34.416628 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407517    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:01:34.416628 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407521    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:01:34.416628 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407526    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:01:34.416628 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407538    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:01:34.416628 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407542    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:01:34.416628 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407547    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:01:34.416628 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407550    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:01:34.416628 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:34.407554    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:01:34.417268 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.407562    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 22:01:34.417268 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.407766    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 22:01:34.417268 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.410577    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 22:01:34.417268 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.411654    2577 server.go:1019] "Starting client certificate rotation"
Sep 10 22:01:34.417268 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.411776    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 22:01:34.417268 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.412568    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 22:01:34.417268 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.414676    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 22:01:34.420623 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.420601    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 22:01:34.433702 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.433671    2577 log.go:25] "Validated CRI v1 runtime API"
Sep 10 22:01:34.436613 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.436593    2577 log.go:25] "Validated CRI v1 image API"
Sep 10 22:01:34.437489 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.437475    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 22:01:34.440909 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.440879    2577 fs.go:135] Filesystem UUIDs: map[32e0d9e8-7f68-44fb-928c-17940a8b5202:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ff0d6ada-3300-48b7-bbb1-2d1432ccd956:/dev/nvme0n1p4]
Sep 10 22:01:34.440963 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.440910    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 22:01:34.445572 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.445553    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 22:01:34.446449 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.446336    2577 manager.go:216] Machine: {Timestamp:2026-09-10 22:01:34.444795525 +0000 UTC m=+0.330513414 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3061127 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a05cdf1bfa004f1e1acf2af9e933b SystemUUID:ec2a05cd-f1bf-a004-f1e1-acf2af9e933b BootID:7d8e04b2-8a8b-4304-8a03-e014c612f1ce Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a3:9e:88:63:91 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a3:9e:88:63:91 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:de:8b:8f:b9:bf Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 22:01:34.446449 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.446447    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 22:01:34.446594 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.446582    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 22:01:34.450241 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.450209    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 22:01:34.450400 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.450247    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-67.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 22:01:34.450886 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.450875    2577 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 22:01:34.450916 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.450887    2577 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 22:01:34.450916 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.450895    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 22:01:34.451513 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.451501    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 22:01:34.452279 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.452268    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 22:01:34.455332 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.455317    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 22:01:34.455477 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.455466    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 22:01:34.455516 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.455501    2577 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 22:01:34.455516 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.455512    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 22:01:34.455571 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.455527    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 22:01:34.455571 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.455537    2577 kubelet.go:398] "Adding apiserver pod source"
Sep 10 22:01:34.455571 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.455545    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 22:01:34.455997 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.455984    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 22:01:34.456035 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.456009    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 22:01:34.458117 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.458100    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 22:01:34.460055 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.460037    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 22:01:34.460092 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.460073    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 22:01:34.461602 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.461582    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 22:01:34.461602 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.461605    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 22:01:34.461759 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.461657    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 22:01:34.461759 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.461663    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 22:01:34.461759 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.461671    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 22:01:34.461759 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.461677    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 22:01:34.461759 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.461691    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 22:01:34.461759 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.461696    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 22:01:34.461759 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.461703    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 22:01:34.461759 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.461709    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 22:01:34.461759 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.461751    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 22:01:34.461759 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.461757    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 22:01:34.462471 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.462457    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 22:01:34.462515 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.462473    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 22:01:34.466844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.466829    2577 server.go:1268] "Started kubelet"
Sep 10 22:01:34.466947 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.466878    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-67.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 22:01:34.466947 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:34.466913    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 22:01:34.467064 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.466945    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 22:01:34.467120 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.467033    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 22:01:34.467205 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:34.467127    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 22:01:34.471085 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.467138    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 22:01:34.471903 ip-10-0-130-67 systemd[1]: Started Kubernetes Kubelet.
Sep 10 22:01:34.473132 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.472935    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hxwb7"
Sep 10 22:01:34.474214 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.474192    2577 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 22:01:34.475433 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.475413    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 22:01:34.477095 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:34.477073    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 22:01:34.478262 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:34.477366    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-67.ec2.internal.18d414af2644cd27  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-67.ec2.internal,UID:ip-10-0-130-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-67.ec2.internal,},FirstTimestamp:2026-09-10 22:01:34.466805031 +0000 UTC m=+0.352522921,LastTimestamp:2026-09-10 22:01:34.466805031 +0000 UTC m=+0.352522921,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-67.ec2.internal,}"
Sep 10 22:01:34.480541 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.480526    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 22:01:34.480977 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.480962    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 22:01:34.481230 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:34.481206    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-67.ec2.internal\" not found"
Sep 10 22:01:34.481554 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.481536    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 22:01:34.481685 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.481608    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hxwb7"
Sep 10 22:01:34.481685 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.481668    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 22:01:34.481685 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.481681    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 22:01:34.481880 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.481856    2577 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 22:01:34.481880 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.481864    2577 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 22:01:34.482044 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.482026    2577 factory.go:55] Registering systemd factory
Sep 10 22:01:34.482124 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.482047    2577 factory.go:223] Registration of the systemd container factory successfully
Sep 10 22:01:34.482286 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.482274    2577 factory.go:153] Registering CRI-O factory
Sep 10 22:01:34.482325 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.482288    2577 factory.go:223] Registration of the crio container factory successfully
Sep 10 22:01:34.482372 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.482345    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 22:01:34.482372 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.482361    2577 factory.go:103] Registering Raw factory
Sep 10 22:01:34.482430 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.482374    2577 manager.go:1196] Started watching for new ooms in manager
Sep 10 22:01:34.482713 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.482702    2577 manager.go:349] Starting recovery of all containers
Sep 10 22:01:34.483868 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:34.483847    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 22:01:34.483940 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:34.483905    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 22:01:34.490836 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.490783    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 22:01:34.492959 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.492934    2577 manager.go:354] Recovery completed
Sep 10 22:01:34.498337 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.498320    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:01:34.500090 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.500072    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-67.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:01:34.500145 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.500111    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-67.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:01:34.500145 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.500122    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-67.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:01:34.500761 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.500746    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 22:01:34.500761 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.500758    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 22:01:34.500861 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.500773    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 22:01:34.500861 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.500782    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:01:34.501747 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.501732    2577 policy_none.go:49] "None policy: Start"
Sep 10 22:01:34.501809 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.501752    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 22:01:34.501809 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.501763    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 22:01:34.501809 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.501774    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-67.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:01:34.501809 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.501800    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-67.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:01:34.501809 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.501811    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-67.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:01:34.502632 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.502622    2577 policy_none.go:47] "Start"
Sep 10 22:01:34.540853 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.540825    2577 manager.go:337] "Starting Device Plugin manager"
Sep 10 22:01:34.540997 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:34.540878    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 22:01:34.540997 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.540890    2577 server.go:87] "Starting device plugin registration server"
Sep 10 22:01:34.541224 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.541211    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 22:01:34.541286 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.541227    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 22:01:34.541368 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.541350    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 22:01:34.541470 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.541440    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 22:01:34.541470 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.541451    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 22:01:34.542020 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:34.541996    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 22:01:34.542112 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:34.542059    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-67.ec2.internal\" not found"
Sep 10 22:01:34.627141 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.627101    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 22:01:34.627345 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.627185    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 22:01:34.627345 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.627218    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 22:01:34.627345 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:34.627269    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 22:01:34.629775 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.629755    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:01:34.642017 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.641912    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:01:34.643740 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.643724    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-67.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:01:34.643822 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.643758    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-67.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:01:34.643822 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.643774    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-67.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:01:34.643822 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.643804    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-67.ec2.internal"
Sep 10 22:01:34.649801 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.649779    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-67.ec2.internal"
Sep 10 22:01:34.649857 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:34.649809    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-67.ec2.internal\": node \"ip-10-0-130-67.ec2.internal\" not found"
Sep 10 22:01:34.663793 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:34.663768    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-67.ec2.internal\" not found"
Sep 10 22:01:34.728347 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.728295    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-67.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-67.ec2.internal"]
Sep 10 22:01:34.728515 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.728396    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:01:34.729963 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.729947    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-67.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:01:34.730041 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.729976    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-67.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:01:34.730041 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.729986    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-67.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:01:34.731286 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.731273    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:01:34.731425 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.731405    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-67.ec2.internal"
Sep 10 22:01:34.731464 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.731439    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:01:34.732077 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.732062    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-67.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:01:34.732170 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.732087    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-67.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:01:34.732170 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.732063    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-67.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:01:34.732170 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.732096    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-67.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:01:34.732170 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.732111    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-67.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:01:34.732170 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.732121    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-67.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:01:34.733208 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.733190    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-67.ec2.internal"
Sep 10 22:01:34.733325 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.733226    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:01:34.733975 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.733948    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-67.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:01:34.733975 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.733977    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-67.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:01:34.734110 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.733989    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-67.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:01:34.759133 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:34.759100    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-67.ec2.internal\" not found" node="ip-10-0-130-67.ec2.internal"
Sep 10 22:01:34.763842 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:34.763820    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-67.ec2.internal\" not found"
Sep 10 22:01:34.763963 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:34.763905    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-67.ec2.internal\" not found" node="ip-10-0-130-67.ec2.internal"
Sep 10 22:01:34.784503 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.784469    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8f17cbcfb74fe83456186f4ef7bd3634-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-67.ec2.internal\" (UID: \"8f17cbcfb74fe83456186f4ef7bd3634\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-67.ec2.internal"
Sep 10 22:01:34.784595 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.784509    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f17cbcfb74fe83456186f4ef7bd3634-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-67.ec2.internal\" (UID: \"8f17cbcfb74fe83456186f4ef7bd3634\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-67.ec2.internal"
Sep 10 22:01:34.784595 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.784531    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/30837abf95c6ef4eb29dd502c80f9ab0-config\") pod \"kube-apiserver-proxy-ip-10-0-130-67.ec2.internal\" (UID: \"30837abf95c6ef4eb29dd502c80f9ab0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-67.ec2.internal"
Sep 10 22:01:34.863968 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:34.863930    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-67.ec2.internal\" not found"
Sep 10 22:01:34.885359 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.885324    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/30837abf95c6ef4eb29dd502c80f9ab0-config\") pod \"kube-apiserver-proxy-ip-10-0-130-67.ec2.internal\" (UID: \"30837abf95c6ef4eb29dd502c80f9ab0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-67.ec2.internal"
Sep 10 22:01:34.885424 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.885364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8f17cbcfb74fe83456186f4ef7bd3634-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-67.ec2.internal\" (UID: \"8f17cbcfb74fe83456186f4ef7bd3634\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-67.ec2.internal"
Sep 10 22:01:34.885424 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.885381    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f17cbcfb74fe83456186f4ef7bd3634-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-67.ec2.internal\" (UID: \"8f17cbcfb74fe83456186f4ef7bd3634\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-67.ec2.internal"
Sep 10 22:01:34.885487 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.885430    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f17cbcfb74fe83456186f4ef7bd3634-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-67.ec2.internal\" (UID: \"8f17cbcfb74fe83456186f4ef7bd3634\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-67.ec2.internal"
Sep 10 22:01:34.885487 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.885427    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/30837abf95c6ef4eb29dd502c80f9ab0-config\") pod \"kube-apiserver-proxy-ip-10-0-130-67.ec2.internal\" (UID: \"30837abf95c6ef4eb29dd502c80f9ab0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-67.ec2.internal"
Sep 10 22:01:34.885487 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:34.885429    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8f17cbcfb74fe83456186f4ef7bd3634-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-67.ec2.internal\" (UID: \"8f17cbcfb74fe83456186f4ef7bd3634\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-67.ec2.internal"
Sep 10 22:01:34.964798 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:34.964752    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-67.ec2.internal\" not found"
Sep 10 22:01:35.061273 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:35.061240    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-67.ec2.internal"
Sep 10 22:01:35.065808 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:35.065789    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-67.ec2.internal\" not found"
Sep 10 22:01:35.066882 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:35.066867    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-67.ec2.internal"
Sep 10 22:01:35.166061 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:35.166026    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-67.ec2.internal\" not found"
Sep 10 22:01:35.266567 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:35.266500    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-67.ec2.internal\" not found"
Sep 10 22:01:35.367079 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:35.367033    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-67.ec2.internal\" not found"
Sep 10 22:01:35.411532 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:35.411504    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 22:01:35.411984 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:35.411708    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 22:01:35.467983 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:35.467958    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-67.ec2.internal\" not found"
Sep 10 22:01:35.485697 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:35.485670    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 21:56:35 +0000 UTC" deadline="2028-04-07 07:15:41.73472878 +0000 UTC"
Sep 10 22:01:35.485697 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:35.485695    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13785h14m6.249036974s"
Sep 10 22:01:35.568430 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:35.568361    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-67.ec2.internal\" not found"
Sep 10 22:01:35.619680 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:35.619651    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:01:35.630623 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:35.630607    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:01:35.669078 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:35.669057    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-67.ec2.internal\" not found"
Sep 10 22:01:35.685636 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:35.685614    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:01:36.995162 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:36.995133    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-67.ec2.internal"
Sep 10 22:01:37.011379 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.011356    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 22:01:37.012328 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.012314    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-67.ec2.internal"
Sep 10 22:01:37.029725 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.029586    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 22:01:37.156358 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:37.156328    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30837abf95c6ef4eb29dd502c80f9ab0.slice/crio-d3c10e5054389e68716c0ee711a6dcbe61e432eee074df63175678d4a04069e9 WatchSource:0}: Error finding container d3c10e5054389e68716c0ee711a6dcbe61e432eee074df63175678d4a04069e9: Status 404 returned error can't find the container with id d3c10e5054389e68716c0ee711a6dcbe61e432eee074df63175678d4a04069e9
Sep 10 22:01:37.160435 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.160420    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 22:01:37.343058 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:37.343035    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f17cbcfb74fe83456186f4ef7bd3634.slice/crio-ea19db382a9794b3676b9208cc0b8e5873ada9105cfbdb2b8cfb27692e1f7979 WatchSource:0}: Error finding container ea19db382a9794b3676b9208cc0b8e5873ada9105cfbdb2b8cfb27692e1f7979: Status 404 returned error can't find the container with id ea19db382a9794b3676b9208cc0b8e5873ada9105cfbdb2b8cfb27692e1f7979
Sep 10 22:01:37.526059 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.526030    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:01:37.670174 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.670145    2577 apiserver.go:52] "Watching apiserver"
Sep 10 22:01:37.674819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.674792    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 22:01:37.682599 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.682562    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-8gghw","openshift-network-diagnostics/network-check-target-8ft52","openshift-network-operator/iptables-alerter-5tclh","openshift-ovn-kubernetes/ovnkube-node-jxqmk","kube-system/global-pull-secret-syncer-hv697","kube-system/konnectivity-agent-lnjgx","kube-system/kube-apiserver-proxy-ip-10-0-130-67.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2","openshift-cluster-node-tuning-operator/tuned-877wn","openshift-dns/node-resolver-jg6p2","openshift-image-registry/node-ca-4jw9j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-67.ec2.internal","openshift-multus/multus-5htbc","openshift-multus/multus-additional-cni-plugins-rdmgw"]
Sep 10 22:01:37.684563 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.684536    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jg6p2"
Sep 10 22:01:37.685760 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.685737    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.686906 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.686887    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5tclh"
Sep 10 22:01:37.687367 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.687348    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 22:01:37.687894 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.687874    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 22:01:37.687987 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.687900    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 22:01:37.688155 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.688135    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 22:01:37.688228 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.688155    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 22:01:37.688282 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.688224    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9dgfc\""
Sep 10 22:01:37.688282 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.688147    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jg8vm\""
Sep 10 22:01:37.688388 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.688360    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 22:01:37.688519 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.688505    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.689253 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.689235    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 22:01:37.689803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.689550    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 22:01:37.690035 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.690014    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 22:01:37.690035 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.690032    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 22:01:37.690276 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.690260    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nngt6\""
Sep 10 22:01:37.690442 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.690419    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 22:01:37.691029 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.690621    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 22:01:37.691029 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.690768    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 22:01:37.691029 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.691016    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 22:01:37.691222 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.691100    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c7ksq\""
Sep 10 22:01:37.691222 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.691016    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 22:01:37.691371 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.691354    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:37.691462 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.691370    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lnjgx"
Sep 10 22:01:37.691462 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:37.691441    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv697" podUID="950dcdf3-d64c-49e2-8e8b-8c8060fa7069"
Sep 10 22:01:37.692096 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.692079    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.693855 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.693240    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 22:01:37.693855 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.693266    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 22:01:37.693855 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.693493    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9nd2t\""
Sep 10 22:01:37.693855 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.693659    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sc9dj\""
Sep 10 22:01:37.693855 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.693799    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 22:01:37.694679 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.694659    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 22:01:37.694763 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.694749    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 22:01:37.695389 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.695375    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:37.696123 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.696093    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:01:37.696200 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:37.696155    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ft52" podUID="4ecebb0d-1784-4cf0-83d0-062dda8e42ce"
Sep 10 22:01:37.698061 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.697334    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:01:37.698061 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.697385    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 22:01:37.698061 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:37.697434    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gghw" podUID="d8a674c6-a1ec-4c69-885b-bb1a7b052aef"
Sep 10 22:01:37.698061 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.697555    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 22:01:37.698061 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.697928    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k6l75\""
Sep 10 22:01:37.699126 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.699097    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4jw9j"
Sep 10 22:01:37.700579 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.700559    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:37.702616 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.701048    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 22:01:37.702616 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.701205    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 22:01:37.702616 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.701251    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 22:01:37.702616 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.701435    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-69g6j\""
Sep 10 22:01:37.703943 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.703923    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qw9d6\""
Sep 10 22:01:37.704151 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.704133    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 22:01:37.704339 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.704325    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 22:01:37.704556 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.704534    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 22:01:37.708264 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708205    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-run-ovn\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.708264 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708241    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-host-cni-bin\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.708414 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708267    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a48cde00-ac8d-468e-b63d-5bdcc93d87f8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rdmgw\" (UID: \"a48cde00-ac8d-468e-b63d-5bdcc93d87f8\") " pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:37.708414 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708293    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-system-cni-dir\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.708414 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708316    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-hostroot\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.708414 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708339    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-host-run-multus-certs\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.708414 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708360    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-sys\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.708414 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708381    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-lib-modules\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.708414 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708403    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-etc-modprobe-d\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.708770 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708445    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cvsl\" (UniqueName: \"kubernetes.io/projected/324b3113-046f-4aa4-92cc-daca32755467-kube-api-access-2cvsl\") pod \"node-resolver-jg6p2\" (UID: \"324b3113-046f-4aa4-92cc-daca32755467\") " pod="openshift-dns/node-resolver-jg6p2"
Sep 10 22:01:37.708770 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708486    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-cnibin\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.708770 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708509    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c92ce384-f37d-4421-a15e-52632b1ae1ba-cni-binary-copy\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.708770 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708530    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-etc-kubernetes\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.708770 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708557    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-systemd-units\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.708770 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708580    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-var-lib-openvswitch\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.708770 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708602    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-etc-kubernetes\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.708770 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708627    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a48cde00-ac8d-468e-b63d-5bdcc93d87f8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rdmgw\" (UID: \"a48cde00-ac8d-468e-b63d-5bdcc93d87f8\") " pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:37.708770 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708691    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-host-run-netns\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.708770 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708716    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvqpb\" (UniqueName: \"kubernetes.io/projected/c92ce384-f37d-4421-a15e-52632b1ae1ba-kube-api-access-tvqpb\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.708770 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708741    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-host-run-netns\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.708770 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708764    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-host-cni-netd\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.709232 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708828    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a48cde00-ac8d-468e-b63d-5bdcc93d87f8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rdmgw\" (UID: \"a48cde00-ac8d-468e-b63d-5bdcc93d87f8\") " pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:37.709232 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708852    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-multus-cni-dir\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.709232 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708872    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-etc-sysconfig\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.709232 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708894    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/deed0389-4578-48f9-8c9b-76361618dfea-etc-tuned\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.709232 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708915    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/deed0389-4578-48f9-8c9b-76361618dfea-tmp\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.709232 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708939    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.709232 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.708974    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56aee085-8da2-4056-ad0e-990947b70d4f-env-overrides\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.709232 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.709001    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56aee085-8da2-4056-ad0e-990947b70d4f-ovn-node-metrics-cert\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.709232 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.709025    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99cecf04-45bd-4da1-92b3-f0d3540812f1-host-slash\") pod \"iptables-alerter-5tclh\" (UID: \"99cecf04-45bd-4da1-92b3-f0d3540812f1\") " pod="openshift-network-operator/iptables-alerter-5tclh"
Sep 10 22:01:37.709981 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.709960    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-dbus\") pod \"global-pull-secret-syncer-hv697\" (UID: \"950dcdf3-d64c-49e2-8e8b-8c8060fa7069\") " pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:37.710066 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710004    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-host-kubelet\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.710066 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710055    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/324b3113-046f-4aa4-92cc-daca32755467-hosts-file\") pod \"node-resolver-jg6p2\" (UID: \"324b3113-046f-4aa4-92cc-daca32755467\") " pod="openshift-dns/node-resolver-jg6p2"
Sep 10 22:01:37.710155 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710078    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-etc-openvswitch\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.710155 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710104    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-node-log\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.710155 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710134    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56aee085-8da2-4056-ad0e-990947b70d4f-ovnkube-config\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.710242 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710162    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.710242 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710195    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a48cde00-ac8d-468e-b63d-5bdcc93d87f8-cnibin\") pod \"multus-additional-cni-plugins-rdmgw\" (UID: \"a48cde00-ac8d-468e-b63d-5bdcc93d87f8\") " pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:37.710242 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710220    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-host-slash\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.710329 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710277    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-run-openvswitch\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.710329 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710308    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c92ce384-f37d-4421-a15e-52632b1ae1ba-multus-daemon-config\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.710384 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710349    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-run-systemd\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.710416 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710382    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-run\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.710446 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710414    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8cd40637-7020-4903-8bf4-71fb2be9ac48-konnectivity-ca\") pod \"konnectivity-agent-lnjgx\" (UID: \"8cd40637-7020-4903-8bf4-71fb2be9ac48\") " pod="kube-system/konnectivity-agent-lnjgx"
Sep 10 22:01:37.710477 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710441    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2g9p\" (UniqueName: \"kubernetes.io/projected/a48cde00-ac8d-468e-b63d-5bdcc93d87f8-kube-api-access-m2g9p\") pod \"multus-additional-cni-plugins-rdmgw\" (UID: \"a48cde00-ac8d-468e-b63d-5bdcc93d87f8\") " pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:37.710508 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710475    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-multus-socket-dir-parent\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.710552 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710514    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-host-run-k8s-cni-cncf-io\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.710586 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710552    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-host-var-lib-cni-bin\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.710586 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710575    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-multus-conf-dir\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.710643 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710623    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ql9m\" (UniqueName: \"kubernetes.io/projected/99cecf04-45bd-4da1-92b3-f0d3540812f1-kube-api-access-7ql9m\") pod \"iptables-alerter-5tclh\" (UID: \"99cecf04-45bd-4da1-92b3-f0d3540812f1\") " pod="openshift-network-operator/iptables-alerter-5tclh"
Sep 10 22:01:37.710684 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710653    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8cd40637-7020-4903-8bf4-71fb2be9ac48-agent-certs\") pod \"konnectivity-agent-lnjgx\" (UID: \"8cd40637-7020-4903-8bf4-71fb2be9ac48\") " pod="kube-system/konnectivity-agent-lnjgx"
Sep 10 22:01:37.710791 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710742    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2gds\" (UniqueName: \"kubernetes.io/projected/56aee085-8da2-4056-ad0e-990947b70d4f-kube-api-access-p2gds\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.710829 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710812    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret\") pod \"global-pull-secret-syncer-hv697\" (UID: \"950dcdf3-d64c-49e2-8e8b-8c8060fa7069\") " pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:37.710877 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710835    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/324b3113-046f-4aa4-92cc-daca32755467-tmp-dir\") pod \"node-resolver-jg6p2\" (UID: \"324b3113-046f-4aa4-92cc-daca32755467\") " pod="openshift-dns/node-resolver-jg6p2"
Sep 10 22:01:37.710927 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710873    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56aee085-8da2-4056-ad0e-990947b70d4f-ovnkube-script-lib\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.710927 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710902    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-etc-systemd\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.711022 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.710930    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-var-lib-kubelet\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.711102 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.711014    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/99cecf04-45bd-4da1-92b3-f0d3540812f1-iptables-alerter-script\") pod \"iptables-alerter-5tclh\" (UID: \"99cecf04-45bd-4da1-92b3-f0d3540812f1\") " pod="openshift-network-operator/iptables-alerter-5tclh"
Sep 10 22:01:37.711102 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.711067    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a48cde00-ac8d-468e-b63d-5bdcc93d87f8-system-cni-dir\") pod \"multus-additional-cni-plugins-rdmgw\" (UID: \"a48cde00-ac8d-468e-b63d-5bdcc93d87f8\") " pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:37.711457 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.711284    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-log-socket\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.711457 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.711324    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls6bd\" (UniqueName: \"kubernetes.io/projected/deed0389-4578-48f9-8c9b-76361618dfea-kube-api-access-ls6bd\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.711457 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.711355    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-kubelet-config\") pod \"global-pull-secret-syncer-hv697\" (UID: \"950dcdf3-d64c-49e2-8e8b-8c8060fa7069\") " pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:37.711557 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.711519    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a48cde00-ac8d-468e-b63d-5bdcc93d87f8-cni-binary-copy\") pod \"multus-additional-cni-plugins-rdmgw\" (UID: \"a48cde00-ac8d-468e-b63d-5bdcc93d87f8\") " pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:37.711943 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.711917    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lth9\" (UniqueName: \"kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9\") pod \"network-check-target-8ft52\" (UID: \"4ecebb0d-1784-4cf0-83d0-062dda8e42ce\") " pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:01:37.712009 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.711963    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-host-var-lib-cni-multus\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.712070 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.711995    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-host-var-lib-kubelet\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.712125 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.712060    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-etc-sysctl-d\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.712125 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.712099    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-etc-sysctl-conf\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.712222 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.712142    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-host\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.714323 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.714300    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 22:01:37.746198 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.746128    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qv5ks"
Sep 10 22:01:37.755367 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.755345    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qv5ks"
Sep 10 22:01:37.796791 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.796748    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 22:01:37.813807 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.812657    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ae49b47-6eb5-4b28-9c86-2ebf32ff97db-socket-dir\") pod \"aws-ebs-csi-driver-node-9nmp2\" (UID: \"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:37.813807 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.812696    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ae49b47-6eb5-4b28-9c86-2ebf32ff97db-device-dir\") pod \"aws-ebs-csi-driver-node-9nmp2\" (UID: \"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:37.813807 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.812723    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr924\" (UniqueName: \"kubernetes.io/projected/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-kube-api-access-qr924\") pod \"network-metrics-daemon-8gghw\" (UID: \"d8a674c6-a1ec-4c69-885b-bb1a7b052aef\") " pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:01:37.813807 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.812754    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-kubelet-config\") pod \"global-pull-secret-syncer-hv697\" (UID: \"950dcdf3-d64c-49e2-8e8b-8c8060fa7069\") " pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:37.813807 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.812794    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a48cde00-ac8d-468e-b63d-5bdcc93d87f8-cni-binary-copy\") pod \"multus-additional-cni-plugins-rdmgw\" (UID: \"a48cde00-ac8d-468e-b63d-5bdcc93d87f8\") " pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:37.813807 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.812818    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lth9\" (UniqueName: \"kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9\") pod \"network-check-target-8ft52\" (UID: \"4ecebb0d-1784-4cf0-83d0-062dda8e42ce\") " pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:01:37.813807 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.812841    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-host-var-lib-cni-multus\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.813807 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.812861    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-kubelet-config\") pod \"global-pull-secret-syncer-hv697\" (UID: \"950dcdf3-d64c-49e2-8e8b-8c8060fa7069\") " pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:37.813807 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.812905    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-host-var-lib-kubelet\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.813807 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.812864    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-host-var-lib-kubelet\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.813807 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.812938    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-etc-sysctl-d\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.813807 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.812961    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-etc-sysctl-conf\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.813807 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.812981    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ccb0482f-9c3a-4f1f-92c3-41816631091b-host\") pod \"node-ca-4jw9j\" (UID: \"ccb0482f-9c3a-4f1f-92c3-41816631091b\") " pod="openshift-image-registry/node-ca-4jw9j"
Sep 10 22:01:37.813807 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813010    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-host\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.813807 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813031    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ae49b47-6eb5-4b28-9c86-2ebf32ff97db-etc-selinux\") pod \"aws-ebs-csi-driver-node-9nmp2\" (UID: \"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:37.813807 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813055    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-run-ovn\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.813807 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813078    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-host-cni-bin\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.814696 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813100    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a48cde00-ac8d-468e-b63d-5bdcc93d87f8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rdmgw\" (UID: \"a48cde00-ac8d-468e-b63d-5bdcc93d87f8\") " pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:37.814696 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813123    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-system-cni-dir\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.814696 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813145    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-hostroot\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.814696 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813169    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-host-run-multus-certs\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.814696 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813205    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-host\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.814696 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813211    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-sys\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.814696 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813280    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-host-var-lib-cni-multus\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.814696 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813299    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-sys\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.814696 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813323    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-lib-modules\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.814696 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813340    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-run-ovn\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.814696 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813376    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-etc-modprobe-d\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.814696 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813403    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cvsl\" (UniqueName: \"kubernetes.io/projected/324b3113-046f-4aa4-92cc-daca32755467-kube-api-access-2cvsl\") pod \"node-resolver-jg6p2\" (UID: \"324b3113-046f-4aa4-92cc-daca32755467\") " pod="openshift-dns/node-resolver-jg6p2"
Sep 10 22:01:37.814696 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813441    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a48cde00-ac8d-468e-b63d-5bdcc93d87f8-cni-binary-copy\") pod \"multus-additional-cni-plugins-rdmgw\" (UID: \"a48cde00-ac8d-468e-b63d-5bdcc93d87f8\") " pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:37.814696 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813471    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-cnibin\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.814696 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813497    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c92ce384-f37d-4421-a15e-52632b1ae1ba-cni-binary-copy\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.814696 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813504    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-host-run-multus-certs\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.814696 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813521    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-etc-kubernetes\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.814696 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813497    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a48cde00-ac8d-468e-b63d-5bdcc93d87f8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rdmgw\" (UID: \"a48cde00-ac8d-468e-b63d-5bdcc93d87f8\") " pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:37.815454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813578    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-system-cni-dir\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.815454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813604    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-hostroot\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.815454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813615    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-etc-sysctl-conf\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.815454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813660    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-cnibin\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.815454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813684    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-lib-modules\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.815454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813706    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-etc-sysctl-d\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.815454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813689    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-systemd-units\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.815454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813741    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-host-cni-bin\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.815454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813757    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-etc-modprobe-d\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.815454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813753    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-var-lib-openvswitch\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.815454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813812    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-etc-kubernetes\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.815454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813836    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a48cde00-ac8d-468e-b63d-5bdcc93d87f8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rdmgw\" (UID: \"a48cde00-ac8d-468e-b63d-5bdcc93d87f8\") " pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:37.815454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813861    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-host-run-netns\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.815454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813916    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvqpb\" (UniqueName: \"kubernetes.io/projected/c92ce384-f37d-4421-a15e-52632b1ae1ba-kube-api-access-tvqpb\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.815454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813938    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-host-run-netns\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.815454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813960    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-host-cni-netd\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.815454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.813985    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ae49b47-6eb5-4b28-9c86-2ebf32ff97db-sys-fs\") pod \"aws-ebs-csi-driver-node-9nmp2\" (UID: \"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:37.815454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814010    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2825\" (UniqueName: \"kubernetes.io/projected/ccb0482f-9c3a-4f1f-92c3-41816631091b-kube-api-access-x2825\") pod \"node-ca-4jw9j\" (UID: \"ccb0482f-9c3a-4f1f-92c3-41816631091b\") " pod="openshift-image-registry/node-ca-4jw9j"
Sep 10 22:01:37.816351 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814038    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a48cde00-ac8d-468e-b63d-5bdcc93d87f8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rdmgw\" (UID: \"a48cde00-ac8d-468e-b63d-5bdcc93d87f8\") " pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:37.816351 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814080    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-multus-cni-dir\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.816351 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814144    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-etc-sysconfig\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.816351 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814170    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/deed0389-4578-48f9-8c9b-76361618dfea-etc-tuned\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.816351 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814169    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-etc-kubernetes\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.816351 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814192    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/deed0389-4578-48f9-8c9b-76361618dfea-tmp\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.816351 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814215    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ae49b47-6eb5-4b28-9c86-2ebf32ff97db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9nmp2\" (UID: \"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:37.816351 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814219    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-systemd-units\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.816351 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814242    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.816351 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814255    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-host-cni-netd\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.816351 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814268    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56aee085-8da2-4056-ad0e-990947b70d4f-env-overrides\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.816351 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814293    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56aee085-8da2-4056-ad0e-990947b70d4f-ovn-node-metrics-cert\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.816351 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814318    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99cecf04-45bd-4da1-92b3-f0d3540812f1-host-slash\") pod \"iptables-alerter-5tclh\" (UID: \"99cecf04-45bd-4da1-92b3-f0d3540812f1\") " pod="openshift-network-operator/iptables-alerter-5tclh"
Sep 10 22:01:37.816351 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814342    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfckc\" (UniqueName: \"kubernetes.io/projected/9ae49b47-6eb5-4b28-9c86-2ebf32ff97db-kube-api-access-qfckc\") pod \"aws-ebs-csi-driver-node-9nmp2\" (UID: \"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:37.816351 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814372    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-multus-cni-dir\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.816351 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814397    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-var-lib-openvswitch\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.816351 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814415    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-etc-sysconfig\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.817145 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814424    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-etc-kubernetes\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.817145 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814451    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-host-run-netns\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.817145 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814713    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c92ce384-f37d-4421-a15e-52632b1ae1ba-cni-binary-copy\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.817145 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814795    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a48cde00-ac8d-468e-b63d-5bdcc93d87f8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rdmgw\" (UID: \"a48cde00-ac8d-468e-b63d-5bdcc93d87f8\") " pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:37.817145 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814931    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-dbus\") pod \"global-pull-secret-syncer-hv697\" (UID: \"950dcdf3-d64c-49e2-8e8b-8c8060fa7069\") " pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:37.817145 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814950    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-host-kubelet\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.817145 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814967    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ccb0482f-9c3a-4f1f-92c3-41816631091b-serviceca\") pod \"node-ca-4jw9j\" (UID: \"ccb0482f-9c3a-4f1f-92c3-41816631091b\") " pod="openshift-image-registry/node-ca-4jw9j"
Sep 10 22:01:37.817145 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.814986    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/324b3113-046f-4aa4-92cc-daca32755467-hosts-file\") pod \"node-resolver-jg6p2\" (UID: \"324b3113-046f-4aa4-92cc-daca32755467\") " pod="openshift-dns/node-resolver-jg6p2"
Sep 10 22:01:37.817145 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815003    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-etc-openvswitch\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.817145 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815020    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-node-log\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.817145 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815064    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-host-run-netns\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.817145 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815070    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-etc-openvswitch\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.817145 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815130    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56aee085-8da2-4056-ad0e-990947b70d4f-ovnkube-config\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.817145 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815146    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 22:01:37.817145 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815158    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.817145 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815180    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99cecf04-45bd-4da1-92b3-f0d3540812f1-host-slash\") pod \"iptables-alerter-5tclh\" (UID: \"99cecf04-45bd-4da1-92b3-f0d3540812f1\") " pod="openshift-network-operator/iptables-alerter-5tclh"
Sep 10 22:01:37.817145 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815208    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a48cde00-ac8d-468e-b63d-5bdcc93d87f8-cnibin\") pod \"multus-additional-cni-plugins-rdmgw\" (UID: \"a48cde00-ac8d-468e-b63d-5bdcc93d87f8\") " pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:37.817145 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815234    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-host-slash\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.818046 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815242    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-dbus\") pod \"global-pull-secret-syncer-hv697\" (UID: \"950dcdf3-d64c-49e2-8e8b-8c8060fa7069\") " pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:37.818046 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815153    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a48cde00-ac8d-468e-b63d-5bdcc93d87f8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rdmgw\" (UID: \"a48cde00-ac8d-468e-b63d-5bdcc93d87f8\") " pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:37.818046 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815291    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-run-openvswitch\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.818046 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815305    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-host-slash\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.818046 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815312    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c92ce384-f37d-4421-a15e-52632b1ae1ba-multus-daemon-config\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.818046 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815329    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-host-kubelet\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.818046 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815329    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-run-systemd\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.818046 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815351    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-run\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.818046 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815353    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-run-systemd\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.818046 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815367    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs\") pod \"network-metrics-daemon-8gghw\" (UID: \"d8a674c6-a1ec-4c69-885b-bb1a7b052aef\") " pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:01:37.818046 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815379    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-run-openvswitch\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.818046 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815395    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.818046 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815511    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a48cde00-ac8d-468e-b63d-5bdcc93d87f8-cnibin\") pod \"multus-additional-cni-plugins-rdmgw\" (UID: \"a48cde00-ac8d-468e-b63d-5bdcc93d87f8\") " pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:37.818046 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815634    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-node-log\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.818046 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815683    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/324b3113-046f-4aa4-92cc-daca32755467-hosts-file\") pod \"node-resolver-jg6p2\" (UID: \"324b3113-046f-4aa4-92cc-daca32755467\") " pod="openshift-dns/node-resolver-jg6p2"
Sep 10 22:01:37.818046 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815899    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-run\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.818046 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815981    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56aee085-8da2-4056-ad0e-990947b70d4f-env-overrides\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.818046 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.815981    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c92ce384-f37d-4421-a15e-52632b1ae1ba-multus-daemon-config\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.818918 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816015    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.818918 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816049    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8cd40637-7020-4903-8bf4-71fb2be9ac48-konnectivity-ca\") pod \"konnectivity-agent-lnjgx\" (UID: \"8cd40637-7020-4903-8bf4-71fb2be9ac48\") " pod="kube-system/konnectivity-agent-lnjgx"
Sep 10 22:01:37.818918 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816132    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56aee085-8da2-4056-ad0e-990947b70d4f-ovnkube-config\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.818918 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816114    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2g9p\" (UniqueName: \"kubernetes.io/projected/a48cde00-ac8d-468e-b63d-5bdcc93d87f8-kube-api-access-m2g9p\") pod \"multus-additional-cni-plugins-rdmgw\" (UID: \"a48cde00-ac8d-468e-b63d-5bdcc93d87f8\") " pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:37.818918 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816219    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-multus-socket-dir-parent\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.818918 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816334    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-host-run-k8s-cni-cncf-io\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.818918 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816370    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-host-var-lib-cni-bin\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.818918 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816431    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-multus-conf-dir\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.818918 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816457    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ql9m\" (UniqueName: \"kubernetes.io/projected/99cecf04-45bd-4da1-92b3-f0d3540812f1-kube-api-access-7ql9m\") pod \"iptables-alerter-5tclh\" (UID: \"99cecf04-45bd-4da1-92b3-f0d3540812f1\") " pod="openshift-network-operator/iptables-alerter-5tclh"
Sep 10 22:01:37.818918 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816482    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8cd40637-7020-4903-8bf4-71fb2be9ac48-agent-certs\") pod \"konnectivity-agent-lnjgx\" (UID: \"8cd40637-7020-4903-8bf4-71fb2be9ac48\") " pod="kube-system/konnectivity-agent-lnjgx"
Sep 10 22:01:37.818918 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816483    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-multus-socket-dir-parent\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.818918 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816521    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2gds\" (UniqueName: \"kubernetes.io/projected/56aee085-8da2-4056-ad0e-990947b70d4f-kube-api-access-p2gds\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.818918 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816540    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret\") pod \"global-pull-secret-syncer-hv697\" (UID: \"950dcdf3-d64c-49e2-8e8b-8c8060fa7069\") " pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:37.818918 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816555    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/324b3113-046f-4aa4-92cc-daca32755467-tmp-dir\") pod \"node-resolver-jg6p2\" (UID: \"324b3113-046f-4aa4-92cc-daca32755467\") " pod="openshift-dns/node-resolver-jg6p2"
Sep 10 22:01:37.818918 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816560    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8cd40637-7020-4903-8bf4-71fb2be9ac48-konnectivity-ca\") pod \"konnectivity-agent-lnjgx\" (UID: \"8cd40637-7020-4903-8bf4-71fb2be9ac48\") " pod="kube-system/konnectivity-agent-lnjgx"
Sep 10 22:01:37.818918 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816595    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-multus-conf-dir\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.818918 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816618    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56aee085-8da2-4056-ad0e-990947b70d4f-ovnkube-script-lib\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.819960 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816636    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-etc-systemd\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.819960 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816658    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-var-lib-kubelet\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.819960 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816674    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/99cecf04-45bd-4da1-92b3-f0d3540812f1-iptables-alerter-script\") pod \"iptables-alerter-5tclh\" (UID: \"99cecf04-45bd-4da1-92b3-f0d3540812f1\") " pod="openshift-network-operator/iptables-alerter-5tclh"
Sep 10 22:01:37.819960 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816692    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ae49b47-6eb5-4b28-9c86-2ebf32ff97db-registration-dir\") pod \"aws-ebs-csi-driver-node-9nmp2\" (UID: \"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:37.819960 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:37.816722    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:01:37.819960 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816769    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-etc-systemd\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.819960 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816842    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-host-var-lib-cni-bin\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.819960 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.816860    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c92ce384-f37d-4421-a15e-52632b1ae1ba-host-run-k8s-cni-cncf-io\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.819960 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:37.816949    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret podName:950dcdf3-d64c-49e2-8e8b-8c8060fa7069 nodeName:}" failed. No retries permitted until 2026-09-10 22:01:38.316929469 +0000 UTC m=+2.989027373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret") pod "global-pull-secret-syncer-hv697" (UID: "950dcdf3-d64c-49e2-8e8b-8c8060fa7069") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:01:37.819960 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.817072    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/324b3113-046f-4aa4-92cc-daca32755467-tmp-dir\") pod \"node-resolver-jg6p2\" (UID: \"324b3113-046f-4aa4-92cc-daca32755467\") " pod="openshift-dns/node-resolver-jg6p2"
Sep 10 22:01:37.819960 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.817137    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a48cde00-ac8d-468e-b63d-5bdcc93d87f8-system-cni-dir\") pod \"multus-additional-cni-plugins-rdmgw\" (UID: \"a48cde00-ac8d-468e-b63d-5bdcc93d87f8\") " pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:37.819960 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.817183    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a48cde00-ac8d-468e-b63d-5bdcc93d87f8-system-cni-dir\") pod \"multus-additional-cni-plugins-rdmgw\" (UID: \"a48cde00-ac8d-468e-b63d-5bdcc93d87f8\") " pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:37.819960 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.817221    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-log-socket\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.819960 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.817269    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56aee085-8da2-4056-ad0e-990947b70d4f-ovnkube-script-lib\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.819960 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.817266    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls6bd\" (UniqueName: \"kubernetes.io/projected/deed0389-4578-48f9-8c9b-76361618dfea-kube-api-access-ls6bd\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.819960 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.817299    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/deed0389-4578-48f9-8c9b-76361618dfea-var-lib-kubelet\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.819960 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.817317    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56aee085-8da2-4056-ad0e-990947b70d4f-log-socket\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.820757 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.817741    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/99cecf04-45bd-4da1-92b3-f0d3540812f1-iptables-alerter-script\") pod \"iptables-alerter-5tclh\" (UID: \"99cecf04-45bd-4da1-92b3-f0d3540812f1\") " pod="openshift-network-operator/iptables-alerter-5tclh"
Sep 10 22:01:37.820757 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.819595    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/deed0389-4578-48f9-8c9b-76361618dfea-etc-tuned\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.820757 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.819713    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56aee085-8da2-4056-ad0e-990947b70d4f-ovn-node-metrics-cert\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.820757 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:37.819881    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:01:37.820757 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:37.819902    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:01:37.820757 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:37.819915    2577 projected.go:196] Error preparing data for projected volume kube-api-access-7lth9 for pod openshift-network-diagnostics/network-check-target-8ft52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:01:37.820757 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:37.819985    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9 podName:4ecebb0d-1784-4cf0-83d0-062dda8e42ce nodeName:}" failed. No retries permitted until 2026-09-10 22:01:38.319968418 +0000 UTC m=+2.992066319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7lth9" (UniqueName: "kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9") pod "network-check-target-8ft52" (UID: "4ecebb0d-1784-4cf0-83d0-062dda8e42ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:01:37.822341 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.822315    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8cd40637-7020-4903-8bf4-71fb2be9ac48-agent-certs\") pod \"konnectivity-agent-lnjgx\" (UID: \"8cd40637-7020-4903-8bf4-71fb2be9ac48\") " pod="kube-system/konnectivity-agent-lnjgx"
Sep 10 22:01:37.823524 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.823501    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cvsl\" (UniqueName: \"kubernetes.io/projected/324b3113-046f-4aa4-92cc-daca32755467-kube-api-access-2cvsl\") pod \"node-resolver-jg6p2\" (UID: \"324b3113-046f-4aa4-92cc-daca32755467\") " pod="openshift-dns/node-resolver-jg6p2"
Sep 10 22:01:37.828141 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.828108    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2g9p\" (UniqueName: \"kubernetes.io/projected/a48cde00-ac8d-468e-b63d-5bdcc93d87f8-kube-api-access-m2g9p\") pod \"multus-additional-cni-plugins-rdmgw\" (UID: \"a48cde00-ac8d-468e-b63d-5bdcc93d87f8\") " pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:37.830056 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.830035    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ql9m\" (UniqueName: \"kubernetes.io/projected/99cecf04-45bd-4da1-92b3-f0d3540812f1-kube-api-access-7ql9m\") pod \"iptables-alerter-5tclh\" (UID: \"99cecf04-45bd-4da1-92b3-f0d3540812f1\") " pod="openshift-network-operator/iptables-alerter-5tclh"
Sep 10 22:01:37.830206 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.830183    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/deed0389-4578-48f9-8c9b-76361618dfea-tmp\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.831114 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.831095    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls6bd\" (UniqueName: \"kubernetes.io/projected/deed0389-4578-48f9-8c9b-76361618dfea-kube-api-access-ls6bd\") pod \"tuned-877wn\" (UID: \"deed0389-4578-48f9-8c9b-76361618dfea\") " pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:37.831962 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.831906    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvqpb\" (UniqueName: \"kubernetes.io/projected/c92ce384-f37d-4421-a15e-52632b1ae1ba-kube-api-access-tvqpb\") pod \"multus-5htbc\" (UID: \"c92ce384-f37d-4421-a15e-52632b1ae1ba\") " pod="openshift-multus/multus-5htbc"
Sep 10 22:01:37.832845 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.832830    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2gds\" (UniqueName: \"kubernetes.io/projected/56aee085-8da2-4056-ad0e-990947b70d4f-kube-api-access-p2gds\") pod \"ovnkube-node-jxqmk\" (UID: \"56aee085-8da2-4056-ad0e-990947b70d4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:37.851320 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.851270    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-67.ec2.internal" event={"ID":"8f17cbcfb74fe83456186f4ef7bd3634","Type":"ContainerStarted","Data":"ea19db382a9794b3676b9208cc0b8e5873ada9105cfbdb2b8cfb27692e1f7979"}
Sep 10 22:01:37.852608 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.852586    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-67.ec2.internal" event={"ID":"30837abf95c6ef4eb29dd502c80f9ab0","Type":"ContainerStarted","Data":"d3c10e5054389e68716c0ee711a6dcbe61e432eee074df63175678d4a04069e9"}
Sep 10 22:01:37.918432 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.918378    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ae49b47-6eb5-4b28-9c86-2ebf32ff97db-registration-dir\") pod \"aws-ebs-csi-driver-node-9nmp2\" (UID: \"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:37.918432 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.918436    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ae49b47-6eb5-4b28-9c86-2ebf32ff97db-socket-dir\") pod \"aws-ebs-csi-driver-node-9nmp2\" (UID: \"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:37.918662 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.918526    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ae49b47-6eb5-4b28-9c86-2ebf32ff97db-registration-dir\") pod \"aws-ebs-csi-driver-node-9nmp2\" (UID: \"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:37.918662 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.918571    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ae49b47-6eb5-4b28-9c86-2ebf32ff97db-device-dir\") pod \"aws-ebs-csi-driver-node-9nmp2\" (UID: \"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:37.918662 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.918589    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ae49b47-6eb5-4b28-9c86-2ebf32ff97db-socket-dir\") pod \"aws-ebs-csi-driver-node-9nmp2\" (UID: \"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:37.918662 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.918600    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr924\" (UniqueName: \"kubernetes.io/projected/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-kube-api-access-qr924\") pod \"network-metrics-daemon-8gghw\" (UID: \"d8a674c6-a1ec-4c69-885b-bb1a7b052aef\") " pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:01:37.918662 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.918644    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ccb0482f-9c3a-4f1f-92c3-41816631091b-host\") pod \"node-ca-4jw9j\" (UID: \"ccb0482f-9c3a-4f1f-92c3-41816631091b\") " pod="openshift-image-registry/node-ca-4jw9j"
Sep 10 22:01:37.918662 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.918649    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ae49b47-6eb5-4b28-9c86-2ebf32ff97db-device-dir\") pod \"aws-ebs-csi-driver-node-9nmp2\" (UID: \"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:37.918983 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.918671    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ae49b47-6eb5-4b28-9c86-2ebf32ff97db-etc-selinux\") pod \"aws-ebs-csi-driver-node-9nmp2\" (UID: \"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:37.918983 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.918710    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ae49b47-6eb5-4b28-9c86-2ebf32ff97db-sys-fs\") pod \"aws-ebs-csi-driver-node-9nmp2\" (UID: \"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:37.918983 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.918733    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2825\" (UniqueName: \"kubernetes.io/projected/ccb0482f-9c3a-4f1f-92c3-41816631091b-kube-api-access-x2825\") pod \"node-ca-4jw9j\" (UID: \"ccb0482f-9c3a-4f1f-92c3-41816631091b\") " pod="openshift-image-registry/node-ca-4jw9j"
Sep 10 22:01:37.918983 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.918760    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ae49b47-6eb5-4b28-9c86-2ebf32ff97db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9nmp2\" (UID: \"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:37.918983 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.918805    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfckc\" (UniqueName: \"kubernetes.io/projected/9ae49b47-6eb5-4b28-9c86-2ebf32ff97db-kube-api-access-qfckc\") pod \"aws-ebs-csi-driver-node-9nmp2\" (UID: \"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:37.918983 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.918830    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ccb0482f-9c3a-4f1f-92c3-41816631091b-serviceca\") pod \"node-ca-4jw9j\" (UID: \"ccb0482f-9c3a-4f1f-92c3-41816631091b\") " pod="openshift-image-registry/node-ca-4jw9j"
Sep 10 22:01:37.918983 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.918864    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs\") pod \"network-metrics-daemon-8gghw\" (UID: \"d8a674c6-a1ec-4c69-885b-bb1a7b052aef\") " pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:01:37.919291 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:37.919030    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:01:37.919291 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:37.919123    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs podName:d8a674c6-a1ec-4c69-885b-bb1a7b052aef nodeName:}" failed. No retries permitted until 2026-09-10 22:01:38.419079887 +0000 UTC m=+3.091177800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs") pod "network-metrics-daemon-8gghw" (UID: "d8a674c6-a1ec-4c69-885b-bb1a7b052aef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:01:37.919291 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.919175    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ccb0482f-9c3a-4f1f-92c3-41816631091b-host\") pod \"node-ca-4jw9j\" (UID: \"ccb0482f-9c3a-4f1f-92c3-41816631091b\") " pod="openshift-image-registry/node-ca-4jw9j"
Sep 10 22:01:37.919444 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.919299    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ae49b47-6eb5-4b28-9c86-2ebf32ff97db-etc-selinux\") pod \"aws-ebs-csi-driver-node-9nmp2\" (UID: \"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:37.919444 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.919355    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ae49b47-6eb5-4b28-9c86-2ebf32ff97db-sys-fs\") pod \"aws-ebs-csi-driver-node-9nmp2\" (UID: \"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:37.919539 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.919518    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ccb0482f-9c3a-4f1f-92c3-41816631091b-serviceca\") pod \"node-ca-4jw9j\" (UID: \"ccb0482f-9c3a-4f1f-92c3-41816631091b\") " pod="openshift-image-registry/node-ca-4jw9j"
Sep 10 22:01:37.919618 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.919587    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ae49b47-6eb5-4b28-9c86-2ebf32ff97db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9nmp2\" (UID: \"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:37.928850 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.928720    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2825\" (UniqueName: \"kubernetes.io/projected/ccb0482f-9c3a-4f1f-92c3-41816631091b-kube-api-access-x2825\") pod \"node-ca-4jw9j\" (UID: \"ccb0482f-9c3a-4f1f-92c3-41816631091b\") " pod="openshift-image-registry/node-ca-4jw9j"
Sep 10 22:01:37.930237 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.930190    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr924\" (UniqueName: \"kubernetes.io/projected/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-kube-api-access-qr924\") pod \"network-metrics-daemon-8gghw\" (UID: \"d8a674c6-a1ec-4c69-885b-bb1a7b052aef\") " pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:01:37.931983 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.931955    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfckc\" (UniqueName: \"kubernetes.io/projected/9ae49b47-6eb5-4b28-9c86-2ebf32ff97db-kube-api-access-qfckc\") pod \"aws-ebs-csi-driver-node-9nmp2\" (UID: \"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:37.997577 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:37.997543    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jg6p2"
Sep 10 22:01:38.006466 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.006438    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5htbc"
Sep 10 22:01:38.007674 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:38.007649    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod324b3113_046f_4aa4_92cc_daca32755467.slice/crio-84f733c3da7f3e3ebec3fbcf7dcc952d8025e460a75b81d7b893800194174e99 WatchSource:0}: Error finding container 84f733c3da7f3e3ebec3fbcf7dcc952d8025e460a75b81d7b893800194174e99: Status 404 returned error can't find the container with id 84f733c3da7f3e3ebec3fbcf7dcc952d8025e460a75b81d7b893800194174e99
Sep 10 22:01:38.016687 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:38.016659    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc92ce384_f37d_4421_a15e_52632b1ae1ba.slice/crio-88ea02d81840285fff7a08f1178571828068decb20fffc8251c46c63743815a4 WatchSource:0}: Error finding container 88ea02d81840285fff7a08f1178571828068decb20fffc8251c46c63743815a4: Status 404 returned error can't find the container with id 88ea02d81840285fff7a08f1178571828068decb20fffc8251c46c63743815a4
Sep 10 22:01:38.017443 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.017427    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5tclh"
Sep 10 22:01:38.024448 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.024429    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:01:38.030430 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.030399    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lnjgx"
Sep 10 22:01:38.030922 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:38.030898    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99cecf04_45bd_4da1_92b3_f0d3540812f1.slice/crio-18555e03bd86be2cab998700e8679dd7393203af4e71606b7b81e6fc5f7964e7 WatchSource:0}: Error finding container 18555e03bd86be2cab998700e8679dd7393203af4e71606b7b81e6fc5f7964e7: Status 404 returned error can't find the container with id 18555e03bd86be2cab998700e8679dd7393203af4e71606b7b81e6fc5f7964e7
Sep 10 22:01:38.037469 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:38.037446    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56aee085_8da2_4056_ad0e_990947b70d4f.slice/crio-db8a51a7844d1cd64487f280ba330a7eda10dbb49a63b356727bd6cf3d991961 WatchSource:0}: Error finding container db8a51a7844d1cd64487f280ba330a7eda10dbb49a63b356727bd6cf3d991961: Status 404 returned error can't find the container with id db8a51a7844d1cd64487f280ba330a7eda10dbb49a63b356727bd6cf3d991961
Sep 10 22:01:38.037565 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.037550    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-877wn"
Sep 10 22:01:38.044446 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:38.044425    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cd40637_7020_4903_8bf4_71fb2be9ac48.slice/crio-280182feb69436e6dfdfe9687dacb7acbc6683f24c44103622af8b3733fe33d9 WatchSource:0}: Error finding container 280182feb69436e6dfdfe9687dacb7acbc6683f24c44103622af8b3733fe33d9: Status 404 returned error can't find the container with id 280182feb69436e6dfdfe9687dacb7acbc6683f24c44103622af8b3733fe33d9
Sep 10 22:01:38.045722 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.045528    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rdmgw"
Sep 10 22:01:38.054862 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.054842    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4jw9j"
Sep 10 22:01:38.057631 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:38.057594    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda48cde00_ac8d_468e_b63d_5bdcc93d87f8.slice/crio-ed17f04d9e941970949de4116edfb2e52b7aacf7191a3223fad657381cdb92c8 WatchSource:0}: Error finding container ed17f04d9e941970949de4116edfb2e52b7aacf7191a3223fad657381cdb92c8: Status 404 returned error can't find the container with id ed17f04d9e941970949de4116edfb2e52b7aacf7191a3223fad657381cdb92c8
Sep 10 22:01:38.060509 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.060484    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2"
Sep 10 22:01:38.065741 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:38.065710    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccb0482f_9c3a_4f1f_92c3_41816631091b.slice/crio-57837e985db3aaa74423a3241ec4a78a19515a1171c40bf6dcd5800abbf3ef15 WatchSource:0}: Error finding container 57837e985db3aaa74423a3241ec4a78a19515a1171c40bf6dcd5800abbf3ef15: Status 404 returned error can't find the container with id 57837e985db3aaa74423a3241ec4a78a19515a1171c40bf6dcd5800abbf3ef15
Sep 10 22:01:38.072816 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:01:38.072290    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ae49b47_6eb5_4b28_9c86_2ebf32ff97db.slice/crio-1a919011be9c4433b88a9fd112990d7abf070f48c0e55e0d4b9fa67033ebac8b WatchSource:0}: Error finding container 1a919011be9c4433b88a9fd112990d7abf070f48c0e55e0d4b9fa67033ebac8b: Status 404 returned error can't find the container with id 1a919011be9c4433b88a9fd112990d7abf070f48c0e55e0d4b9fa67033ebac8b
Sep 10 22:01:38.322336 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.322249    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lth9\" (UniqueName: \"kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9\") pod \"network-check-target-8ft52\" (UID: \"4ecebb0d-1784-4cf0-83d0-062dda8e42ce\") " pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:01:38.322336 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.322324    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret\") pod \"global-pull-secret-syncer-hv697\" (UID: \"950dcdf3-d64c-49e2-8e8b-8c8060fa7069\") " pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:38.322513 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:38.322444    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:01:38.322513 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:38.322498    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret podName:950dcdf3-d64c-49e2-8e8b-8c8060fa7069 nodeName:}" failed. No retries permitted until 2026-09-10 22:01:39.32248013 +0000 UTC m=+3.994578034 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret") pod "global-pull-secret-syncer-hv697" (UID: "950dcdf3-d64c-49e2-8e8b-8c8060fa7069") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:01:38.322910 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:38.322886    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:01:38.323067 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:38.322920    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:01:38.323067 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:38.322934    2577 projected.go:196] Error preparing data for projected volume kube-api-access-7lth9 for pod openshift-network-diagnostics/network-check-target-8ft52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:01:38.323067 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:38.322978    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9 podName:4ecebb0d-1784-4cf0-83d0-062dda8e42ce nodeName:}" failed. No retries permitted until 2026-09-10 22:01:39.32296695 +0000 UTC m=+3.995064848 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7lth9" (UniqueName: "kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9") pod "network-check-target-8ft52" (UID: "4ecebb0d-1784-4cf0-83d0-062dda8e42ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:01:38.422680 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.422635    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs\") pod \"network-metrics-daemon-8gghw\" (UID: \"d8a674c6-a1ec-4c69-885b-bb1a7b052aef\") " pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:01:38.422855 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:38.422803    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:01:38.422905 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:38.422864    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs podName:d8a674c6-a1ec-4c69-885b-bb1a7b052aef nodeName:}" failed. No retries permitted until 2026-09-10 22:01:39.42284884 +0000 UTC m=+4.094946761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs") pod "network-metrics-daemon-8gghw" (UID: "d8a674c6-a1ec-4c69-885b-bb1a7b052aef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:01:38.757908 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.757868    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 21:56:37 +0000 UTC" deadline="2028-02-24 18:45:24.666587592 +0000 UTC"
Sep 10 22:01:38.757908 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.757904    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12764h43m45.908687291s"
Sep 10 22:01:38.842078 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.842041    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:01:38.842228 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:38.842205    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gghw" podUID="d8a674c6-a1ec-4c69-885b-bb1a7b052aef"
Sep 10 22:01:38.855791 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.855738    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5htbc" event={"ID":"c92ce384-f37d-4421-a15e-52632b1ae1ba","Type":"ContainerStarted","Data":"88ea02d81840285fff7a08f1178571828068decb20fffc8251c46c63743815a4"}
Sep 10 22:01:38.857204 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.857175    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jg6p2" event={"ID":"324b3113-046f-4aa4-92cc-daca32755467","Type":"ContainerStarted","Data":"84f733c3da7f3e3ebec3fbcf7dcc952d8025e460a75b81d7b893800194174e99"}
Sep 10 22:01:38.858437 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.858408    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4jw9j" event={"ID":"ccb0482f-9c3a-4f1f-92c3-41816631091b","Type":"ContainerStarted","Data":"57837e985db3aaa74423a3241ec4a78a19515a1171c40bf6dcd5800abbf3ef15"}
Sep 10 22:01:38.859857 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.859835    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rdmgw" event={"ID":"a48cde00-ac8d-468e-b63d-5bdcc93d87f8","Type":"ContainerStarted","Data":"ed17f04d9e941970949de4116edfb2e52b7aacf7191a3223fad657381cdb92c8"}
Sep 10 22:01:38.861050 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.861028    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-877wn" event={"ID":"deed0389-4578-48f9-8c9b-76361618dfea","Type":"ContainerStarted","Data":"562b2ad6d75ac24fbd00db327a1a854436b1cb54106be6bebc3664cfc07d8e6f"}
Sep 10 22:01:38.862541 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.862486    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lnjgx" event={"ID":"8cd40637-7020-4903-8bf4-71fb2be9ac48","Type":"ContainerStarted","Data":"280182feb69436e6dfdfe9687dacb7acbc6683f24c44103622af8b3733fe33d9"}
Sep 10 22:01:38.863831 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.863809    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk" event={"ID":"56aee085-8da2-4056-ad0e-990947b70d4f","Type":"ContainerStarted","Data":"db8a51a7844d1cd64487f280ba330a7eda10dbb49a63b356727bd6cf3d991961"}
Sep 10 22:01:38.865172 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.865144    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5tclh" event={"ID":"99cecf04-45bd-4da1-92b3-f0d3540812f1","Type":"ContainerStarted","Data":"18555e03bd86be2cab998700e8679dd7393203af4e71606b7b81e6fc5f7964e7"}
Sep 10 22:01:38.866890 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:38.866477    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2" event={"ID":"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db","Type":"ContainerStarted","Data":"1a919011be9c4433b88a9fd112990d7abf070f48c0e55e0d4b9fa67033ebac8b"}
Sep 10 22:01:39.331058 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:39.331018    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lth9\" (UniqueName: \"kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9\") pod \"network-check-target-8ft52\" (UID: \"4ecebb0d-1784-4cf0-83d0-062dda8e42ce\") " pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:01:39.331221 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:39.331112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret\") pod \"global-pull-secret-syncer-hv697\" (UID: \"950dcdf3-d64c-49e2-8e8b-8c8060fa7069\") " pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:39.331302 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:39.331228    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:01:39.331302 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:39.331288    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret podName:950dcdf3-d64c-49e2-8e8b-8c8060fa7069 nodeName:}" failed. No retries permitted until 2026-09-10 22:01:41.331271214 +0000 UTC m=+6.003369130 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret") pod "global-pull-secret-syncer-hv697" (UID: "950dcdf3-d64c-49e2-8e8b-8c8060fa7069") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:01:39.331719 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:39.331699    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:01:39.331823 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:39.331725    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:01:39.331823 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:39.331738    2577 projected.go:196] Error preparing data for projected volume kube-api-access-7lth9 for pod openshift-network-diagnostics/network-check-target-8ft52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:01:39.331823 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:39.331801    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9 podName:4ecebb0d-1784-4cf0-83d0-062dda8e42ce nodeName:}" failed. No retries permitted until 2026-09-10 22:01:41.331768426 +0000 UTC m=+6.003866339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7lth9" (UniqueName: "kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9") pod "network-check-target-8ft52" (UID: "4ecebb0d-1784-4cf0-83d0-062dda8e42ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:01:39.431956 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:39.431912    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs\") pod \"network-metrics-daemon-8gghw\" (UID: \"d8a674c6-a1ec-4c69-885b-bb1a7b052aef\") " pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:01:39.432117 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:39.432057    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:01:39.432187 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:39.432119    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs podName:d8a674c6-a1ec-4c69-885b-bb1a7b052aef nodeName:}" failed. No retries permitted until 2026-09-10 22:01:41.432101554 +0000 UTC m=+6.104199468 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs") pod "network-metrics-daemon-8gghw" (UID: "d8a674c6-a1ec-4c69-885b-bb1a7b052aef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:01:39.767613 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:39.767553    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 21:56:37 +0000 UTC" deadline="2028-05-11 11:25:12.309843502 +0000 UTC"
Sep 10 22:01:39.768099 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:39.767622    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14605h23m32.542235003s"
Sep 10 22:01:39.844260 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:39.844229    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:39.844403 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:39.844370    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv697" podUID="950dcdf3-d64c-49e2-8e8b-8c8060fa7069"
Sep 10 22:01:39.846922 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:39.846893    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:01:39.847055 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:39.847021    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ft52" podUID="4ecebb0d-1784-4cf0-83d0-062dda8e42ce"
Sep 10 22:01:39.881126 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:39.881089    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-67.ec2.internal" event={"ID":"30837abf95c6ef4eb29dd502c80f9ab0","Type":"ContainerStarted","Data":"50d0847810de77d5249c079876d6c146414b29ab307a0b29041989104f3e3541"}
Sep 10 22:01:39.895466 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:39.895409    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-67.ec2.internal" podStartSLOduration=2.895389329 podStartE2EDuration="2.895389329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:01:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:01:39.894995958 +0000 UTC m=+4.567093880" watchObservedRunningTime="2026-09-10 22:01:39.895389329 +0000 UTC m=+4.567487252"
Sep 10 22:01:40.842635 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:40.841759    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:01:40.842635 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:40.842135    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gghw" podUID="d8a674c6-a1ec-4c69-885b-bb1a7b052aef"
Sep 10 22:01:40.892922 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:40.892875    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-67.ec2.internal" event={"ID":"8f17cbcfb74fe83456186f4ef7bd3634","Type":"ContainerStarted","Data":"f9ad3d28e8df9a8de2193d516128451194e679b115ed0f816d21decb898826c7"}
Sep 10 22:01:41.350764 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:41.350734    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lth9\" (UniqueName: \"kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9\") pod \"network-check-target-8ft52\" (UID: \"4ecebb0d-1784-4cf0-83d0-062dda8e42ce\") " pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:01:41.351010 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:41.350820    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret\") pod \"global-pull-secret-syncer-hv697\" (UID: \"950dcdf3-d64c-49e2-8e8b-8c8060fa7069\") " pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:41.351010 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:41.350915    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:01:41.351010 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:41.350964    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret podName:950dcdf3-d64c-49e2-8e8b-8c8060fa7069 nodeName:}" failed. No retries permitted until 2026-09-10 22:01:45.350949952 +0000 UTC m=+10.023047851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret") pod "global-pull-secret-syncer-hv697" (UID: "950dcdf3-d64c-49e2-8e8b-8c8060fa7069") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:01:41.351180 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:41.351073    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:01:41.351180 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:41.351098    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:01:41.351180 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:41.351112    2577 projected.go:196] Error preparing data for projected volume kube-api-access-7lth9 for pod openshift-network-diagnostics/network-check-target-8ft52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:01:41.351296 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:41.351173    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9 podName:4ecebb0d-1784-4cf0-83d0-062dda8e42ce nodeName:}" failed. No retries permitted until 2026-09-10 22:01:45.351154807 +0000 UTC m=+10.023252712 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7lth9" (UniqueName: "kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9") pod "network-check-target-8ft52" (UID: "4ecebb0d-1784-4cf0-83d0-062dda8e42ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:01:41.452802 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:41.451489    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs\") pod \"network-metrics-daemon-8gghw\" (UID: \"d8a674c6-a1ec-4c69-885b-bb1a7b052aef\") " pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:01:41.452802 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:41.451676    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:01:41.452802 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:41.451740    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs podName:d8a674c6-a1ec-4c69-885b-bb1a7b052aef nodeName:}" failed. No retries permitted until 2026-09-10 22:01:45.451721258 +0000 UTC m=+10.123819161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs") pod "network-metrics-daemon-8gghw" (UID: "d8a674c6-a1ec-4c69-885b-bb1a7b052aef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:01:41.842401 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:41.842370    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:01:41.842584 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:41.842516    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ft52" podUID="4ecebb0d-1784-4cf0-83d0-062dda8e42ce"
Sep 10 22:01:41.843030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:41.842370    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:41.843030 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:41.842973    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv697" podUID="950dcdf3-d64c-49e2-8e8b-8c8060fa7069"
Sep 10 22:01:42.841706 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:42.841197    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:01:42.841706 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:42.841338    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gghw" podUID="d8a674c6-a1ec-4c69-885b-bb1a7b052aef"
Sep 10 22:01:42.899029 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:42.898991    2577 generic.go:356] "Generic (PLEG): container finished" podID="8f17cbcfb74fe83456186f4ef7bd3634" containerID="f9ad3d28e8df9a8de2193d516128451194e679b115ed0f816d21decb898826c7" exitCode=0
Sep 10 22:01:42.899503 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:42.899038    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-67.ec2.internal" event={"ID":"8f17cbcfb74fe83456186f4ef7bd3634","Type":"ContainerDied","Data":"f9ad3d28e8df9a8de2193d516128451194e679b115ed0f816d21decb898826c7"}
Sep 10 22:01:43.844659 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:43.843972    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:43.844659 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:43.844127    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv697" podUID="950dcdf3-d64c-49e2-8e8b-8c8060fa7069"
Sep 10 22:01:43.844659 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:43.844495    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:01:43.844659 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:43.844602    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ft52" podUID="4ecebb0d-1784-4cf0-83d0-062dda8e42ce"
Sep 10 22:01:44.841655 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:44.841569    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:01:44.842146 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:44.841728    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gghw" podUID="d8a674c6-a1ec-4c69-885b-bb1a7b052aef"
Sep 10 22:01:45.385255 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:45.385213    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret\") pod \"global-pull-secret-syncer-hv697\" (UID: \"950dcdf3-d64c-49e2-8e8b-8c8060fa7069\") " pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:45.385255 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:45.385273    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lth9\" (UniqueName: \"kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9\") pod \"network-check-target-8ft52\" (UID: \"4ecebb0d-1784-4cf0-83d0-062dda8e42ce\") " pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:01:45.385521 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:45.385389    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:01:45.385521 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:45.385426    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:01:45.385521 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:45.385446    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:01:45.385521 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:45.385460    2577 projected.go:196] Error preparing data for projected volume kube-api-access-7lth9 for pod openshift-network-diagnostics/network-check-target-8ft52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:01:45.385521 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:45.385468    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret podName:950dcdf3-d64c-49e2-8e8b-8c8060fa7069 nodeName:}" failed. No retries permitted until 2026-09-10 22:01:53.385448488 +0000 UTC m=+18.057546392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret") pod "global-pull-secret-syncer-hv697" (UID: "950dcdf3-d64c-49e2-8e8b-8c8060fa7069") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:01:45.385521 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:45.385509    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9 podName:4ecebb0d-1784-4cf0-83d0-062dda8e42ce nodeName:}" failed. No retries permitted until 2026-09-10 22:01:53.385492975 +0000 UTC m=+18.057590889 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7lth9" (UniqueName: "kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9") pod "network-check-target-8ft52" (UID: "4ecebb0d-1784-4cf0-83d0-062dda8e42ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:01:45.487169 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:45.486549    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs\") pod \"network-metrics-daemon-8gghw\" (UID: \"d8a674c6-a1ec-4c69-885b-bb1a7b052aef\") " pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:01:45.487169 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:45.486742    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:01:45.487169 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:45.486826    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs podName:d8a674c6-a1ec-4c69-885b-bb1a7b052aef nodeName:}" failed. No retries permitted until 2026-09-10 22:01:53.486805203 +0000 UTC m=+18.158903121 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs") pod "network-metrics-daemon-8gghw" (UID: "d8a674c6-a1ec-4c69-885b-bb1a7b052aef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:01:45.842843 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:45.842395    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:01:45.842843 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:45.842520    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ft52" podUID="4ecebb0d-1784-4cf0-83d0-062dda8e42ce"
Sep 10 22:01:45.843310 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:45.842932    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:45.843310 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:45.843030    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv697" podUID="950dcdf3-d64c-49e2-8e8b-8c8060fa7069"
Sep 10 22:01:46.841742 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:46.841697    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:01:46.841941 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:46.841860    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gghw" podUID="d8a674c6-a1ec-4c69-885b-bb1a7b052aef"
Sep 10 22:01:47.841666 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:47.841635    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:01:47.842094 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:47.841636    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:47.842094 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:47.841764    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ft52" podUID="4ecebb0d-1784-4cf0-83d0-062dda8e42ce"
Sep 10 22:01:47.842094 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:47.841892    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv697" podUID="950dcdf3-d64c-49e2-8e8b-8c8060fa7069"
Sep 10 22:01:48.841162 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:48.841134    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:01:48.841266 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:48.841237    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gghw" podUID="d8a674c6-a1ec-4c69-885b-bb1a7b052aef"
Sep 10 22:01:49.841626 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:49.841592    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:49.842071 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:49.841718    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv697" podUID="950dcdf3-d64c-49e2-8e8b-8c8060fa7069"
Sep 10 22:01:49.842071 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:49.841795    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:01:49.842071 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:49.841903    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ft52" podUID="4ecebb0d-1784-4cf0-83d0-062dda8e42ce"
Sep 10 22:01:50.841113 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:50.841079    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:01:50.841275 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:50.841210    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gghw" podUID="d8a674c6-a1ec-4c69-885b-bb1a7b052aef"
Sep 10 22:01:51.841451 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:51.841413    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:51.841884 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:51.841528    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv697" podUID="950dcdf3-d64c-49e2-8e8b-8c8060fa7069"
Sep 10 22:01:51.841884 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:51.841587    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:01:51.841884 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:51.841695    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ft52" podUID="4ecebb0d-1784-4cf0-83d0-062dda8e42ce"
Sep 10 22:01:52.841325 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:52.841287    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:01:52.841545 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:52.841405    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gghw" podUID="d8a674c6-a1ec-4c69-885b-bb1a7b052aef"
Sep 10 22:01:53.445170 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:53.445129    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret\") pod \"global-pull-secret-syncer-hv697\" (UID: \"950dcdf3-d64c-49e2-8e8b-8c8060fa7069\") " pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:53.445342 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:53.445189    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lth9\" (UniqueName: \"kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9\") pod \"network-check-target-8ft52\" (UID: \"4ecebb0d-1784-4cf0-83d0-062dda8e42ce\") " pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:01:53.445342 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:53.445312    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:01:53.445342 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:53.445310    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:01:53.445342 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:53.445327    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:01:53.445342 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:53.445344    2577 projected.go:196] Error preparing data for projected volume kube-api-access-7lth9 for pod openshift-network-diagnostics/network-check-target-8ft52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:01:53.445539 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:53.445392    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret podName:950dcdf3-d64c-49e2-8e8b-8c8060fa7069 nodeName:}" failed. No retries permitted until 2026-09-10 22:02:09.445371627 +0000 UTC m=+34.117469540 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret") pod "global-pull-secret-syncer-hv697" (UID: "950dcdf3-d64c-49e2-8e8b-8c8060fa7069") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:01:53.445539 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:53.445413    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9 podName:4ecebb0d-1784-4cf0-83d0-062dda8e42ce nodeName:}" failed. No retries permitted until 2026-09-10 22:02:09.445403269 +0000 UTC m=+34.117501173 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7lth9" (UniqueName: "kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9") pod "network-check-target-8ft52" (UID: "4ecebb0d-1784-4cf0-83d0-062dda8e42ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:01:53.546462 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:53.546423    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs\") pod \"network-metrics-daemon-8gghw\" (UID: \"d8a674c6-a1ec-4c69-885b-bb1a7b052aef\") " pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:01:53.546628 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:53.546601    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:01:53.546703 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:53.546694    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs podName:d8a674c6-a1ec-4c69-885b-bb1a7b052aef nodeName:}" failed. No retries permitted until 2026-09-10 22:02:09.546670484 +0000 UTC m=+34.218768401 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs") pod "network-metrics-daemon-8gghw" (UID: "d8a674c6-a1ec-4c69-885b-bb1a7b052aef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:01:53.841356 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:53.841265    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:53.841535 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:53.841410    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv697" podUID="950dcdf3-d64c-49e2-8e8b-8c8060fa7069"
Sep 10 22:01:53.841535 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:53.841477    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:01:53.841882 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:53.841582    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ft52" podUID="4ecebb0d-1784-4cf0-83d0-062dda8e42ce"
Sep 10 22:01:54.842011 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:54.841975    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:01:54.842503 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:54.842128    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gghw" podUID="d8a674c6-a1ec-4c69-885b-bb1a7b052aef"
Sep 10 22:01:55.841844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:55.841744    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:01:55.841844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:55.841830    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:55.842089 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:55.841932    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ft52" podUID="4ecebb0d-1784-4cf0-83d0-062dda8e42ce"
Sep 10 22:01:55.842089 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:55.842057    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv697" podUID="950dcdf3-d64c-49e2-8e8b-8c8060fa7069"
Sep 10 22:01:56.842101 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:56.841934    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:01:56.842485 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:56.842190    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gghw" podUID="d8a674c6-a1ec-4c69-885b-bb1a7b052aef"
Sep 10 22:01:56.932134 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:56.932103    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2" event={"ID":"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db","Type":"ContainerStarted","Data":"855ea816c810916f21a6e988c26c5b768b1506992f48a32deaf1accfb749afab"}
Sep 10 22:01:56.933743 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:56.933720    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5htbc" event={"ID":"c92ce384-f37d-4421-a15e-52632b1ae1ba","Type":"ContainerStarted","Data":"ccad5592fca8ca30714316f08a24fee020b03c63b833bd4eaca810d62a7dfa96"}
Sep 10 22:01:56.935174 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:56.935150    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jg6p2" event={"ID":"324b3113-046f-4aa4-92cc-daca32755467","Type":"ContainerStarted","Data":"e56656ed6f43b1eae5ec92fa0f852ad36ea6bf7d194b72c75cb2e62128761c46"}
Sep 10 22:01:56.936739 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:56.936714    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-67.ec2.internal" event={"ID":"8f17cbcfb74fe83456186f4ef7bd3634","Type":"ContainerStarted","Data":"9db0880334e406f385e5ad59bfa0e07d20cebc50da3106f31c0a59bf76bc67c7"}
Sep 10 22:01:56.938031 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:56.938009    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4jw9j" event={"ID":"ccb0482f-9c3a-4f1f-92c3-41816631091b","Type":"ContainerStarted","Data":"2bacea8a1b492bd90375112d5d68307d74d9163acdbb65c7031b8077c751ed1c"}
Sep 10 22:01:56.939206 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:56.939181    2577 generic.go:356] "Generic (PLEG): container finished" podID="a48cde00-ac8d-468e-b63d-5bdcc93d87f8" containerID="00e42e1ffa9b8ffb9ea95dbee10fb111033aae090e690a128153b5ad0e76cbac" exitCode=0
Sep 10 22:01:56.939277 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:56.939244    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rdmgw" event={"ID":"a48cde00-ac8d-468e-b63d-5bdcc93d87f8","Type":"ContainerDied","Data":"00e42e1ffa9b8ffb9ea95dbee10fb111033aae090e690a128153b5ad0e76cbac"}
Sep 10 22:01:56.940649 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:56.940627    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-877wn" event={"ID":"deed0389-4578-48f9-8c9b-76361618dfea","Type":"ContainerStarted","Data":"7f6023ad82af365c8cd21337d76104fdbd7b09127728073da25e92a816ac233b"}
Sep 10 22:01:56.942037 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:56.942012    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lnjgx" event={"ID":"8cd40637-7020-4903-8bf4-71fb2be9ac48","Type":"ContainerStarted","Data":"c5715317150b8dfc3a213be265e876c00ce628b093cd469cf996a9471d92eaea"}
Sep 10 22:01:56.944231 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:56.944206    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk" event={"ID":"56aee085-8da2-4056-ad0e-990947b70d4f","Type":"ContainerStarted","Data":"20de06b1b4e45f387ac17f4ca99e1910ac57d18bc9049b46f1d56fc35faaad52"}
Sep 10 22:01:56.944326 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:56.944267    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk" event={"ID":"56aee085-8da2-4056-ad0e-990947b70d4f","Type":"ContainerStarted","Data":"643736bcad7743fa13db947b4aa1340752e1b68fc7a42f9fc07e4afe622c8d5b"}
Sep 10 22:01:56.971740 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:56.971691    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-67.ec2.internal" podStartSLOduration=19.971677305 podStartE2EDuration="19.971677305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:01:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:01:56.971605645 +0000 UTC m=+21.643703564" watchObservedRunningTime="2026-09-10 22:01:56.971677305 +0000 UTC m=+21.643775226"
Sep 10 22:01:56.995578 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:56.995534    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5htbc" podStartSLOduration=3.6597899739999997 podStartE2EDuration="21.995517859s" totalImagesPullingTime="18.335727885s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:01:56.995374341 +0000 UTC m=+21.667472273" watchObservedRunningTime="2026-09-10 22:01:56.995517859 +0000 UTC m=+21.667615781"
Sep 10 22:01:57.008626 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:57.008580    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jg6p2" podStartSLOduration=3.711259342 podStartE2EDuration="22.008561939s" totalImagesPullingTime="18.297302597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:01:57.008345968 +0000 UTC m=+21.680443889" watchObservedRunningTime="2026-09-10 22:01:57.008561939 +0000 UTC m=+21.680659860"
Sep 10 22:01:57.024520 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:57.024480    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lnjgx" podStartSLOduration=3.768051566 podStartE2EDuration="22.024468284s" totalImagesPullingTime="18.256416718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:01:57.023995987 +0000 UTC m=+21.696093910" watchObservedRunningTime="2026-09-10 22:01:57.024468284 +0000 UTC m=+21.696566206"
Sep 10 22:01:57.041471 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:57.041431    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-877wn" podStartSLOduration=3.788902713 podStartE2EDuration="22.04141447s" totalImagesPullingTime="18.252511757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:01:57.041226698 +0000 UTC m=+21.713324610" watchObservedRunningTime="2026-09-10 22:01:57.04141447 +0000 UTC m=+21.713512391"
Sep 10 22:01:57.060167 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:57.057925    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4jw9j" podStartSLOduration=3.8209556620000003 podStartE2EDuration="22.05790542s" totalImagesPullingTime="18.236949758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:01:57.057874307 +0000 UTC m=+21.729972229" watchObservedRunningTime="2026-09-10 22:01:57.05790542 +0000 UTC m=+21.730003342"
Sep 10 22:01:57.842260 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:57.841990    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:57.843178 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:57.842064    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:01:57.843178 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:57.842351    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv697" podUID="950dcdf3-d64c-49e2-8e8b-8c8060fa7069"
Sep 10 22:01:57.843178 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:57.842417    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ft52" podUID="4ecebb0d-1784-4cf0-83d0-062dda8e42ce"
Sep 10 22:01:57.950508 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:57.950477    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk" event={"ID":"56aee085-8da2-4056-ad0e-990947b70d4f","Type":"ContainerStarted","Data":"43f60d5b51ddd240d9e787ada33d35cdc325cd5e0db3e4c2b25d8466b9c06a01"}
Sep 10 22:01:57.950647 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:57.950566    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk" event={"ID":"56aee085-8da2-4056-ad0e-990947b70d4f","Type":"ContainerStarted","Data":"68d790ca5d3f0f5efb4d5edbe4ba58e0f3278815135973eb7a5ffc9bcc658b4a"}
Sep 10 22:01:57.950647 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:57.950615    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk" event={"ID":"56aee085-8da2-4056-ad0e-990947b70d4f","Type":"ContainerStarted","Data":"7a5a2d3f499c3ffa20b4b097f351d6f7014d4fe2bde4048930352d4721c94c4c"}
Sep 10 22:01:57.950755 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:57.950658    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk" event={"ID":"56aee085-8da2-4056-ad0e-990947b70d4f","Type":"ContainerStarted","Data":"0ea2a762c8d4fc3c139c547bae6152713d04fb09bdb9446b699254672f3b7399"}
Sep 10 22:01:57.952207 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:57.952175    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5tclh" event={"ID":"99cecf04-45bd-4da1-92b3-f0d3540812f1","Type":"ContainerStarted","Data":"9788c79bcde0deea90b2ca9e9f6c4769e00fbd2fff37f1b366aca495669ebf6d"}
Sep 10 22:01:58.085356 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:58.085325    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 22:01:58.255982 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:58.255889    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lnjgx"
Sep 10 22:01:58.256623 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:58.256601    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lnjgx"
Sep 10 22:01:58.271656 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:58.271602    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5tclh" podStartSLOduration=4.999873142 podStartE2EDuration="23.271581042s" totalImagesPullingTime="18.2717079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:01:57.968419953 +0000 UTC m=+22.640517877" watchObservedRunningTime="2026-09-10 22:01:58.271581042 +0000 UTC m=+22.943678964"
Sep 10 22:01:58.779361 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:58.779261    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T22:01:58.085349074Z","UUID":"7006da70-efd8-4352-9364-bcb5b562b5fe","Handler":null,"Name":"","Endpoint":""}
Sep 10 22:01:58.781039 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:58.781006    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 22:01:58.781181 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:58.781051    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 22:01:58.841537 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:58.841508    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:01:58.841716 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:58.841646    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gghw" podUID="d8a674c6-a1ec-4c69-885b-bb1a7b052aef"
Sep 10 22:01:58.956960 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:58.956923    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2" event={"ID":"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db","Type":"ContainerStarted","Data":"e7c058df68f23d2980b6b742a5380d310358c2be5d9ba587f55ffda89aa7faf7"}
Sep 10 22:01:58.957442 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:58.957380    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lnjgx"
Sep 10 22:01:58.957743 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:58.957726    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lnjgx"
Sep 10 22:01:59.842188 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:59.842080    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:01:59.842188 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:59.842124    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:01:59.842404 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:59.842232    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv697" podUID="950dcdf3-d64c-49e2-8e8b-8c8060fa7069"
Sep 10 22:01:59.842404 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:01:59.842323    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ft52" podUID="4ecebb0d-1784-4cf0-83d0-062dda8e42ce"
Sep 10 22:01:59.963669 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:59.963633    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk" event={"ID":"56aee085-8da2-4056-ad0e-990947b70d4f","Type":"ContainerStarted","Data":"124f1b984c0e1759b7ff5b38c965b234af9b99f1ef24545a4bbdd4fb9190e9ce"}
Sep 10 22:01:59.966226 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:59.966193    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2" event={"ID":"9ae49b47-6eb5-4b28-9c86-2ebf32ff97db","Type":"ContainerStarted","Data":"5f42c047a88c65057246256382993f13a3367d6e389332e9db753d1b8e059a6b"}
Sep 10 22:01:59.984213 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:01:59.984162    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nmp2" podStartSLOduration=4.408116719 podStartE2EDuration="24.9841425s" totalImagesPullingTime="20.576025781s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:01:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:01:59.983537838 +0000 UTC m=+24.655635761" watchObservedRunningTime="2026-09-10 22:01:59.9841425 +0000 UTC m=+24.656240421"
Sep 10 22:02:00.841911 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:00.841874    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:02:00.842126 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:00.842010    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gghw" podUID="d8a674c6-a1ec-4c69-885b-bb1a7b052aef"
Sep 10 22:02:01.842364 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:01.841806    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:02:01.842364 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:01.841806    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:02:01.842364 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:01.842145    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ft52" podUID="4ecebb0d-1784-4cf0-83d0-062dda8e42ce"
Sep 10 22:02:01.842364 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:01.842238    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv697" podUID="950dcdf3-d64c-49e2-8e8b-8c8060fa7069"
Sep 10 22:02:01.973480 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:01.973449    2577 generic.go:356] "Generic (PLEG): container finished" podID="a48cde00-ac8d-468e-b63d-5bdcc93d87f8" containerID="90567556dd1977af7f516ddc428ea18da4682c60486d716258a13fd20f7a01b9" exitCode=0
Sep 10 22:02:01.973621 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:01.973534    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rdmgw" event={"ID":"a48cde00-ac8d-468e-b63d-5bdcc93d87f8","Type":"ContainerDied","Data":"90567556dd1977af7f516ddc428ea18da4682c60486d716258a13fd20f7a01b9"}
Sep 10 22:02:01.977684 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:01.977655    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk" event={"ID":"56aee085-8da2-4056-ad0e-990947b70d4f","Type":"ContainerStarted","Data":"7c544d688c32dbe0451550bb83b115b62aedea81f2c91b15c10ff98bde2b2ff9"}
Sep 10 22:02:01.978000 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:01.977985    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:02:01.993666 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:01.993642    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:02:02.020747 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:02.020690    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk" podStartSLOduration=8.332268235 podStartE2EDuration="27.020676678s" totalImagesPullingTime="18.688408443s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:02:02.01933111 +0000 UTC m=+26.691429031" watchObservedRunningTime="2026-09-10 22:02:02.020676678 +0000 UTC m=+26.692774598"
Sep 10 22:02:02.841380 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:02.841349    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:02:02.841546 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:02.841473    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gghw" podUID="d8a674c6-a1ec-4c69-885b-bb1a7b052aef"
Sep 10 22:02:02.981539 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:02.981432    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:02:02.982372 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:02.981858    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:02:03.002180 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:03.002145    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:02:03.665441 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:03.665260    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8ft52"]
Sep 10 22:02:03.665618 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:03.665548    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:02:03.665685 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:03.665652    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ft52" podUID="4ecebb0d-1784-4cf0-83d0-062dda8e42ce"
Sep 10 22:02:03.668536 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:03.668497    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hv697"]
Sep 10 22:02:03.668664 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:03.668622    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:02:03.668758 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:03.668725    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv697" podUID="950dcdf3-d64c-49e2-8e8b-8c8060fa7069"
Sep 10 22:02:03.669042 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:03.669013    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8gghw"]
Sep 10 22:02:03.669131 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:03.669096    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:02:03.669208 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:03.669184    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gghw" podUID="d8a674c6-a1ec-4c69-885b-bb1a7b052aef"
Sep 10 22:02:03.985796 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:03.985741    2577 generic.go:356] "Generic (PLEG): container finished" podID="a48cde00-ac8d-468e-b63d-5bdcc93d87f8" containerID="7595e5dac5a2574894666289975225acf4badf068642bdc6f85e567d73c84887" exitCode=0
Sep 10 22:02:03.986280 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:03.985821    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rdmgw" event={"ID":"a48cde00-ac8d-468e-b63d-5bdcc93d87f8","Type":"ContainerDied","Data":"7595e5dac5a2574894666289975225acf4badf068642bdc6f85e567d73c84887"}
Sep 10 22:02:04.842150 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:04.842047    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:02:04.842317 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:04.842187    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv697" podUID="950dcdf3-d64c-49e2-8e8b-8c8060fa7069"
Sep 10 22:02:04.991066 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:04.991032    2577 generic.go:356] "Generic (PLEG): container finished" podID="a48cde00-ac8d-468e-b63d-5bdcc93d87f8" containerID="f7e7e8b4075ad4c6f967fd8f7c32e9be7c3cede398e58fdebe3b6807107dac4c" exitCode=0
Sep 10 22:02:04.991462 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:04.991160    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rdmgw" event={"ID":"a48cde00-ac8d-468e-b63d-5bdcc93d87f8","Type":"ContainerDied","Data":"f7e7e8b4075ad4c6f967fd8f7c32e9be7c3cede398e58fdebe3b6807107dac4c"}
Sep 10 22:02:05.842739 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:05.842703    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:02:05.842920 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:05.842889    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ft52" podUID="4ecebb0d-1784-4cf0-83d0-062dda8e42ce"
Sep 10 22:02:05.843146 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:05.843003    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:02:05.843146 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:05.843123    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gghw" podUID="d8a674c6-a1ec-4c69-885b-bb1a7b052aef"
Sep 10 22:02:06.841999 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:06.841917    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:02:06.842428 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:06.842029    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv697" podUID="950dcdf3-d64c-49e2-8e8b-8c8060fa7069"
Sep 10 22:02:07.841872 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:07.841838    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:02:07.842031 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:07.841845    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:02:07.842031 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:07.841963    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ft52" podUID="4ecebb0d-1784-4cf0-83d0-062dda8e42ce"
Sep 10 22:02:07.842436 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:07.842085    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gghw" podUID="d8a674c6-a1ec-4c69-885b-bb1a7b052aef"
Sep 10 22:02:08.841296 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:08.841259    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:02:08.841514 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:08.841381    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv697" podUID="950dcdf3-d64c-49e2-8e8b-8c8060fa7069"
Sep 10 22:02:09.124514 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.124430    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-67.ec2.internal" event="NodeReady"
Sep 10 22:02:09.124944 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.124598    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 22:02:09.173035 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.172988    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4jtgl"]
Sep 10 22:02:09.203910 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.203877    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w524p"]
Sep 10 22:02:09.204082 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.203996    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4jtgl"
Sep 10 22:02:09.206798 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.206752    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fw62z\""
Sep 10 22:02:09.206798 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.206765    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 22:02:09.206999 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.206849    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 22:02:09.207120 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.207100    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 22:02:09.217739 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.217709    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w524p"]
Sep 10 22:02:09.217739 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.217743    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4jtgl"]
Sep 10 22:02:09.217943 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.217911    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w524p"
Sep 10 22:02:09.219887 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.219865    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 22:02:09.219995 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.219891    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 22:02:09.219995 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.219925    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qt6wb\""
Sep 10 22:02:09.371532 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.371487    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/271823ee-f2c9-4afa-bd8b-66f666095c92-tmp-dir\") pod \"dns-default-w524p\" (UID: \"271823ee-f2c9-4afa-bd8b-66f666095c92\") " pod="openshift-dns/dns-default-w524p"
Sep 10 22:02:09.371532 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.371532    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzv9z\" (UniqueName: \"kubernetes.io/projected/271823ee-f2c9-4afa-bd8b-66f666095c92-kube-api-access-zzv9z\") pod \"dns-default-w524p\" (UID: \"271823ee-f2c9-4afa-bd8b-66f666095c92\") " pod="openshift-dns/dns-default-w524p"
Sep 10 22:02:09.371731 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.371630    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls\") pod \"dns-default-w524p\" (UID: \"271823ee-f2c9-4afa-bd8b-66f666095c92\") " pod="openshift-dns/dns-default-w524p"
Sep 10 22:02:09.371731 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.371680    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/271823ee-f2c9-4afa-bd8b-66f666095c92-config-volume\") pod \"dns-default-w524p\" (UID: \"271823ee-f2c9-4afa-bd8b-66f666095c92\") " pod="openshift-dns/dns-default-w524p"
Sep 10 22:02:09.371731 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.371712    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3693b69-6ebd-4065-895c-328d90290ce8-cert\") pod \"ingress-canary-4jtgl\" (UID: \"a3693b69-6ebd-4065-895c-328d90290ce8\") " pod="openshift-ingress-canary/ingress-canary-4jtgl"
Sep 10 22:02:09.371898 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.371804    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7hm5\" (UniqueName: \"kubernetes.io/projected/a3693b69-6ebd-4065-895c-328d90290ce8-kube-api-access-f7hm5\") pod \"ingress-canary-4jtgl\" (UID: \"a3693b69-6ebd-4065-895c-328d90290ce8\") " pod="openshift-ingress-canary/ingress-canary-4jtgl"
Sep 10 22:02:09.472846 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.472805    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7hm5\" (UniqueName: \"kubernetes.io/projected/a3693b69-6ebd-4065-895c-328d90290ce8-kube-api-access-f7hm5\") pod \"ingress-canary-4jtgl\" (UID: \"a3693b69-6ebd-4065-895c-328d90290ce8\") " pod="openshift-ingress-canary/ingress-canary-4jtgl"
Sep 10 22:02:09.472846 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.472847    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/271823ee-f2c9-4afa-bd8b-66f666095c92-tmp-dir\") pod \"dns-default-w524p\" (UID: \"271823ee-f2c9-4afa-bd8b-66f666095c92\") " pod="openshift-dns/dns-default-w524p"
Sep 10 22:02:09.473106 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.472875    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzv9z\" (UniqueName: \"kubernetes.io/projected/271823ee-f2c9-4afa-bd8b-66f666095c92-kube-api-access-zzv9z\") pod \"dns-default-w524p\" (UID: \"271823ee-f2c9-4afa-bd8b-66f666095c92\") " pod="openshift-dns/dns-default-w524p"
Sep 10 22:02:09.473106 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.473020    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls\") pod \"dns-default-w524p\" (UID: \"271823ee-f2c9-4afa-bd8b-66f666095c92\") " pod="openshift-dns/dns-default-w524p"
Sep 10 22:02:09.473106 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.473053    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret\") pod \"global-pull-secret-syncer-hv697\" (UID: \"950dcdf3-d64c-49e2-8e8b-8c8060fa7069\") " pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:02:09.473106 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.473082    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/271823ee-f2c9-4afa-bd8b-66f666095c92-config-volume\") pod \"dns-default-w524p\" (UID: \"271823ee-f2c9-4afa-bd8b-66f666095c92\") " pod="openshift-dns/dns-default-w524p"
Sep 10 22:02:09.473106 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.473109    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3693b69-6ebd-4065-895c-328d90290ce8-cert\") pod \"ingress-canary-4jtgl\" (UID: \"a3693b69-6ebd-4065-895c-328d90290ce8\") " pod="openshift-ingress-canary/ingress-canary-4jtgl"
Sep 10 22:02:09.473380 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:09.473124    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:02:09.473380 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:09.473164    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:02:09.473380 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.473133    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lth9\" (UniqueName: \"kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9\") pod \"network-check-target-8ft52\" (UID: \"4ecebb0d-1784-4cf0-83d0-062dda8e42ce\") " pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:02:09.473380 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.473173    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/271823ee-f2c9-4afa-bd8b-66f666095c92-tmp-dir\") pod \"dns-default-w524p\" (UID: \"271823ee-f2c9-4afa-bd8b-66f666095c92\") " pod="openshift-dns/dns-default-w524p"
Sep 10 22:02:09.473380 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:09.473208    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls podName:271823ee-f2c9-4afa-bd8b-66f666095c92 nodeName:}" failed. No retries permitted until 2026-09-10 22:02:09.973170587 +0000 UTC m=+34.645268518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls") pod "dns-default-w524p" (UID: "271823ee-f2c9-4afa-bd8b-66f666095c92") : secret "dns-default-metrics-tls" not found
Sep 10 22:02:09.473380 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:09.473208    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:02:09.473380 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:09.473232    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:02:09.473380 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:09.473244    2577 projected.go:196] Error preparing data for projected volume kube-api-access-7lth9 for pod openshift-network-diagnostics/network-check-target-8ft52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:02:09.473380 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:09.473248    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret podName:950dcdf3-d64c-49e2-8e8b-8c8060fa7069 nodeName:}" failed. No retries permitted until 2026-09-10 22:02:41.473227002 +0000 UTC m=+66.145324907 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret") pod "global-pull-secret-syncer-hv697" (UID: "950dcdf3-d64c-49e2-8e8b-8c8060fa7069") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:02:09.473380 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:09.473288    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9 podName:4ecebb0d-1784-4cf0-83d0-062dda8e42ce nodeName:}" failed. No retries permitted until 2026-09-10 22:02:41.473274375 +0000 UTC m=+66.145372274 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7lth9" (UniqueName: "kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9") pod "network-check-target-8ft52" (UID: "4ecebb0d-1784-4cf0-83d0-062dda8e42ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:02:09.473697 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.473630    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/271823ee-f2c9-4afa-bd8b-66f666095c92-config-volume\") pod \"dns-default-w524p\" (UID: \"271823ee-f2c9-4afa-bd8b-66f666095c92\") " pod="openshift-dns/dns-default-w524p"
Sep 10 22:02:09.477815 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.477795    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3693b69-6ebd-4065-895c-328d90290ce8-cert\") pod \"ingress-canary-4jtgl\" (UID: \"a3693b69-6ebd-4065-895c-328d90290ce8\") " pod="openshift-ingress-canary/ingress-canary-4jtgl"
Sep 10 22:02:09.480786 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.480760    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzv9z\" (UniqueName: \"kubernetes.io/projected/271823ee-f2c9-4afa-bd8b-66f666095c92-kube-api-access-zzv9z\") pod \"dns-default-w524p\" (UID: \"271823ee-f2c9-4afa-bd8b-66f666095c92\") " pod="openshift-dns/dns-default-w524p"
Sep 10 22:02:09.481221 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.480986    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7hm5\" (UniqueName: \"kubernetes.io/projected/a3693b69-6ebd-4065-895c-328d90290ce8-kube-api-access-f7hm5\") pod \"ingress-canary-4jtgl\" (UID: \"a3693b69-6ebd-4065-895c-328d90290ce8\") " pod="openshift-ingress-canary/ingress-canary-4jtgl"
Sep 10 22:02:09.515310 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.515273    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4jtgl"
Sep 10 22:02:09.574181 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.573933    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs\") pod \"network-metrics-daemon-8gghw\" (UID: \"d8a674c6-a1ec-4c69-885b-bb1a7b052aef\") " pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:02:09.574338 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:09.574099    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:02:09.574338 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:09.574308    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs podName:d8a674c6-a1ec-4c69-885b-bb1a7b052aef nodeName:}" failed. No retries permitted until 2026-09-10 22:02:41.574285805 +0000 UTC m=+66.246383710 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs") pod "network-metrics-daemon-8gghw" (UID: "d8a674c6-a1ec-4c69-885b-bb1a7b052aef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:02:09.823088 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.823058    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4jtgl"]
Sep 10 22:02:09.826987 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:02:09.826963    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3693b69_6ebd_4065_895c_328d90290ce8.slice/crio-593dacfe4c7c71859ff9c190c7e8a28d9c454b051542fbabd5e5c7f640e7c7be WatchSource:0}: Error finding container 593dacfe4c7c71859ff9c190c7e8a28d9c454b051542fbabd5e5c7f640e7c7be: Status 404 returned error can't find the container with id 593dacfe4c7c71859ff9c190c7e8a28d9c454b051542fbabd5e5c7f640e7c7be
Sep 10 22:02:09.841316 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.841281    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:02:09.841472 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.841281    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:02:09.843495 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.843442    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vfb6l\""
Sep 10 22:02:09.843495 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.843454    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5csvl\""
Sep 10 22:02:09.843495 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.843468    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 22:02:09.843495 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.843474    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 22:02:09.844049 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.843894    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 22:02:09.977418 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:09.977346    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls\") pod \"dns-default-w524p\" (UID: \"271823ee-f2c9-4afa-bd8b-66f666095c92\") " pod="openshift-dns/dns-default-w524p"
Sep 10 22:02:09.977557 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:09.977507    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:02:09.977678 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:09.977577    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls podName:271823ee-f2c9-4afa-bd8b-66f666095c92 nodeName:}" failed. No retries permitted until 2026-09-10 22:02:10.97755833 +0000 UTC m=+35.649656251 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls") pod "dns-default-w524p" (UID: "271823ee-f2c9-4afa-bd8b-66f666095c92") : secret "dns-default-metrics-tls" not found
Sep 10 22:02:10.003845 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:10.003811    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4jtgl" event={"ID":"a3693b69-6ebd-4065-895c-328d90290ce8","Type":"ContainerStarted","Data":"593dacfe4c7c71859ff9c190c7e8a28d9c454b051542fbabd5e5c7f640e7c7be"}
Sep 10 22:02:10.006533 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:10.006507    2577 generic.go:356] "Generic (PLEG): container finished" podID="a48cde00-ac8d-468e-b63d-5bdcc93d87f8" containerID="b3a98502b1daa86f277884135132badde577fea43bee34da837407796155551e" exitCode=0
Sep 10 22:02:10.006659 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:10.006558    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rdmgw" event={"ID":"a48cde00-ac8d-468e-b63d-5bdcc93d87f8","Type":"ContainerDied","Data":"b3a98502b1daa86f277884135132badde577fea43bee34da837407796155551e"}
Sep 10 22:02:10.842076 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:10.841991    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:02:10.844244 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:10.844220    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 22:02:10.983508 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:10.983473    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls\") pod \"dns-default-w524p\" (UID: \"271823ee-f2c9-4afa-bd8b-66f666095c92\") " pod="openshift-dns/dns-default-w524p"
Sep 10 22:02:10.983689 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:10.983628    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:02:10.983743 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:10.983701    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls podName:271823ee-f2c9-4afa-bd8b-66f666095c92 nodeName:}" failed. No retries permitted until 2026-09-10 22:02:12.983681747 +0000 UTC m=+37.655779653 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls") pod "dns-default-w524p" (UID: "271823ee-f2c9-4afa-bd8b-66f666095c92") : secret "dns-default-metrics-tls" not found
Sep 10 22:02:11.013928 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:11.013892    2577 generic.go:356] "Generic (PLEG): container finished" podID="a48cde00-ac8d-468e-b63d-5bdcc93d87f8" containerID="a9e027dd2e283acca2ca675f618cd745f9af87272a5760f04580ab0b066e089b" exitCode=0
Sep 10 22:02:11.014103 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:11.013935    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rdmgw" event={"ID":"a48cde00-ac8d-468e-b63d-5bdcc93d87f8","Type":"ContainerDied","Data":"a9e027dd2e283acca2ca675f618cd745f9af87272a5760f04580ab0b066e089b"}
Sep 10 22:02:12.021103 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:12.021063    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rdmgw" event={"ID":"a48cde00-ac8d-468e-b63d-5bdcc93d87f8","Type":"ContainerStarted","Data":"78ba8ca94ebb2be262c16d548e71b8f9f645bbf245eb97fbbcf9808c90b50526"}
Sep 10 22:02:12.044441 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:12.044212    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rdmgw" podStartSLOduration=7.55822734 podStartE2EDuration="37.044188206s" totalImagesPullingTime="29.485960866s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:01:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:02:12.043265626 +0000 UTC m=+36.715363546" watchObservedRunningTime="2026-09-10 22:02:12.044188206 +0000 UTC m=+36.716286165"
Sep 10 22:02:13.001369 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:13.001183    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls\") pod \"dns-default-w524p\" (UID: \"271823ee-f2c9-4afa-bd8b-66f666095c92\") " pod="openshift-dns/dns-default-w524p"
Sep 10 22:02:13.001561 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:13.001370    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:02:13.001561 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:13.001450    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls podName:271823ee-f2c9-4afa-bd8b-66f666095c92 nodeName:}" failed. No retries permitted until 2026-09-10 22:02:17.001433235 +0000 UTC m=+41.673531137 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls") pod "dns-default-w524p" (UID: "271823ee-f2c9-4afa-bd8b-66f666095c92") : secret "dns-default-metrics-tls" not found
Sep 10 22:02:13.024723 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:13.024689    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4jtgl" event={"ID":"a3693b69-6ebd-4065-895c-328d90290ce8","Type":"ContainerStarted","Data":"3a448b645e8d94a1719d2bcc8b9ee8f1bb46cfe48168e32acd06fcb7da1d10a9"}
Sep 10 22:02:13.039108 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:13.039060    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4jtgl" podStartSLOduration=1.421240432 podStartE2EDuration="4.039042702s" totalImagesPullingTime="2.61780227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:02:13.03832679 +0000 UTC m=+37.710424710" watchObservedRunningTime="2026-09-10 22:02:13.039042702 +0000 UTC m=+37.711140613"
Sep 10 22:02:17.027033 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:17.026991    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls\") pod \"dns-default-w524p\" (UID: \"271823ee-f2c9-4afa-bd8b-66f666095c92\") " pod="openshift-dns/dns-default-w524p"
Sep 10 22:02:17.027428 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:17.027162    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:02:17.027428 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:17.027242    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls podName:271823ee-f2c9-4afa-bd8b-66f666095c92 nodeName:}" failed. No retries permitted until 2026-09-10 22:02:25.027224647 +0000 UTC m=+49.699322551 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls") pod "dns-default-w524p" (UID: "271823ee-f2c9-4afa-bd8b-66f666095c92") : secret "dns-default-metrics-tls" not found
Sep 10 22:02:25.083321 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:25.083287    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls\") pod \"dns-default-w524p\" (UID: \"271823ee-f2c9-4afa-bd8b-66f666095c92\") " pod="openshift-dns/dns-default-w524p"
Sep 10 22:02:25.083719 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:25.083469    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:02:25.083719 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:25.083540    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls podName:271823ee-f2c9-4afa-bd8b-66f666095c92 nodeName:}" failed. No retries permitted until 2026-09-10 22:02:41.083520663 +0000 UTC m=+65.755618579 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls") pod "dns-default-w524p" (UID: "271823ee-f2c9-4afa-bd8b-66f666095c92") : secret "dns-default-metrics-tls" not found
Sep 10 22:02:28.348273 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.348238    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-cxmwk"]
Sep 10 22:02:28.349788 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.349758    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-cxmwk"
Sep 10 22:02:28.351659 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.351629    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 10 22:02:28.351821 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.351744    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 10 22:02:28.352054 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.352039    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6vk9l\""
Sep 10 22:02:28.358148 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.358123    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-cxmwk"]
Sep 10 22:02:28.509111 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.509077    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-cxmwk\" (UID: \"8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-cxmwk"
Sep 10 22:02:28.509301 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.509133    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-cxmwk\" (UID: \"8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-cxmwk"
Sep 10 22:02:28.549424 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.549360    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-9zl6k"]
Sep 10 22:02:28.552798 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.552006    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9zl6k"
Sep 10 22:02:28.554715 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.554688    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 10 22:02:28.555146 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.555112    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-m22lt\""
Sep 10 22:02:28.555373 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.555354    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 10 22:02:28.555464 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.555360    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 10 22:02:28.555846 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.555832    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 10 22:02:28.555991 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.555974    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58f68dcfc4-fvp7q"]
Sep 10 22:02:28.557542 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.557521    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.562402 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.562385    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 22:02:28.562495 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.562443    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 22:02:28.562557 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.562510    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c5lwm\""
Sep 10 22:02:28.562557 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.562519    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 22:02:28.565489 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.565465    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-9zl6k"]
Sep 10 22:02:28.569681 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.569657    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 22:02:28.582582 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.582547    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58f68dcfc4-fvp7q"]
Sep 10 22:02:28.610083 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.609994    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-cxmwk\" (UID: \"8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-cxmwk"
Sep 10 22:02:28.610083 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.610038    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-cxmwk\" (UID: \"8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-cxmwk"
Sep 10 22:02:28.610271 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:28.610158    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 22:02:28.610271 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:28.610233    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-networking-console-plugin-cert podName:8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5 nodeName:}" failed. No retries permitted until 2026-09-10 22:02:29.110218538 +0000 UTC m=+53.782316436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-cxmwk" (UID: "8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5") : secret "networking-console-plugin-cert" not found
Sep 10 22:02:28.610752 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.610734    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-cxmwk\" (UID: \"8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-cxmwk"
Sep 10 22:02:28.711464 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.711417    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2caeb931-21b1-4f02-ade4-a690f0b06b16-installation-pull-secrets\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.711464 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.711467    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2caeb931-21b1-4f02-ade4-a690f0b06b16-image-registry-private-configuration\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.711680 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.711487    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56d34526-ae4c-41ef-ae43-5974a7d7a865-config\") pod \"service-ca-operator-cf7c776b7-9zl6k\" (UID: \"56d34526-ae4c-41ef-ae43-5974a7d7a865\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9zl6k"
Sep 10 22:02:28.711680 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.711512    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-bound-sa-token\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.711680 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.711584    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2caeb931-21b1-4f02-ade4-a690f0b06b16-ca-trust-extracted\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.711680 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.711632    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7tjn\" (UniqueName: \"kubernetes.io/projected/56d34526-ae4c-41ef-ae43-5974a7d7a865-kube-api-access-g7tjn\") pod \"service-ca-operator-cf7c776b7-9zl6k\" (UID: \"56d34526-ae4c-41ef-ae43-5974a7d7a865\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9zl6k"
Sep 10 22:02:28.711680 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.711668    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2caeb931-21b1-4f02-ade4-a690f0b06b16-trusted-ca\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.711946 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.711683    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56d34526-ae4c-41ef-ae43-5974a7d7a865-serving-cert\") pod \"service-ca-operator-cf7c776b7-9zl6k\" (UID: \"56d34526-ae4c-41ef-ae43-5974a7d7a865\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9zl6k"
Sep 10 22:02:28.711946 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.711810    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-tls\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.711946 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.711868    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-certificates\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.711946 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.711901    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sn76\" (UniqueName: \"kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-kube-api-access-5sn76\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.812869 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.812838    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2caeb931-21b1-4f02-ade4-a690f0b06b16-image-registry-private-configuration\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.812869 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.812873    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56d34526-ae4c-41ef-ae43-5974a7d7a865-config\") pod \"service-ca-operator-cf7c776b7-9zl6k\" (UID: \"56d34526-ae4c-41ef-ae43-5974a7d7a865\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9zl6k"
Sep 10 22:02:28.812978 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.812891    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-bound-sa-token\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.812978 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.812922    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2caeb931-21b1-4f02-ade4-a690f0b06b16-ca-trust-extracted\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.812978 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.812936    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7tjn\" (UniqueName: \"kubernetes.io/projected/56d34526-ae4c-41ef-ae43-5974a7d7a865-kube-api-access-g7tjn\") pod \"service-ca-operator-cf7c776b7-9zl6k\" (UID: \"56d34526-ae4c-41ef-ae43-5974a7d7a865\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9zl6k"
Sep 10 22:02:28.812978 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.812969    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2caeb931-21b1-4f02-ade4-a690f0b06b16-trusted-ca\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.813129 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.812993    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56d34526-ae4c-41ef-ae43-5974a7d7a865-serving-cert\") pod \"service-ca-operator-cf7c776b7-9zl6k\" (UID: \"56d34526-ae4c-41ef-ae43-5974a7d7a865\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9zl6k"
Sep 10 22:02:28.813129 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.813036    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-tls\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.813129 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.813075    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-certificates\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.813129 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.813101    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sn76\" (UniqueName: \"kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-kube-api-access-5sn76\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.813325 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.813167    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2caeb931-21b1-4f02-ade4-a690f0b06b16-installation-pull-secrets\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.813325 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:28.813222    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 22:02:28.813325 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:28.813239    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58f68dcfc4-fvp7q: secret "image-registry-tls" not found
Sep 10 22:02:28.813325 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:28.813302    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-tls podName:2caeb931-21b1-4f02-ade4-a690f0b06b16 nodeName:}" failed. No retries permitted until 2026-09-10 22:02:29.313281081 +0000 UTC m=+53.985378999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-tls") pod "image-registry-58f68dcfc4-fvp7q" (UID: "2caeb931-21b1-4f02-ade4-a690f0b06b16") : secret "image-registry-tls" not found
Sep 10 22:02:28.813532 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.813355    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2caeb931-21b1-4f02-ade4-a690f0b06b16-ca-trust-extracted\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.813688 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.813666    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56d34526-ae4c-41ef-ae43-5974a7d7a865-config\") pod \"service-ca-operator-cf7c776b7-9zl6k\" (UID: \"56d34526-ae4c-41ef-ae43-5974a7d7a865\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9zl6k"
Sep 10 22:02:28.813922 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.813897    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-certificates\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.814958 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.814931    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2caeb931-21b1-4f02-ade4-a690f0b06b16-trusted-ca\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.816552 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.816530    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56d34526-ae4c-41ef-ae43-5974a7d7a865-serving-cert\") pod \"service-ca-operator-cf7c776b7-9zl6k\" (UID: \"56d34526-ae4c-41ef-ae43-5974a7d7a865\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9zl6k"
Sep 10 22:02:28.816647 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.816597    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2caeb931-21b1-4f02-ade4-a690f0b06b16-installation-pull-secrets\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.816647 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.816611    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2caeb931-21b1-4f02-ade4-a690f0b06b16-image-registry-private-configuration\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.821908 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.821876    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7tjn\" (UniqueName: \"kubernetes.io/projected/56d34526-ae4c-41ef-ae43-5974a7d7a865-kube-api-access-g7tjn\") pod \"service-ca-operator-cf7c776b7-9zl6k\" (UID: \"56d34526-ae4c-41ef-ae43-5974a7d7a865\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9zl6k"
Sep 10 22:02:28.822059 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.822042    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-bound-sa-token\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.822164 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.822148    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sn76\" (UniqueName: \"kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-kube-api-access-5sn76\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:28.863255 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:28.863167    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9zl6k"
Sep 10 22:02:29.116060 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:29.115983    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-cxmwk\" (UID: \"8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-cxmwk"
Sep 10 22:02:29.116197 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:29.116136    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 22:02:29.116254 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:29.116199    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-networking-console-plugin-cert podName:8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5 nodeName:}" failed. No retries permitted until 2026-09-10 22:02:30.116184408 +0000 UTC m=+54.788282307 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-cxmwk" (UID: "8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5") : secret "networking-console-plugin-cert" not found
Sep 10 22:02:29.133127 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:29.133096    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-9zl6k"]
Sep 10 22:02:29.136770 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:02:29.136743    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d34526_ae4c_41ef_ae43_5974a7d7a865.slice/crio-ca838e45315d0ec088516a21d7b81cbb8335297ec302c8800d00ad774f117538 WatchSource:0}: Error finding container ca838e45315d0ec088516a21d7b81cbb8335297ec302c8800d00ad774f117538: Status 404 returned error can't find the container with id ca838e45315d0ec088516a21d7b81cbb8335297ec302c8800d00ad774f117538
Sep 10 22:02:29.317462 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:29.317424    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-tls\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:29.317608 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:29.317568    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 22:02:29.317608 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:29.317583    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58f68dcfc4-fvp7q: secret "image-registry-tls" not found
Sep 10 22:02:29.317699 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:29.317640    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-tls podName:2caeb931-21b1-4f02-ade4-a690f0b06b16 nodeName:}" failed. No retries permitted until 2026-09-10 22:02:30.317621949 +0000 UTC m=+54.989719849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-tls") pod "image-registry-58f68dcfc4-fvp7q" (UID: "2caeb931-21b1-4f02-ade4-a690f0b06b16") : secret "image-registry-tls" not found
Sep 10 22:02:30.067639 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:30.067598    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9zl6k" event={"ID":"56d34526-ae4c-41ef-ae43-5974a7d7a865","Type":"ContainerStarted","Data":"ca838e45315d0ec088516a21d7b81cbb8335297ec302c8800d00ad774f117538"}
Sep 10 22:02:30.123206 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:30.123169    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-cxmwk\" (UID: \"8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-cxmwk"
Sep 10 22:02:30.123394 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:30.123346    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 22:02:30.123449 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:30.123425    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-networking-console-plugin-cert podName:8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5 nodeName:}" failed. No retries permitted until 2026-09-10 22:02:32.12340016 +0000 UTC m=+56.795498108 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-cxmwk" (UID: "8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5") : secret "networking-console-plugin-cert" not found
Sep 10 22:02:30.324438 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:30.324353    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-tls\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:30.324580 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:30.324536    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 22:02:30.324580 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:30.324559    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58f68dcfc4-fvp7q: secret "image-registry-tls" not found
Sep 10 22:02:30.324674 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:30.324629    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-tls podName:2caeb931-21b1-4f02-ade4-a690f0b06b16 nodeName:}" failed. No retries permitted until 2026-09-10 22:02:32.324608681 +0000 UTC m=+56.996706584 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-tls") pod "image-registry-58f68dcfc4-fvp7q" (UID: "2caeb931-21b1-4f02-ade4-a690f0b06b16") : secret "image-registry-tls" not found
Sep 10 22:02:32.074251 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:32.074210    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9zl6k" event={"ID":"56d34526-ae4c-41ef-ae43-5974a7d7a865","Type":"ContainerStarted","Data":"2d1022dc02dccd35de7aa39c28ac3562c070598fd5d4ec185113a406da220c2b"}
Sep 10 22:02:32.089733 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:32.089679    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9zl6k" podStartSLOduration=1.720071501 podStartE2EDuration="4.089660253s" totalImagesPullingTime="2.369588752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:02:32.089162297 +0000 UTC m=+56.761260219" watchObservedRunningTime="2026-09-10 22:02:32.089660253 +0000 UTC m=+56.761758174"
Sep 10 22:02:32.136438 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:32.136395    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-cxmwk\" (UID: \"8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-cxmwk"
Sep 10 22:02:32.136617 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:32.136583    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 22:02:32.136706 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:32.136674    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-networking-console-plugin-cert podName:8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5 nodeName:}" failed. No retries permitted until 2026-09-10 22:02:36.136651163 +0000 UTC m=+60.808749069 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-cxmwk" (UID: "8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5") : secret "networking-console-plugin-cert" not found
Sep 10 22:02:32.338647 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:32.338566    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-tls\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:32.338807 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:32.338715    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 22:02:32.338807 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:32.338733    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58f68dcfc4-fvp7q: secret "image-registry-tls" not found
Sep 10 22:02:32.338885 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:32.338816    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-tls podName:2caeb931-21b1-4f02-ade4-a690f0b06b16 nodeName:}" failed. No retries permitted until 2026-09-10 22:02:36.338800209 +0000 UTC m=+61.010898108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-tls") pod "image-registry-58f68dcfc4-fvp7q" (UID: "2caeb931-21b1-4f02-ade4-a690f0b06b16") : secret "image-registry-tls" not found
Sep 10 22:02:35.002537 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.002504    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxqmk"
Sep 10 22:02:35.037798 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.037754    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h8cb2"]
Sep 10 22:02:35.040344 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.040322    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:35.042489 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.042467    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 22:02:35.042489 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.042478    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 22:02:35.042684 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.042494    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 22:02:35.042684 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.042472    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 22:02:35.042684 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.042572    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fvnxt\""
Sep 10 22:02:35.059090 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.059062    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h8cb2"]
Sep 10 22:02:35.059380 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.059361    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvr4t\" (UniqueName: \"kubernetes.io/projected/1bef2d5e-a670-4780-8433-9526446d099e-kube-api-access-kvr4t\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:35.059435 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.059415    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bef2d5e-a670-4780-8433-9526446d099e-data-volume\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:35.059582 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.059567    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1bef2d5e-a670-4780-8433-9526446d099e-crio-socket\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:35.059709 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.059689    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1bef2d5e-a670-4780-8433-9526446d099e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:35.059767 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.059749    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1bef2d5e-a670-4780-8433-9526446d099e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:35.160428 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.160389    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1bef2d5e-a670-4780-8433-9526446d099e-crio-socket\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:35.160641 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.160465    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1bef2d5e-a670-4780-8433-9526446d099e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:35.160641 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.160510    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1bef2d5e-a670-4780-8433-9526446d099e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:35.160641 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.160533    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1bef2d5e-a670-4780-8433-9526446d099e-crio-socket\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:35.160641 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.160554    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvr4t\" (UniqueName: \"kubernetes.io/projected/1bef2d5e-a670-4780-8433-9526446d099e-kube-api-access-kvr4t\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:35.160641 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.160583    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bef2d5e-a670-4780-8433-9526446d099e-data-volume\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:35.160641 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:35.160620    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:02:35.160964 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:35.160674    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:02:35.160964 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:35.160695    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1bef2d5e-a670-4780-8433-9526446d099e-kube-rbac-proxy-cm podName:1bef2d5e-a670-4780-8433-9526446d099e nodeName:}" failed. No retries permitted until 2026-09-10 22:02:35.660675881 +0000 UTC m=+60.332773796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1bef2d5e-a670-4780-8433-9526446d099e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8cb2" (UID: "1bef2d5e-a670-4780-8433-9526446d099e") : configmap "kube-rbac-proxy" not found
Sep 10 22:02:35.160964 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:35.160743    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bef2d5e-a670-4780-8433-9526446d099e-insights-runtime-extractor-tls podName:1bef2d5e-a670-4780-8433-9526446d099e nodeName:}" failed. No retries permitted until 2026-09-10 22:02:35.660724095 +0000 UTC m=+60.332822018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1bef2d5e-a670-4780-8433-9526446d099e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8cb2" (UID: "1bef2d5e-a670-4780-8433-9526446d099e") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:02:35.160964 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.160963    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bef2d5e-a670-4780-8433-9526446d099e-data-volume\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:35.181512 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.181476    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvr4t\" (UniqueName: \"kubernetes.io/projected/1bef2d5e-a670-4780-8433-9526446d099e-kube-api-access-kvr4t\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:35.416025 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.415974    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-b2zhh"]
Sep 10 22:02:35.417940 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.417924    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-b2zhh"
Sep 10 22:02:35.420163 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.420130    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 10 22:02:35.420358 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.420184    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 10 22:02:35.420358 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.420196    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bshvj\""
Sep 10 22:02:35.420358 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.420220    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 10 22:02:35.420495 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.420435    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 10 22:02:35.425924 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.425901    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-b2zhh"]
Sep 10 22:02:35.464126 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.464093    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e2b44a19-e868-4933-9344-27d8a3d6311a-signing-cabundle\") pod \"service-ca-568869fdc5-b2zhh\" (UID: \"e2b44a19-e868-4933-9344-27d8a3d6311a\") " pod="openshift-service-ca/service-ca-568869fdc5-b2zhh"
Sep 10 22:02:35.464292 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.464156    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzpf6\" (UniqueName: \"kubernetes.io/projected/e2b44a19-e868-4933-9344-27d8a3d6311a-kube-api-access-fzpf6\") pod \"service-ca-568869fdc5-b2zhh\" (UID: \"e2b44a19-e868-4933-9344-27d8a3d6311a\") " pod="openshift-service-ca/service-ca-568869fdc5-b2zhh"
Sep 10 22:02:35.464292 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.464202    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e2b44a19-e868-4933-9344-27d8a3d6311a-signing-key\") pod \"service-ca-568869fdc5-b2zhh\" (UID: \"e2b44a19-e868-4933-9344-27d8a3d6311a\") " pod="openshift-service-ca/service-ca-568869fdc5-b2zhh"
Sep 10 22:02:35.564695 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.564662    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e2b44a19-e868-4933-9344-27d8a3d6311a-signing-cabundle\") pod \"service-ca-568869fdc5-b2zhh\" (UID: \"e2b44a19-e868-4933-9344-27d8a3d6311a\") " pod="openshift-service-ca/service-ca-568869fdc5-b2zhh"
Sep 10 22:02:35.564843 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.564711    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzpf6\" (UniqueName: \"kubernetes.io/projected/e2b44a19-e868-4933-9344-27d8a3d6311a-kube-api-access-fzpf6\") pod \"service-ca-568869fdc5-b2zhh\" (UID: \"e2b44a19-e868-4933-9344-27d8a3d6311a\") " pod="openshift-service-ca/service-ca-568869fdc5-b2zhh"
Sep 10 22:02:35.564891 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.564854    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e2b44a19-e868-4933-9344-27d8a3d6311a-signing-key\") pod \"service-ca-568869fdc5-b2zhh\" (UID: \"e2b44a19-e868-4933-9344-27d8a3d6311a\") " pod="openshift-service-ca/service-ca-568869fdc5-b2zhh"
Sep 10 22:02:35.565373 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.565343    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e2b44a19-e868-4933-9344-27d8a3d6311a-signing-cabundle\") pod \"service-ca-568869fdc5-b2zhh\" (UID: \"e2b44a19-e868-4933-9344-27d8a3d6311a\") " pod="openshift-service-ca/service-ca-568869fdc5-b2zhh"
Sep 10 22:02:35.567339 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.567319    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e2b44a19-e868-4933-9344-27d8a3d6311a-signing-key\") pod \"service-ca-568869fdc5-b2zhh\" (UID: \"e2b44a19-e868-4933-9344-27d8a3d6311a\") " pod="openshift-service-ca/service-ca-568869fdc5-b2zhh"
Sep 10 22:02:35.573167 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.573145    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzpf6\" (UniqueName: \"kubernetes.io/projected/e2b44a19-e868-4933-9344-27d8a3d6311a-kube-api-access-fzpf6\") pod \"service-ca-568869fdc5-b2zhh\" (UID: \"e2b44a19-e868-4933-9344-27d8a3d6311a\") " pod="openshift-service-ca/service-ca-568869fdc5-b2zhh"
Sep 10 22:02:35.665633 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.665600    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1bef2d5e-a670-4780-8433-9526446d099e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:35.665819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.665704    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1bef2d5e-a670-4780-8433-9526446d099e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:35.665819 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:35.665739    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:02:35.665819 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:35.665818    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1bef2d5e-a670-4780-8433-9526446d099e-kube-rbac-proxy-cm podName:1bef2d5e-a670-4780-8433-9526446d099e nodeName:}" failed. No retries permitted until 2026-09-10 22:02:36.665802155 +0000 UTC m=+61.337900053 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1bef2d5e-a670-4780-8433-9526446d099e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8cb2" (UID: "1bef2d5e-a670-4780-8433-9526446d099e") : configmap "kube-rbac-proxy" not found
Sep 10 22:02:35.665929 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:35.665822    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:02:35.665929 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:35.665863    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bef2d5e-a670-4780-8433-9526446d099e-insights-runtime-extractor-tls podName:1bef2d5e-a670-4780-8433-9526446d099e nodeName:}" failed. No retries permitted until 2026-09-10 22:02:36.665851806 +0000 UTC m=+61.337949704 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1bef2d5e-a670-4780-8433-9526446d099e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8cb2" (UID: "1bef2d5e-a670-4780-8433-9526446d099e") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:02:35.729592 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.729518    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bshvj\""
Sep 10 22:02:35.738083 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:35.738059    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-b2zhh"
Sep 10 22:02:36.007800 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:36.007684    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-b2zhh"]
Sep 10 22:02:36.011232 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:02:36.011201    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2b44a19_e868_4933_9344_27d8a3d6311a.slice/crio-fd3b91c54fae36c48dabe8c79894d8481e35359701a5b2dc9781fa3efd3f6377 WatchSource:0}: Error finding container fd3b91c54fae36c48dabe8c79894d8481e35359701a5b2dc9781fa3efd3f6377: Status 404 returned error can't find the container with id fd3b91c54fae36c48dabe8c79894d8481e35359701a5b2dc9781fa3efd3f6377
Sep 10 22:02:36.090402 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:36.090365    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-b2zhh" event={"ID":"e2b44a19-e868-4933-9344-27d8a3d6311a","Type":"ContainerStarted","Data":"078473194bf255993112daa247e24f1d5e80f6e649d0e0ebb79f41cb46430eb7"}
Sep 10 22:02:36.090566 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:36.090442    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-b2zhh" event={"ID":"e2b44a19-e868-4933-9344-27d8a3d6311a","Type":"ContainerStarted","Data":"fd3b91c54fae36c48dabe8c79894d8481e35359701a5b2dc9781fa3efd3f6377"}
Sep 10 22:02:36.106073 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:36.106019    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-b2zhh" podStartSLOduration=1.106001778 podStartE2EDuration="1.106001778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:02:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:02:36.104733056 +0000 UTC m=+60.776830976" watchObservedRunningTime="2026-09-10 22:02:36.106001778 +0000 UTC m=+60.778099699"
Sep 10 22:02:36.170208 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:36.170160    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-cxmwk\" (UID: \"8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-cxmwk"
Sep 10 22:02:36.170349 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:36.170296    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 22:02:36.170403 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:36.170374    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-networking-console-plugin-cert podName:8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5 nodeName:}" failed. No retries permitted until 2026-09-10 22:02:44.170353319 +0000 UTC m=+68.842451235 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-cxmwk" (UID: "8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5") : secret "networking-console-plugin-cert" not found
Sep 10 22:02:36.372205 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:36.372117    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-tls\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:36.372353 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:36.372285    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 22:02:36.372353 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:36.372304    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58f68dcfc4-fvp7q: secret "image-registry-tls" not found
Sep 10 22:02:36.372425 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:36.372361    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-tls podName:2caeb931-21b1-4f02-ade4-a690f0b06b16 nodeName:}" failed. No retries permitted until 2026-09-10 22:02:44.372345186 +0000 UTC m=+69.044443088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-tls") pod "image-registry-58f68dcfc4-fvp7q" (UID: "2caeb931-21b1-4f02-ade4-a690f0b06b16") : secret "image-registry-tls" not found
Sep 10 22:02:36.674506 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:36.674471    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1bef2d5e-a670-4780-8433-9526446d099e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:36.674506 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:36.674519    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1bef2d5e-a670-4780-8433-9526446d099e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:36.674747 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:36.674589    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:02:36.674747 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:36.674632    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1bef2d5e-a670-4780-8433-9526446d099e-kube-rbac-proxy-cm podName:1bef2d5e-a670-4780-8433-9526446d099e nodeName:}" failed. No retries permitted until 2026-09-10 22:02:38.674619884 +0000 UTC m=+63.346717783 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1bef2d5e-a670-4780-8433-9526446d099e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8cb2" (UID: "1bef2d5e-a670-4780-8433-9526446d099e") : configmap "kube-rbac-proxy" not found
Sep 10 22:02:36.674747 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:36.674636    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:02:36.674747 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:36.674693    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bef2d5e-a670-4780-8433-9526446d099e-insights-runtime-extractor-tls podName:1bef2d5e-a670-4780-8433-9526446d099e nodeName:}" failed. No retries permitted until 2026-09-10 22:02:38.674677893 +0000 UTC m=+63.346775791 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1bef2d5e-a670-4780-8433-9526446d099e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8cb2" (UID: "1bef2d5e-a670-4780-8433-9526446d099e") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:02:37.800898 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:37.800866    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jg6p2_324b3113-046f-4aa4-92cc-daca32755467/dns-node-resolver/0.log"
Sep 10 22:02:38.604528 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:38.604496    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4jw9j_ccb0482f-9c3a-4f1f-92c3-41816631091b/node-ca/0.log"
Sep 10 22:02:38.688629 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:38.688592    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1bef2d5e-a670-4780-8433-9526446d099e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:38.688629 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:38.688640    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1bef2d5e-a670-4780-8433-9526446d099e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:38.688904 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:38.688717    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:02:38.688904 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:38.688771    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:02:38.688904 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:38.688797    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1bef2d5e-a670-4780-8433-9526446d099e-kube-rbac-proxy-cm podName:1bef2d5e-a670-4780-8433-9526446d099e nodeName:}" failed. No retries permitted until 2026-09-10 22:02:42.68876304 +0000 UTC m=+67.360860939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1bef2d5e-a670-4780-8433-9526446d099e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8cb2" (UID: "1bef2d5e-a670-4780-8433-9526446d099e") : configmap "kube-rbac-proxy" not found
Sep 10 22:02:38.688904 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:38.688873    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bef2d5e-a670-4780-8433-9526446d099e-insights-runtime-extractor-tls podName:1bef2d5e-a670-4780-8433-9526446d099e nodeName:}" failed. No retries permitted until 2026-09-10 22:02:42.688852821 +0000 UTC m=+67.360950728 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1bef2d5e-a670-4780-8433-9526446d099e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8cb2" (UID: "1bef2d5e-a670-4780-8433-9526446d099e") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:02:39.401332 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:39.401303    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4jtgl_a3693b69-6ebd-4065-895c-328d90290ce8/serve-healthcheck-canary/0.log"
Sep 10 22:02:41.108356 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:41.108325    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls\") pod \"dns-default-w524p\" (UID: \"271823ee-f2c9-4afa-bd8b-66f666095c92\") " pod="openshift-dns/dns-default-w524p"
Sep 10 22:02:41.108882 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:41.108450    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:02:41.108882 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:41.108525    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls podName:271823ee-f2c9-4afa-bd8b-66f666095c92 nodeName:}" failed. No retries permitted until 2026-09-10 22:03:13.108497279 +0000 UTC m=+97.780595181 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls") pod "dns-default-w524p" (UID: "271823ee-f2c9-4afa-bd8b-66f666095c92") : secret "dns-default-metrics-tls" not found
Sep 10 22:02:41.510553 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:41.510515    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret\") pod \"global-pull-secret-syncer-hv697\" (UID: \"950dcdf3-d64c-49e2-8e8b-8c8060fa7069\") " pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:02:41.510553 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:41.510561    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lth9\" (UniqueName: \"kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9\") pod \"network-check-target-8ft52\" (UID: \"4ecebb0d-1784-4cf0-83d0-062dda8e42ce\") " pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:02:41.513201 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:41.513180    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 22:02:41.513251 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:41.513182    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 22:02:41.522820 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:41.522770    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 22:02:41.523313 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:41.523295    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/950dcdf3-d64c-49e2-8e8b-8c8060fa7069-original-pull-secret\") pod \"global-pull-secret-syncer-hv697\" (UID: \"950dcdf3-d64c-49e2-8e8b-8c8060fa7069\") " pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:02:41.533488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:41.533458    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lth9\" (UniqueName: \"kubernetes.io/projected/4ecebb0d-1784-4cf0-83d0-062dda8e42ce-kube-api-access-7lth9\") pod \"network-check-target-8ft52\" (UID: \"4ecebb0d-1784-4cf0-83d0-062dda8e42ce\") " pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:02:41.611483 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:41.611438    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs\") pod \"network-metrics-daemon-8gghw\" (UID: \"d8a674c6-a1ec-4c69-885b-bb1a7b052aef\") " pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:02:41.613709 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:41.613686    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 22:02:41.622209 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:41.622184    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 10 22:02:41.622334 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:41.622260    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs podName:d8a674c6-a1ec-4c69-885b-bb1a7b052aef nodeName:}" failed. No retries permitted until 2026-09-10 22:03:45.622243171 +0000 UTC m=+130.294341070 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs") pod "network-metrics-daemon-8gghw" (UID: "d8a674c6-a1ec-4c69-885b-bb1a7b052aef") : secret "metrics-daemon-secret" not found
Sep 10 22:02:41.665026 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:41.664989    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5csvl\""
Sep 10 22:02:41.672997 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:41.672965    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:02:41.752119 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:41.752080    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv697"
Sep 10 22:02:41.947583 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:41.947553    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8ft52"]
Sep 10 22:02:41.950877 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:02:41.950845    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ecebb0d_1784_4cf0_83d0_062dda8e42ce.slice/crio-373579b7ca620f1a9fb494eede5121df88e956b7e5563b48980c238cea47162d WatchSource:0}: Error finding container 373579b7ca620f1a9fb494eede5121df88e956b7e5563b48980c238cea47162d: Status 404 returned error can't find the container with id 373579b7ca620f1a9fb494eede5121df88e956b7e5563b48980c238cea47162d
Sep 10 22:02:42.024317 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:42.024223    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hv697"]
Sep 10 22:02:42.028141 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:02:42.028112    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod950dcdf3_d64c_49e2_8e8b_8c8060fa7069.slice/crio-c1cdb4108381994243b4b1ebf6f43be5e33a7739e1315cd263f3a6b13377f2d2 WatchSource:0}: Error finding container c1cdb4108381994243b4b1ebf6f43be5e33a7739e1315cd263f3a6b13377f2d2: Status 404 returned error can't find the container with id c1cdb4108381994243b4b1ebf6f43be5e33a7739e1315cd263f3a6b13377f2d2
Sep 10 22:02:42.106919 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:42.106880    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8ft52" event={"ID":"4ecebb0d-1784-4cf0-83d0-062dda8e42ce","Type":"ContainerStarted","Data":"373579b7ca620f1a9fb494eede5121df88e956b7e5563b48980c238cea47162d"}
Sep 10 22:02:42.107992 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:42.107959    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hv697" event={"ID":"950dcdf3-d64c-49e2-8e8b-8c8060fa7069","Type":"ContainerStarted","Data":"c1cdb4108381994243b4b1ebf6f43be5e33a7739e1315cd263f3a6b13377f2d2"}
Sep 10 22:02:42.723067 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:42.723031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1bef2d5e-a670-4780-8433-9526446d099e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:42.723460 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:42.723159    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1bef2d5e-a670-4780-8433-9526446d099e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:42.723460 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:42.723161    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:02:42.723460 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:42.723237    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:02:42.723460 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:42.723262    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1bef2d5e-a670-4780-8433-9526446d099e-kube-rbac-proxy-cm podName:1bef2d5e-a670-4780-8433-9526446d099e nodeName:}" failed. No retries permitted until 2026-09-10 22:02:50.723244618 +0000 UTC m=+75.395342533 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1bef2d5e-a670-4780-8433-9526446d099e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8cb2" (UID: "1bef2d5e-a670-4780-8433-9526446d099e") : configmap "kube-rbac-proxy" not found
Sep 10 22:02:42.723460 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:42.723279    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bef2d5e-a670-4780-8433-9526446d099e-insights-runtime-extractor-tls podName:1bef2d5e-a670-4780-8433-9526446d099e nodeName:}" failed. No retries permitted until 2026-09-10 22:02:50.723268308 +0000 UTC m=+75.395366229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1bef2d5e-a670-4780-8433-9526446d099e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8cb2" (UID: "1bef2d5e-a670-4780-8433-9526446d099e") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:02:44.238420 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:44.238374    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-cxmwk\" (UID: \"8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-cxmwk"
Sep 10 22:02:44.238916 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:44.238561    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 22:02:44.238916 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:02:44.238645    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-networking-console-plugin-cert podName:8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5 nodeName:}" failed. No retries permitted until 2026-09-10 22:03:00.238623821 +0000 UTC m=+84.910721743 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-cxmwk" (UID: "8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5") : secret "networking-console-plugin-cert" not found
Sep 10 22:02:44.440831 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:44.440767    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-tls\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:44.444171 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:44.444139    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-tls\") pod \"image-registry-58f68dcfc4-fvp7q\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") " pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:44.471035 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:44.471001    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c5lwm\""
Sep 10 22:02:44.479168 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:44.479129    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:44.781966 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:44.781441    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58f68dcfc4-fvp7q"]
Sep 10 22:02:45.648860 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:02:45.648820    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2caeb931_21b1_4f02_ade4_a690f0b06b16.slice/crio-2a17b4630e9cbf3d96a6898ad6c7fec19bc5cc455039726f2ad714133644fefe WatchSource:0}: Error finding container 2a17b4630e9cbf3d96a6898ad6c7fec19bc5cc455039726f2ad714133644fefe: Status 404 returned error can't find the container with id 2a17b4630e9cbf3d96a6898ad6c7fec19bc5cc455039726f2ad714133644fefe
Sep 10 22:02:46.120527 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:46.120435    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q" event={"ID":"2caeb931-21b1-4f02-ade4-a690f0b06b16","Type":"ContainerStarted","Data":"2a17b4630e9cbf3d96a6898ad6c7fec19bc5cc455039726f2ad714133644fefe"}
Sep 10 22:02:48.128816 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:48.128761    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q" event={"ID":"2caeb931-21b1-4f02-ade4-a690f0b06b16","Type":"ContainerStarted","Data":"810045b17f94535acc3044ed4b85a2e94ecf34b97209568e45d31169121f0874"}
Sep 10 22:02:48.129266 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:48.128842    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:02:48.130310 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:48.130286    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8ft52" event={"ID":"4ecebb0d-1784-4cf0-83d0-062dda8e42ce","Type":"ContainerStarted","Data":"75f328ab6563d750a405bacad4668274a0cda5926175a460bba2170ca95446b6"}
Sep 10 22:02:48.130425 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:48.130406    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:02:48.131712 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:48.131691    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hv697" event={"ID":"950dcdf3-d64c-49e2-8e8b-8c8060fa7069","Type":"ContainerStarted","Data":"24125a44d50f8bea8fd3a2e2d82a38fe2eb4878bce97bfd596db2f513cd4d827"}
Sep 10 22:02:48.147209 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:48.147138    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q" podStartSLOduration=20.147119099 podStartE2EDuration="20.147119099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:02:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:02:48.146703565 +0000 UTC m=+72.818801486" watchObservedRunningTime="2026-09-10 22:02:48.147119099 +0000 UTC m=+72.819217022"
Sep 10 22:02:48.161426 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:48.161373    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8ft52" podStartSLOduration=67.936279081 podStartE2EDuration="1m13.161357614s" totalImagesPullingTime="5.225078533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:02:48.160435129 +0000 UTC m=+72.832533061" watchObservedRunningTime="2026-09-10 22:02:48.161357614 +0000 UTC m=+72.833455562"
Sep 10 22:02:48.175051 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:48.175001    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hv697" podStartSLOduration=68.018743318 podStartE2EDuration="1m13.174984579s" totalImagesPullingTime="5.156241261s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:02:48.1739458 +0000 UTC m=+72.846043721" watchObservedRunningTime="2026-09-10 22:02:48.174984579 +0000 UTC m=+72.847082500"
Sep 10 22:02:50.794039 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:50.793998    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1bef2d5e-a670-4780-8433-9526446d099e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:50.794435 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:50.794052    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1bef2d5e-a670-4780-8433-9526446d099e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:50.794644 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:50.794621    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1bef2d5e-a670-4780-8433-9526446d099e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:50.796435 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:50.796415    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1bef2d5e-a670-4780-8433-9526446d099e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8cb2\" (UID: \"1bef2d5e-a670-4780-8433-9526446d099e\") " pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:50.951349 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:50.951318    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fvnxt\""
Sep 10 22:02:50.959747 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:50.959725    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h8cb2"
Sep 10 22:02:51.236197 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:51.236163    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h8cb2"]
Sep 10 22:02:51.239613 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:02:51.239588    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bef2d5e_a670_4780_8433_9526446d099e.slice/crio-584b41eac6072132ed39f513f68fbfffd8803fb123669a0278f06d9c7975bb9f WatchSource:0}: Error finding container 584b41eac6072132ed39f513f68fbfffd8803fb123669a0278f06d9c7975bb9f: Status 404 returned error can't find the container with id 584b41eac6072132ed39f513f68fbfffd8803fb123669a0278f06d9c7975bb9f
Sep 10 22:02:52.147373 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:52.147342    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8cb2" event={"ID":"1bef2d5e-a670-4780-8433-9526446d099e","Type":"ContainerStarted","Data":"424b6940e7b1b407f27d6464f2621c061c0226c59a1e7c363c27df7821760345"}
Sep 10 22:02:52.147750 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:52.147399    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8cb2" event={"ID":"1bef2d5e-a670-4780-8433-9526446d099e","Type":"ContainerStarted","Data":"4997f387fa465c948b52d4d9a10aab84adf37b74944a75186e32816e00c961bc"}
Sep 10 22:02:52.147750 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:52.147418    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8cb2" event={"ID":"1bef2d5e-a670-4780-8433-9526446d099e","Type":"ContainerStarted","Data":"584b41eac6072132ed39f513f68fbfffd8803fb123669a0278f06d9c7975bb9f"}
Sep 10 22:02:54.156909 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:54.156878    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8cb2" event={"ID":"1bef2d5e-a670-4780-8433-9526446d099e","Type":"ContainerStarted","Data":"77159dce35d4c1506ef1a87171e82a02cf2d922380d910e90936e29942ac4c9c"}
Sep 10 22:02:54.177546 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:54.177489    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h8cb2" podStartSLOduration=17.201069442 podStartE2EDuration="19.177471851s" totalImagesPullingTime="1.976402409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:02:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:02:54.176699941 +0000 UTC m=+78.848797860" watchObservedRunningTime="2026-09-10 22:02:54.177471851 +0000 UTC m=+78.849569772"
Sep 10 22:02:57.150152 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.150037    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59848d6c56-q4fnz"]
Sep 10 22:02:57.152517 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.152500    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59848d6c56-q4fnz"
Sep 10 22:02:57.154554 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.154534    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2k2k5\""
Sep 10 22:02:57.155141 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.155124    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 22:02:57.155253 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.155186    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 10 22:02:57.155253 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.155128    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 22:02:57.155253 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.155213    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 22:02:57.168041 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.168019    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59848d6c56-q4fnz"]
Sep 10 22:02:57.201518 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.201486    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58f68dcfc4-fvp7q"]
Sep 10 22:02:57.240043 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.240013    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw7gw\" (UniqueName: \"kubernetes.io/projected/0285b312-f288-4c3e-9620-cd8fd189ea40-kube-api-access-sw7gw\") pod \"managed-serviceaccount-addon-agent-59848d6c56-q4fnz\" (UID: \"0285b312-f288-4c3e-9620-cd8fd189ea40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59848d6c56-q4fnz"
Sep 10 22:02:57.240213 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.240097    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0285b312-f288-4c3e-9620-cd8fd189ea40-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59848d6c56-q4fnz\" (UID: \"0285b312-f288-4c3e-9620-cd8fd189ea40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59848d6c56-q4fnz"
Sep 10 22:02:57.249685 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.249655    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-788d5df44-gfpnm"]
Sep 10 22:02:57.251447 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.251431    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.269754 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.269726    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-788d5df44-gfpnm"]
Sep 10 22:02:57.341082 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.341044    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/daee20da-5700-4c53-bbd9-73b7740c2af3-trusted-ca\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.341253 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.341098    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/daee20da-5700-4c53-bbd9-73b7740c2af3-image-registry-private-configuration\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.341253 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.341122    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/daee20da-5700-4c53-bbd9-73b7740c2af3-registry-tls\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.341253 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.341201    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/daee20da-5700-4c53-bbd9-73b7740c2af3-bound-sa-token\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.341357 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.341253    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/daee20da-5700-4c53-bbd9-73b7740c2af3-ca-trust-extracted\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.341357 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.341294    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/daee20da-5700-4c53-bbd9-73b7740c2af3-installation-pull-secrets\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.341357 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.341317    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0285b312-f288-4c3e-9620-cd8fd189ea40-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59848d6c56-q4fnz\" (UID: \"0285b312-f288-4c3e-9620-cd8fd189ea40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59848d6c56-q4fnz"
Sep 10 22:02:57.341357 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.341350    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsgws\" (UniqueName: \"kubernetes.io/projected/daee20da-5700-4c53-bbd9-73b7740c2af3-kube-api-access-dsgws\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.341637 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.341436    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/daee20da-5700-4c53-bbd9-73b7740c2af3-registry-certificates\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.341637 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.341463    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw7gw\" (UniqueName: \"kubernetes.io/projected/0285b312-f288-4c3e-9620-cd8fd189ea40-kube-api-access-sw7gw\") pod \"managed-serviceaccount-addon-agent-59848d6c56-q4fnz\" (UID: \"0285b312-f288-4c3e-9620-cd8fd189ea40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59848d6c56-q4fnz"
Sep 10 22:02:57.344164 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.344140    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0285b312-f288-4c3e-9620-cd8fd189ea40-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59848d6c56-q4fnz\" (UID: \"0285b312-f288-4c3e-9620-cd8fd189ea40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59848d6c56-q4fnz"
Sep 10 22:02:57.350517 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.350491    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw7gw\" (UniqueName: \"kubernetes.io/projected/0285b312-f288-4c3e-9620-cd8fd189ea40-kube-api-access-sw7gw\") pod \"managed-serviceaccount-addon-agent-59848d6c56-q4fnz\" (UID: \"0285b312-f288-4c3e-9620-cd8fd189ea40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59848d6c56-q4fnz"
Sep 10 22:02:57.442321 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.442225    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/daee20da-5700-4c53-bbd9-73b7740c2af3-ca-trust-extracted\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.442321 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.442276    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/daee20da-5700-4c53-bbd9-73b7740c2af3-installation-pull-secrets\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.442321 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.442314    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsgws\" (UniqueName: \"kubernetes.io/projected/daee20da-5700-4c53-bbd9-73b7740c2af3-kube-api-access-dsgws\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.442648 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.442335    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/daee20da-5700-4c53-bbd9-73b7740c2af3-registry-certificates\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.442648 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.442365    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/daee20da-5700-4c53-bbd9-73b7740c2af3-trusted-ca\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.442648 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.442528    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/daee20da-5700-4c53-bbd9-73b7740c2af3-image-registry-private-configuration\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.442648 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.442584    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/daee20da-5700-4c53-bbd9-73b7740c2af3-registry-tls\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.442648 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.442625    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/daee20da-5700-4c53-bbd9-73b7740c2af3-bound-sa-token\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.442965 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.442732    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/daee20da-5700-4c53-bbd9-73b7740c2af3-ca-trust-extracted\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.443342 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.443319    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/daee20da-5700-4c53-bbd9-73b7740c2af3-registry-certificates\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.443748 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.443725    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/daee20da-5700-4c53-bbd9-73b7740c2af3-trusted-ca\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.445040 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.445017    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/daee20da-5700-4c53-bbd9-73b7740c2af3-installation-pull-secrets\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.445183 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.445164    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/daee20da-5700-4c53-bbd9-73b7740c2af3-registry-tls\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.445355 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.445338    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/daee20da-5700-4c53-bbd9-73b7740c2af3-image-registry-private-configuration\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.450095 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.450065    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/daee20da-5700-4c53-bbd9-73b7740c2af3-bound-sa-token\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.450191 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.450123    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsgws\" (UniqueName: \"kubernetes.io/projected/daee20da-5700-4c53-bbd9-73b7740c2af3-kube-api-access-dsgws\") pod \"image-registry-788d5df44-gfpnm\" (UID: \"daee20da-5700-4c53-bbd9-73b7740c2af3\") " pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.476679 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.476652    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59848d6c56-q4fnz"
Sep 10 22:02:57.560548 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.560517    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:57.746945 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.746866    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59848d6c56-q4fnz"]
Sep 10 22:02:57.749835 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:02:57.749809    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0285b312_f288_4c3e_9620_cd8fd189ea40.slice/crio-864e054bd705663c5be3e08735a0c07a025250e1150179d1657565a59777bb23 WatchSource:0}: Error finding container 864e054bd705663c5be3e08735a0c07a025250e1150179d1657565a59777bb23: Status 404 returned error can't find the container with id 864e054bd705663c5be3e08735a0c07a025250e1150179d1657565a59777bb23
Sep 10 22:02:57.834193 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:57.834161    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-788d5df44-gfpnm"]
Sep 10 22:02:57.838243 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:02:57.838194    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaee20da_5700_4c53_bbd9_73b7740c2af3.slice/crio-c2d931c69aed7fe726463e6fcc9d623518c9c5cd0233673f903750abbd6f738f WatchSource:0}: Error finding container c2d931c69aed7fe726463e6fcc9d623518c9c5cd0233673f903750abbd6f738f: Status 404 returned error can't find the container with id c2d931c69aed7fe726463e6fcc9d623518c9c5cd0233673f903750abbd6f738f
Sep 10 22:02:58.172138 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:58.172095    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59848d6c56-q4fnz" event={"ID":"0285b312-f288-4c3e-9620-cd8fd189ea40","Type":"ContainerStarted","Data":"864e054bd705663c5be3e08735a0c07a025250e1150179d1657565a59777bb23"}
Sep 10 22:02:58.173816 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:58.173772    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-788d5df44-gfpnm" event={"ID":"daee20da-5700-4c53-bbd9-73b7740c2af3","Type":"ContainerStarted","Data":"a94033899a022e585851cf0cce2e43dfb5df0733258cb3001436e1da211c961c"}
Sep 10 22:02:58.173942 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:58.173829    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-788d5df44-gfpnm" event={"ID":"daee20da-5700-4c53-bbd9-73b7740c2af3","Type":"ContainerStarted","Data":"c2d931c69aed7fe726463e6fcc9d623518c9c5cd0233673f903750abbd6f738f"}
Sep 10 22:02:58.173942 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:58.173863    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:02:58.195335 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:02:58.195278    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-788d5df44-gfpnm" podStartSLOduration=1.195262416 podStartE2EDuration="1.195262416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:02:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:02:58.193773058 +0000 UTC m=+82.865870979" watchObservedRunningTime="2026-09-10 22:02:58.195262416 +0000 UTC m=+82.867360391"
Sep 10 22:03:00.183441 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:00.183369    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59848d6c56-q4fnz" event={"ID":"0285b312-f288-4c3e-9620-cd8fd189ea40","Type":"ContainerStarted","Data":"3468cfdc8929e29a64e8c046ed87cc598b8daa64ead367750fb8abbd31cc207e"}
Sep 10 22:03:00.198277 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:00.198224    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59848d6c56-q4fnz" podStartSLOduration=0.909743517 podStartE2EDuration="3.198199061s" totalImagesPullingTime="2.288455544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:02:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:03:00.197508657 +0000 UTC m=+84.869606581" watchObservedRunningTime="2026-09-10 22:03:00.198199061 +0000 UTC m=+84.870296981"
Sep 10 22:03:00.270246 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:00.270205    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-cxmwk\" (UID: \"8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-cxmwk"
Sep 10 22:03:00.272722 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:00.272700    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-cxmwk\" (UID: \"8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-cxmwk"
Sep 10 22:03:00.461435 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:00.461397    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6vk9l\""
Sep 10 22:03:00.469933 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:00.469908    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-cxmwk"
Sep 10 22:03:00.737017 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:00.736939    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-cxmwk"]
Sep 10 22:03:00.740038 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:03:00.740013    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b02aba2_8d9a_430e_84ea_f4d2aa4a37e5.slice/crio-c1733fb8e88898a5672d38e76f6060d0493499ceddd58594e9c943cd129d97fb WatchSource:0}: Error finding container c1733fb8e88898a5672d38e76f6060d0493499ceddd58594e9c943cd129d97fb: Status 404 returned error can't find the container with id c1733fb8e88898a5672d38e76f6060d0493499ceddd58594e9c943cd129d97fb
Sep 10 22:03:01.187836 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:01.187803    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-cxmwk" event={"ID":"8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5","Type":"ContainerStarted","Data":"c1733fb8e88898a5672d38e76f6060d0493499ceddd58594e9c943cd129d97fb"}
Sep 10 22:03:02.192431 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:02.192374    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-cxmwk" event={"ID":"8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5","Type":"ContainerStarted","Data":"10e85c863c3de47c260a0c4cae33c1be6f088d9b90076f015a3070fbacddc767"}
Sep 10 22:03:02.210643 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:02.210581    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-cxmwk" podStartSLOduration=33.079626331 podStartE2EDuration="34.210566238s" totalImagesPullingTime="1.130939907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:03:02.209410345 +0000 UTC m=+86.881508266" watchObservedRunningTime="2026-09-10 22:03:02.210566238 +0000 UTC m=+86.882664159"
Sep 10 22:03:07.208343 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:07.208285    2577 patch_prober.go:28] interesting pod/image-registry-58f68dcfc4-fvp7q container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 10 22:03:07.208935 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:07.208891    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q" podUID="2caeb931-21b1-4f02-ade4-a690f0b06b16" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 22:03:12.264553 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.264516    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46"]
Sep 10 22:03:12.268256 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.268234    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46"
Sep 10 22:03:12.271460 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.271429    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 10 22:03:12.272138 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.272115    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 22:03:12.272297 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.272138    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 22:03:12.272386 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.272370    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 22:03:12.272446 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.272398    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nshbg\""
Sep 10 22:03:12.278344 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.278327    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 10 22:03:12.298498 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.298465    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46"]
Sep 10 22:03:12.311879 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.311854    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-llljk"]
Sep 10 22:03:12.314199 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.314167    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.316270 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.316253    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 22:03:12.318103 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.318077    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 22:03:12.318446 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.318427    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7v8kf\""
Sep 10 22:03:12.324587 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.324554    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 22:03:12.368640 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.368599    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac48f7ae-2068-4609-9f35-a40dc76666df-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-c4x46\" (UID: \"ac48f7ae-2068-4609-9f35-a40dc76666df\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46"
Sep 10 22:03:12.368640 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.368644    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac48f7ae-2068-4609-9f35-a40dc76666df-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-c4x46\" (UID: \"ac48f7ae-2068-4609-9f35-a40dc76666df\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46"
Sep 10 22:03:12.368909 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.368724    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4cm2\" (UniqueName: \"kubernetes.io/projected/ac48f7ae-2068-4609-9f35-a40dc76666df-kube-api-access-m4cm2\") pod \"openshift-state-metrics-67dcf8c979-c4x46\" (UID: \"ac48f7ae-2068-4609-9f35-a40dc76666df\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46"
Sep 10 22:03:12.368909 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.368830    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac48f7ae-2068-4609-9f35-a40dc76666df-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-c4x46\" (UID: \"ac48f7ae-2068-4609-9f35-a40dc76666df\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46"
Sep 10 22:03:12.469508 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.469457    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/05d401e4-4129-44ca-8346-782b7dbb297b-root\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.469680 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.469532    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05d401e4-4129-44ca-8346-782b7dbb297b-sys\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.469680 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.469569    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac48f7ae-2068-4609-9f35-a40dc76666df-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-c4x46\" (UID: \"ac48f7ae-2068-4609-9f35-a40dc76666df\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46"
Sep 10 22:03:12.469680 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.469597    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac48f7ae-2068-4609-9f35-a40dc76666df-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-c4x46\" (UID: \"ac48f7ae-2068-4609-9f35-a40dc76666df\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46"
Sep 10 22:03:12.469835 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.469667    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05d401e4-4129-44ca-8346-782b7dbb297b-metrics-client-ca\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.469835 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.469705    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfpcs\" (UniqueName: \"kubernetes.io/projected/05d401e4-4129-44ca-8346-782b7dbb297b-kube-api-access-lfpcs\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.469835 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.469744    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/05d401e4-4129-44ca-8346-782b7dbb297b-node-exporter-wtmp\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.469835 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.469815    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05d401e4-4129-44ca-8346-782b7dbb297b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.470028 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.469917    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4cm2\" (UniqueName: \"kubernetes.io/projected/ac48f7ae-2068-4609-9f35-a40dc76666df-kube-api-access-m4cm2\") pod \"openshift-state-metrics-67dcf8c979-c4x46\" (UID: \"ac48f7ae-2068-4609-9f35-a40dc76666df\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46"
Sep 10 22:03:12.470028 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.469964    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/05d401e4-4129-44ca-8346-782b7dbb297b-node-exporter-tls\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.470135 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.470073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/05d401e4-4129-44ca-8346-782b7dbb297b-node-exporter-accelerators-collector-config\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.470185 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.470154    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/05d401e4-4129-44ca-8346-782b7dbb297b-node-exporter-textfile\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.470249 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.470207    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac48f7ae-2068-4609-9f35-a40dc76666df-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-c4x46\" (UID: \"ac48f7ae-2068-4609-9f35-a40dc76666df\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46"
Sep 10 22:03:12.470361 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:03:12.470340    2577 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 10 22:03:12.470611 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.470384    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac48f7ae-2068-4609-9f35-a40dc76666df-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-c4x46\" (UID: \"ac48f7ae-2068-4609-9f35-a40dc76666df\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46"
Sep 10 22:03:12.470611 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:03:12.470417    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac48f7ae-2068-4609-9f35-a40dc76666df-openshift-state-metrics-tls podName:ac48f7ae-2068-4609-9f35-a40dc76666df nodeName:}" failed. No retries permitted until 2026-09-10 22:03:12.97039859 +0000 UTC m=+97.642496506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ac48f7ae-2068-4609-9f35-a40dc76666df-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-c4x46" (UID: "ac48f7ae-2068-4609-9f35-a40dc76666df") : secret "openshift-state-metrics-tls" not found
Sep 10 22:03:12.472730 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.472704    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac48f7ae-2068-4609-9f35-a40dc76666df-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-c4x46\" (UID: \"ac48f7ae-2068-4609-9f35-a40dc76666df\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46"
Sep 10 22:03:12.483565 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.483531    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4cm2\" (UniqueName: \"kubernetes.io/projected/ac48f7ae-2068-4609-9f35-a40dc76666df-kube-api-access-m4cm2\") pod \"openshift-state-metrics-67dcf8c979-c4x46\" (UID: \"ac48f7ae-2068-4609-9f35-a40dc76666df\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46"
Sep 10 22:03:12.570844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.570746    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/05d401e4-4129-44ca-8346-782b7dbb297b-node-exporter-textfile\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.570844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.570828    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/05d401e4-4129-44ca-8346-782b7dbb297b-root\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.571047 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.570860    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05d401e4-4129-44ca-8346-782b7dbb297b-sys\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.571047 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.570893    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05d401e4-4129-44ca-8346-782b7dbb297b-metrics-client-ca\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.571047 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.570917    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfpcs\" (UniqueName: \"kubernetes.io/projected/05d401e4-4129-44ca-8346-782b7dbb297b-kube-api-access-lfpcs\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.571047 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.570955    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/05d401e4-4129-44ca-8346-782b7dbb297b-root\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.571047 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.570962    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05d401e4-4129-44ca-8346-782b7dbb297b-sys\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.571279 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.571058    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/05d401e4-4129-44ca-8346-782b7dbb297b-node-exporter-wtmp\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.571279 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.571089    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05d401e4-4129-44ca-8346-782b7dbb297b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.571279 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.571132    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/05d401e4-4129-44ca-8346-782b7dbb297b-node-exporter-tls\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.571279 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.571154    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/05d401e4-4129-44ca-8346-782b7dbb297b-node-exporter-accelerators-collector-config\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.571279 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.571202    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/05d401e4-4129-44ca-8346-782b7dbb297b-node-exporter-wtmp\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.571279 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.571149    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/05d401e4-4129-44ca-8346-782b7dbb297b-node-exporter-textfile\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.571566 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.571503    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05d401e4-4129-44ca-8346-782b7dbb297b-metrics-client-ca\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.571733 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.571710    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/05d401e4-4129-44ca-8346-782b7dbb297b-node-exporter-accelerators-collector-config\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.573544 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.573524    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05d401e4-4129-44ca-8346-782b7dbb297b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.573960 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.573937    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/05d401e4-4129-44ca-8346-782b7dbb297b-node-exporter-tls\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.579426 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.579402    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfpcs\" (UniqueName: \"kubernetes.io/projected/05d401e4-4129-44ca-8346-782b7dbb297b-kube-api-access-lfpcs\") pod \"node-exporter-llljk\" (UID: \"05d401e4-4129-44ca-8346-782b7dbb297b\") " pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.631564 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.631520    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-llljk"
Sep 10 22:03:12.642632 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:03:12.642603    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05d401e4_4129_44ca_8346_782b7dbb297b.slice/crio-678cca2d6109fec385957df58429c61affda5cda79b59ab7d7fca68a406f2b2a WatchSource:0}: Error finding container 678cca2d6109fec385957df58429c61affda5cda79b59ab7d7fca68a406f2b2a: Status 404 returned error can't find the container with id 678cca2d6109fec385957df58429c61affda5cda79b59ab7d7fca68a406f2b2a
Sep 10 22:03:12.974023 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.973988    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac48f7ae-2068-4609-9f35-a40dc76666df-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-c4x46\" (UID: \"ac48f7ae-2068-4609-9f35-a40dc76666df\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46"
Sep 10 22:03:12.976491 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:12.976471    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac48f7ae-2068-4609-9f35-a40dc76666df-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-c4x46\" (UID: \"ac48f7ae-2068-4609-9f35-a40dc76666df\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46"
Sep 10 22:03:13.175538 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:13.175501    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls\") pod \"dns-default-w524p\" (UID: \"271823ee-f2c9-4afa-bd8b-66f666095c92\") " pod="openshift-dns/dns-default-w524p"
Sep 10 22:03:13.178315 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:13.178281    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/271823ee-f2c9-4afa-bd8b-66f666095c92-metrics-tls\") pod \"dns-default-w524p\" (UID: \"271823ee-f2c9-4afa-bd8b-66f666095c92\") " pod="openshift-dns/dns-default-w524p"
Sep 10 22:03:13.179146 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:13.179120    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46"
Sep 10 22:03:13.230953 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:13.230837    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llljk" event={"ID":"05d401e4-4129-44ca-8346-782b7dbb297b","Type":"ContainerStarted","Data":"678cca2d6109fec385957df58429c61affda5cda79b59ab7d7fca68a406f2b2a"}
Sep 10 22:03:13.429331 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:13.429299    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qt6wb\""
Sep 10 22:03:13.437993 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:13.437861    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w524p"
Sep 10 22:03:13.478371 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:13.478004    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46"]
Sep 10 22:03:13.521487 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:03:13.521419    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac48f7ae_2068_4609_9f35_a40dc76666df.slice/crio-35278b3df939657f9f18b13af80e4a123b58a7260a990a13f8984cd4bd7743ad WatchSource:0}: Error finding container 35278b3df939657f9f18b13af80e4a123b58a7260a990a13f8984cd4bd7743ad: Status 404 returned error can't find the container with id 35278b3df939657f9f18b13af80e4a123b58a7260a990a13f8984cd4bd7743ad
Sep 10 22:03:13.802062 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:13.801978    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w524p"]
Sep 10 22:03:13.804926 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:03:13.804890    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod271823ee_f2c9_4afa_bd8b_66f666095c92.slice/crio-48e885291c15be5d1c85b8d6c19dc329ca863d83be4420a54cec8d555977f822 WatchSource:0}: Error finding container 48e885291c15be5d1c85b8d6c19dc329ca863d83be4420a54cec8d555977f822: Status 404 returned error can't find the container with id 48e885291c15be5d1c85b8d6c19dc329ca863d83be4420a54cec8d555977f822
Sep 10 22:03:14.236419 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:14.236377    2577 generic.go:356] "Generic (PLEG): container finished" podID="05d401e4-4129-44ca-8346-782b7dbb297b" containerID="1f9bb09ccaca0b43d03ea7d16b5f5ee45043b7342e847fba89e04dc6cf029001" exitCode=0
Sep 10 22:03:14.236646 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:14.236463    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llljk" event={"ID":"05d401e4-4129-44ca-8346-782b7dbb297b","Type":"ContainerDied","Data":"1f9bb09ccaca0b43d03ea7d16b5f5ee45043b7342e847fba89e04dc6cf029001"}
Sep 10 22:03:14.238930 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:14.238898    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46" event={"ID":"ac48f7ae-2068-4609-9f35-a40dc76666df","Type":"ContainerStarted","Data":"4f1650c124df18a57a92e73cfbca4ac83c227c11757067922ffe31edad1f965e"}
Sep 10 22:03:14.239040 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:14.238962    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46" event={"ID":"ac48f7ae-2068-4609-9f35-a40dc76666df","Type":"ContainerStarted","Data":"891cd78fae572df7107dd73dda243c469ba25c63533acd3db6fe2a3ecf45cebb"}
Sep 10 22:03:14.239040 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:14.238993    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46" event={"ID":"ac48f7ae-2068-4609-9f35-a40dc76666df","Type":"ContainerStarted","Data":"35278b3df939657f9f18b13af80e4a123b58a7260a990a13f8984cd4bd7743ad"}
Sep 10 22:03:14.240534 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:14.240507    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w524p" event={"ID":"271823ee-f2c9-4afa-bd8b-66f666095c92","Type":"ContainerStarted","Data":"48e885291c15be5d1c85b8d6c19dc329ca863d83be4420a54cec8d555977f822"}
Sep 10 22:03:15.247113 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.247075    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46" event={"ID":"ac48f7ae-2068-4609-9f35-a40dc76666df","Type":"ContainerStarted","Data":"e4a9f8046d8b74eb04a6abe1d6cd4a402e4703a489d026f5e5f42a780101ce65"}
Sep 10 22:03:15.249973 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.249945    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llljk" event={"ID":"05d401e4-4129-44ca-8346-782b7dbb297b","Type":"ContainerStarted","Data":"39d316d99c669dc62a8dbdae910552d5a643c5750e84b7c5534dc0ff72ac2ded"}
Sep 10 22:03:15.250083 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.249997    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llljk" event={"ID":"05d401e4-4129-44ca-8346-782b7dbb297b","Type":"ContainerStarted","Data":"928cc1968cbf6edbeb8eac90688203229ea6f2cd35922f63780a01f5511fdf4b"}
Sep 10 22:03:15.268454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.268391    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-c4x46" podStartSLOduration=2.311637254 podStartE2EDuration="3.268368921s" totalImagesPullingTime="956.731667ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:03:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:03:15.266948859 +0000 UTC m=+99.939046781" watchObservedRunningTime="2026-09-10 22:03:15.268368921 +0000 UTC m=+99.940466843"
Sep 10 22:03:15.297862 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.297827    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-75cf558f89-v4s46"]
Sep 10 22:03:15.299639 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.299589    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-llljk" podStartSLOduration=2.306441681 podStartE2EDuration="3.299576551s" totalImagesPullingTime="907.068832ms" totalInitContainerRuntime="86.066038ms" isStatefulPod=true podCreationTimestamp="2026-09-10 22:03:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:03:15.299463431 +0000 UTC m=+99.971561353" watchObservedRunningTime="2026-09-10 22:03:15.299576551 +0000 UTC m=+99.971674472"
Sep 10 22:03:15.302295 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.302260    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.306806 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.305435    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pp4ht\""
Sep 10 22:03:15.306806 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.305907    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 10 22:03:15.306806 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.305921    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 10 22:03:15.306806 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.306227    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-17m7h6g7ucjdb\""
Sep 10 22:03:15.306806 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.306621    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 10 22:03:15.307118 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.307090    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 10 22:03:15.307879 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.307847    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 10 22:03:15.322287 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.322252    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75cf558f89-v4s46"]
Sep 10 22:03:15.397326 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.397277    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/019b3300-6658-4cda-928a-32ff41d65d63-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.397326 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.397326    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/019b3300-6658-4cda-928a-32ff41d65d63-metrics-client-ca\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.397586 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.397440    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtskk\" (UniqueName: \"kubernetes.io/projected/019b3300-6658-4cda-928a-32ff41d65d63-kube-api-access-gtskk\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.397645 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.397587    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/019b3300-6658-4cda-928a-32ff41d65d63-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.397698 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.397679    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/019b3300-6658-4cda-928a-32ff41d65d63-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.397801 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.397766    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/019b3300-6658-4cda-928a-32ff41d65d63-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.397884 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.397816    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/019b3300-6658-4cda-928a-32ff41d65d63-secret-thanos-querier-tls\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.397935 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.397882    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/019b3300-6658-4cda-928a-32ff41d65d63-secret-grpc-tls\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.498692 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.498595    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/019b3300-6658-4cda-928a-32ff41d65d63-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.498692 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.498659    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/019b3300-6658-4cda-928a-32ff41d65d63-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.498914 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.498724    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/019b3300-6658-4cda-928a-32ff41d65d63-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.498914 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.498751    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/019b3300-6658-4cda-928a-32ff41d65d63-secret-thanos-querier-tls\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.498914 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.498803    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/019b3300-6658-4cda-928a-32ff41d65d63-secret-grpc-tls\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.498914 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.498838    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/019b3300-6658-4cda-928a-32ff41d65d63-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.498914 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.498862    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/019b3300-6658-4cda-928a-32ff41d65d63-metrics-client-ca\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.498914 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.498895    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtskk\" (UniqueName: \"kubernetes.io/projected/019b3300-6658-4cda-928a-32ff41d65d63-kube-api-access-gtskk\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.500755 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.500720    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/019b3300-6658-4cda-928a-32ff41d65d63-metrics-client-ca\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.502704 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.502650    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/019b3300-6658-4cda-928a-32ff41d65d63-secret-grpc-tls\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.503460 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.503415    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/019b3300-6658-4cda-928a-32ff41d65d63-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.503669 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.503643    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/019b3300-6658-4cda-928a-32ff41d65d63-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.504234 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.504211    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/019b3300-6658-4cda-928a-32ff41d65d63-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.504470 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.504443    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/019b3300-6658-4cda-928a-32ff41d65d63-secret-thanos-querier-tls\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.505830 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.505767    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/019b3300-6658-4cda-928a-32ff41d65d63-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.507673 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.507650    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtskk\" (UniqueName: \"kubernetes.io/projected/019b3300-6658-4cda-928a-32ff41d65d63-kube-api-access-gtskk\") pod \"thanos-querier-75cf558f89-v4s46\" (UID: \"019b3300-6658-4cda-928a-32ff41d65d63\") " pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.617663 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.617625    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:15.909347 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:15.909321    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75cf558f89-v4s46"]
Sep 10 22:03:15.910759 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:03:15.910731    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod019b3300_6658_4cda_928a_32ff41d65d63.slice/crio-7cc44f2d5d3a683fc65067354456209b12fd4c823ecbc53507001688266a1096 WatchSource:0}: Error finding container 7cc44f2d5d3a683fc65067354456209b12fd4c823ecbc53507001688266a1096: Status 404 returned error can't find the container with id 7cc44f2d5d3a683fc65067354456209b12fd4c823ecbc53507001688266a1096
Sep 10 22:03:16.255388 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.255353    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w524p" event={"ID":"271823ee-f2c9-4afa-bd8b-66f666095c92","Type":"ContainerStarted","Data":"2fe82bcc4ac00fe30f777b256f49c69e0542e12c5a32ff7b73a10e3175459c81"}
Sep 10 22:03:16.255866 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.255401    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w524p" event={"ID":"271823ee-f2c9-4afa-bd8b-66f666095c92","Type":"ContainerStarted","Data":"8598dfab06beaef07ca01668c9645b53eb3ca4a52df3c32deeb770a6c219911b"}
Sep 10 22:03:16.255866 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.255468    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w524p"
Sep 10 22:03:16.256649 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.256630    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46" event={"ID":"019b3300-6658-4cda-928a-32ff41d65d63","Type":"ContainerStarted","Data":"7cc44f2d5d3a683fc65067354456209b12fd4c823ecbc53507001688266a1096"}
Sep 10 22:03:16.273362 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.273316    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w524p" podStartSLOduration=65.45045702 podStartE2EDuration="1m7.27330178s" totalImagesPullingTime="1.82284476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:03:16.272412266 +0000 UTC m=+100.944510188" watchObservedRunningTime="2026-09-10 22:03:16.27330178 +0000 UTC m=+100.945399763"
Sep 10 22:03:16.657350 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.657310    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-58cc978fcd-wvt2b"]
Sep 10 22:03:16.662437 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.661637    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:16.664061 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.664038    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 10 22:03:16.664505 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.664470    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 10 22:03:16.664505 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.664502    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-sqvfs\""
Sep 10 22:03:16.664666 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.664502    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 10 22:03:16.664731 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.664691    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 10 22:03:16.664852 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.664828    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1ijid28m9qtgo\""
Sep 10 22:03:16.671319 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.671259    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-58cc978fcd-wvt2b"]
Sep 10 22:03:16.810674 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.810640    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/70e756be-8861-466d-9789-4ac95a6d9cab-metrics-server-audit-profiles\") pod \"metrics-server-58cc978fcd-wvt2b\" (UID: \"70e756be-8861-466d-9789-4ac95a6d9cab\") " pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:16.810864 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.810709    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/70e756be-8861-466d-9789-4ac95a6d9cab-secret-metrics-server-client-certs\") pod \"metrics-server-58cc978fcd-wvt2b\" (UID: \"70e756be-8861-466d-9789-4ac95a6d9cab\") " pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:16.810864 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.810803    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9wn7\" (UniqueName: \"kubernetes.io/projected/70e756be-8861-466d-9789-4ac95a6d9cab-kube-api-access-d9wn7\") pod \"metrics-server-58cc978fcd-wvt2b\" (UID: \"70e756be-8861-466d-9789-4ac95a6d9cab\") " pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:16.810987 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.810869    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70e756be-8861-466d-9789-4ac95a6d9cab-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58cc978fcd-wvt2b\" (UID: \"70e756be-8861-466d-9789-4ac95a6d9cab\") " pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:16.810987 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.810913    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/70e756be-8861-466d-9789-4ac95a6d9cab-audit-log\") pod \"metrics-server-58cc978fcd-wvt2b\" (UID: \"70e756be-8861-466d-9789-4ac95a6d9cab\") " pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:16.810987 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.810942    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/70e756be-8861-466d-9789-4ac95a6d9cab-secret-metrics-server-tls\") pod \"metrics-server-58cc978fcd-wvt2b\" (UID: \"70e756be-8861-466d-9789-4ac95a6d9cab\") " pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:16.811101 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.811029    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70e756be-8861-466d-9789-4ac95a6d9cab-client-ca-bundle\") pod \"metrics-server-58cc978fcd-wvt2b\" (UID: \"70e756be-8861-466d-9789-4ac95a6d9cab\") " pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:16.912493 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.912402    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/70e756be-8861-466d-9789-4ac95a6d9cab-metrics-server-audit-profiles\") pod \"metrics-server-58cc978fcd-wvt2b\" (UID: \"70e756be-8861-466d-9789-4ac95a6d9cab\") " pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:16.912493 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.912459    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/70e756be-8861-466d-9789-4ac95a6d9cab-secret-metrics-server-client-certs\") pod \"metrics-server-58cc978fcd-wvt2b\" (UID: \"70e756be-8861-466d-9789-4ac95a6d9cab\") " pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:16.912726 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.912502    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9wn7\" (UniqueName: \"kubernetes.io/projected/70e756be-8861-466d-9789-4ac95a6d9cab-kube-api-access-d9wn7\") pod \"metrics-server-58cc978fcd-wvt2b\" (UID: \"70e756be-8861-466d-9789-4ac95a6d9cab\") " pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:16.912726 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.912521    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70e756be-8861-466d-9789-4ac95a6d9cab-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58cc978fcd-wvt2b\" (UID: \"70e756be-8861-466d-9789-4ac95a6d9cab\") " pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:16.912726 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.912538    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/70e756be-8861-466d-9789-4ac95a6d9cab-audit-log\") pod \"metrics-server-58cc978fcd-wvt2b\" (UID: \"70e756be-8861-466d-9789-4ac95a6d9cab\") " pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:16.912726 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.912556    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/70e756be-8861-466d-9789-4ac95a6d9cab-secret-metrics-server-tls\") pod \"metrics-server-58cc978fcd-wvt2b\" (UID: \"70e756be-8861-466d-9789-4ac95a6d9cab\") " pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:16.912726 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.912602    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70e756be-8861-466d-9789-4ac95a6d9cab-client-ca-bundle\") pod \"metrics-server-58cc978fcd-wvt2b\" (UID: \"70e756be-8861-466d-9789-4ac95a6d9cab\") " pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:16.913208 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.913177    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/70e756be-8861-466d-9789-4ac95a6d9cab-audit-log\") pod \"metrics-server-58cc978fcd-wvt2b\" (UID: \"70e756be-8861-466d-9789-4ac95a6d9cab\") " pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:16.913299 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.913275    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70e756be-8861-466d-9789-4ac95a6d9cab-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58cc978fcd-wvt2b\" (UID: \"70e756be-8861-466d-9789-4ac95a6d9cab\") " pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:16.913690 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.913638    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/70e756be-8861-466d-9789-4ac95a6d9cab-metrics-server-audit-profiles\") pod \"metrics-server-58cc978fcd-wvt2b\" (UID: \"70e756be-8861-466d-9789-4ac95a6d9cab\") " pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:16.915995 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.915972    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/70e756be-8861-466d-9789-4ac95a6d9cab-secret-metrics-server-client-certs\") pod \"metrics-server-58cc978fcd-wvt2b\" (UID: \"70e756be-8861-466d-9789-4ac95a6d9cab\") " pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:16.916110 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.916027    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/70e756be-8861-466d-9789-4ac95a6d9cab-secret-metrics-server-tls\") pod \"metrics-server-58cc978fcd-wvt2b\" (UID: \"70e756be-8861-466d-9789-4ac95a6d9cab\") " pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:16.916154 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.916137    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70e756be-8861-466d-9789-4ac95a6d9cab-client-ca-bundle\") pod \"metrics-server-58cc978fcd-wvt2b\" (UID: \"70e756be-8861-466d-9789-4ac95a6d9cab\") " pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:16.920610 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.920576    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9wn7\" (UniqueName: \"kubernetes.io/projected/70e756be-8861-466d-9789-4ac95a6d9cab-kube-api-access-d9wn7\") pod \"metrics-server-58cc978fcd-wvt2b\" (UID: \"70e756be-8861-466d-9789-4ac95a6d9cab\") " pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:16.975222 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:16.975081    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:17.207284 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:17.207207    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:03:17.260680 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:17.260638    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-58cc978fcd-wvt2b"]
Sep 10 22:03:17.688999 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:03:17.688963    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e756be_8861_466d_9789_4ac95a6d9cab.slice/crio-2cc799382fdc71ef1750c7a37c6af38774075b8c5ba0ae35a0ef281112a77c6a WatchSource:0}: Error finding container 2cc799382fdc71ef1750c7a37c6af38774075b8c5ba0ae35a0ef281112a77c6a: Status 404 returned error can't find the container with id 2cc799382fdc71ef1750c7a37c6af38774075b8c5ba0ae35a0ef281112a77c6a
Sep 10 22:03:18.269516 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:18.269436    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46" event={"ID":"019b3300-6658-4cda-928a-32ff41d65d63","Type":"ContainerStarted","Data":"ba3d9b6977948637e26326a9f8f7ca58e877414966067e8b6e3c587c5c25b2ae"}
Sep 10 22:03:18.270005 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:18.269519    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46" event={"ID":"019b3300-6658-4cda-928a-32ff41d65d63","Type":"ContainerStarted","Data":"4226e17383f6e8f7d9f766c87ac748952e686d028430f06de1d6309e81085e3b"}
Sep 10 22:03:18.270005 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:18.269566    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46" event={"ID":"019b3300-6658-4cda-928a-32ff41d65d63","Type":"ContainerStarted","Data":"575d0ae9b951a2ff268305114801facd364ee75d760713d6ad67ef3ff2956ffb"}
Sep 10 22:03:18.270938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:18.270904    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b" event={"ID":"70e756be-8861-466d-9789-4ac95a6d9cab","Type":"ContainerStarted","Data":"2cc799382fdc71ef1750c7a37c6af38774075b8c5ba0ae35a0ef281112a77c6a"}
Sep 10 22:03:19.139665 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:19.139633    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8ft52"
Sep 10 22:03:19.182034 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:19.182005    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-788d5df44-gfpnm"
Sep 10 22:03:20.281391 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:20.281302    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46" event={"ID":"019b3300-6658-4cda-928a-32ff41d65d63","Type":"ContainerStarted","Data":"a9ae4cee524c84fcf97743a43b7643cbdca31b26d271577b36e657befec9c33a"}
Sep 10 22:03:20.281391 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:20.281385    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46" event={"ID":"019b3300-6658-4cda-928a-32ff41d65d63","Type":"ContainerStarted","Data":"423b9398d30648038522a134bc27be1f268e786a1c7f3a2bcb0cafb0ace1a6c7"}
Sep 10 22:03:20.281861 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:20.281428    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46" event={"ID":"019b3300-6658-4cda-928a-32ff41d65d63","Type":"ContainerStarted","Data":"91b5f2409fe29fcf8faf4852025753c76748104853b12c3d62b2fa9ac842b13a"}
Sep 10 22:03:20.281861 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:20.281544    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:20.282882 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:20.282856    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b" event={"ID":"70e756be-8861-466d-9789-4ac95a6d9cab","Type":"ContainerStarted","Data":"f29b8b9b5ee96f646b69cbd026f7f7d72887792c1d4f2b75908cba607b473b29"}
Sep 10 22:03:20.305053 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:20.305003    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46" podStartSLOduration=1.871860368 podStartE2EDuration="5.304987773s" totalImagesPullingTime="3.433127405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:03:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:03:20.303826448 +0000 UTC m=+104.975924370" watchObservedRunningTime="2026-09-10 22:03:20.304987773 +0000 UTC m=+104.977085697"
Sep 10 22:03:20.320552 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:20.320502    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b" podStartSLOduration=2.351140296 podStartE2EDuration="4.320485258s" totalImagesPullingTime="1.969344962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:03:20.319649306 +0000 UTC m=+104.991747227" watchObservedRunningTime="2026-09-10 22:03:20.320485258 +0000 UTC m=+104.992583179"
Sep 10 22:03:22.220622 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.220561    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q" podUID="2caeb931-21b1-4f02-ade4-a690f0b06b16" containerName="registry" containerID="cri-o://810045b17f94535acc3044ed4b85a2e94ecf34b97209568e45d31169121f0874" gracePeriod=30
Sep 10 22:03:22.457964 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.457940    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:03:22.561353 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.561272    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-certificates\") pod \"2caeb931-21b1-4f02-ade4-a690f0b06b16\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") "
Sep 10 22:03:22.561353 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.561334    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5sn76\" (UniqueName: \"kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-kube-api-access-5sn76\") pod \"2caeb931-21b1-4f02-ade4-a690f0b06b16\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") "
Sep 10 22:03:22.561584 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.561367    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2caeb931-21b1-4f02-ade4-a690f0b06b16-ca-trust-extracted\") pod \"2caeb931-21b1-4f02-ade4-a690f0b06b16\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") "
Sep 10 22:03:22.561584 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.561488    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2caeb931-21b1-4f02-ade4-a690f0b06b16-trusted-ca\") pod \"2caeb931-21b1-4f02-ade4-a690f0b06b16\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") "
Sep 10 22:03:22.561584 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.561543    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-tls\") pod \"2caeb931-21b1-4f02-ade4-a690f0b06b16\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") "
Sep 10 22:03:22.562040 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.561888    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2caeb931-21b1-4f02-ade4-a690f0b06b16-installation-pull-secrets\") pod \"2caeb931-21b1-4f02-ade4-a690f0b06b16\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") "
Sep 10 22:03:22.562113 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.562087    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2caeb931-21b1-4f02-ade4-a690f0b06b16-image-registry-private-configuration\") pod \"2caeb931-21b1-4f02-ade4-a690f0b06b16\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") "
Sep 10 22:03:22.562155 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.562130    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-bound-sa-token\") pod \"2caeb931-21b1-4f02-ade4-a690f0b06b16\" (UID: \"2caeb931-21b1-4f02-ade4-a690f0b06b16\") "
Sep 10 22:03:22.562195 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.562142    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2caeb931-21b1-4f02-ade4-a690f0b06b16" (UID: "2caeb931-21b1-4f02-ade4-a690f0b06b16"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:03:22.562254 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.562185    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2caeb931-21b1-4f02-ade4-a690f0b06b16-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2caeb931-21b1-4f02-ade4-a690f0b06b16" (UID: "2caeb931-21b1-4f02-ade4-a690f0b06b16"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:03:22.562643 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.562547    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-certificates\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:03:22.562643 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.562573    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2caeb931-21b1-4f02-ade4-a690f0b06b16-trusted-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:03:22.566563 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.565482    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2caeb931-21b1-4f02-ade4-a690f0b06b16" (UID: "2caeb931-21b1-4f02-ade4-a690f0b06b16"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:03:22.566563 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.565648    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2caeb931-21b1-4f02-ade4-a690f0b06b16" (UID: "2caeb931-21b1-4f02-ade4-a690f0b06b16"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:03:22.566563 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.566403    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2caeb931-21b1-4f02-ade4-a690f0b06b16-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2caeb931-21b1-4f02-ade4-a690f0b06b16" (UID: "2caeb931-21b1-4f02-ade4-a690f0b06b16"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:03:22.566563 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.566497    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2caeb931-21b1-4f02-ade4-a690f0b06b16-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2caeb931-21b1-4f02-ade4-a690f0b06b16" (UID: "2caeb931-21b1-4f02-ade4-a690f0b06b16"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:03:22.570907 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.570714    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-kube-api-access-5sn76" (OuterVolumeSpecName: "kube-api-access-5sn76") pod "2caeb931-21b1-4f02-ade4-a690f0b06b16" (UID: "2caeb931-21b1-4f02-ade4-a690f0b06b16"). InnerVolumeSpecName "kube-api-access-5sn76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:03:22.573612 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.573588    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2caeb931-21b1-4f02-ade4-a690f0b06b16-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2caeb931-21b1-4f02-ade4-a690f0b06b16" (UID: "2caeb931-21b1-4f02-ade4-a690f0b06b16"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:03:22.663178 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.663143    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sn76\" (UniqueName: \"kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-kube-api-access-5sn76\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:03:22.663178 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.663170    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2caeb931-21b1-4f02-ade4-a690f0b06b16-ca-trust-extracted\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:03:22.663178 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.663182    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-registry-tls\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:03:22.663178 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.663191    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2caeb931-21b1-4f02-ade4-a690f0b06b16-installation-pull-secrets\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:03:22.663516 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.663199    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2caeb931-21b1-4f02-ade4-a690f0b06b16-image-registry-private-configuration\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:03:22.663516 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:22.663209    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2caeb931-21b1-4f02-ade4-a690f0b06b16-bound-sa-token\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:03:23.296039 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:23.296007    2577 generic.go:356] "Generic (PLEG): container finished" podID="2caeb931-21b1-4f02-ade4-a690f0b06b16" containerID="810045b17f94535acc3044ed4b85a2e94ecf34b97209568e45d31169121f0874" exitCode=0
Sep 10 22:03:23.296039 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:23.296043    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q" event={"ID":"2caeb931-21b1-4f02-ade4-a690f0b06b16","Type":"ContainerDied","Data":"810045b17f94535acc3044ed4b85a2e94ecf34b97209568e45d31169121f0874"}
Sep 10 22:03:23.296448 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:23.296079    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q" event={"ID":"2caeb931-21b1-4f02-ade4-a690f0b06b16","Type":"ContainerDied","Data":"2a17b4630e9cbf3d96a6898ad6c7fec19bc5cc455039726f2ad714133644fefe"}
Sep 10 22:03:23.296448 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:23.296082    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58f68dcfc4-fvp7q"
Sep 10 22:03:23.296878 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:23.296867    2577 scope.go:117] "RemoveContainer" containerID="810045b17f94535acc3044ed4b85a2e94ecf34b97209568e45d31169121f0874"
Sep 10 22:03:23.305852 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:23.305833    2577 scope.go:117] "RemoveContainer" containerID="810045b17f94535acc3044ed4b85a2e94ecf34b97209568e45d31169121f0874"
Sep 10 22:03:23.306160 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:03:23.306141    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"810045b17f94535acc3044ed4b85a2e94ecf34b97209568e45d31169121f0874\": container with ID starting with 810045b17f94535acc3044ed4b85a2e94ecf34b97209568e45d31169121f0874 not found: ID does not exist" containerID="810045b17f94535acc3044ed4b85a2e94ecf34b97209568e45d31169121f0874"
Sep 10 22:03:23.306210 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:23.306168    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"810045b17f94535acc3044ed4b85a2e94ecf34b97209568e45d31169121f0874"} err="failed to get container status \"810045b17f94535acc3044ed4b85a2e94ecf34b97209568e45d31169121f0874\": rpc error: code = NotFound desc = could not find container \"810045b17f94535acc3044ed4b85a2e94ecf34b97209568e45d31169121f0874\": container with ID starting with 810045b17f94535acc3044ed4b85a2e94ecf34b97209568e45d31169121f0874 not found: ID does not exist"
Sep 10 22:03:23.320061 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:23.320035    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58f68dcfc4-fvp7q"]
Sep 10 22:03:23.322455 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:23.322432    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-58f68dcfc4-fvp7q"]
Sep 10 22:03:23.846499 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:23.846465    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2caeb931-21b1-4f02-ade4-a690f0b06b16" path="/var/lib/kubelet/pods/2caeb931-21b1-4f02-ade4-a690f0b06b16/volumes"
Sep 10 22:03:25.560741 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:25.560706    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-q8rmz"]
Sep 10 22:03:25.561158 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:25.560986    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2caeb931-21b1-4f02-ade4-a690f0b06b16" containerName="registry"
Sep 10 22:03:25.561158 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:25.560997    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2caeb931-21b1-4f02-ade4-a690f0b06b16" containerName="registry"
Sep 10 22:03:25.561158 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:25.561049    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2caeb931-21b1-4f02-ade4-a690f0b06b16" containerName="registry"
Sep 10 22:03:25.562595 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:25.562578    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-q8rmz"
Sep 10 22:03:25.564637 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:25.564611    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 22:03:25.564760 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:25.564713    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-q9klt\""
Sep 10 22:03:25.564760 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:25.564713    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 22:03:25.574090 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:25.574067    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-q8rmz"]
Sep 10 22:03:25.689205 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:25.689156    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k2j4\" (UniqueName: \"kubernetes.io/projected/455cfb34-8878-4260-84bd-320ec5bffb0c-kube-api-access-4k2j4\") pod \"downloads-76f99584f4-q8rmz\" (UID: \"455cfb34-8878-4260-84bd-320ec5bffb0c\") " pod="openshift-console/downloads-76f99584f4-q8rmz"
Sep 10 22:03:25.789752 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:25.789723    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k2j4\" (UniqueName: \"kubernetes.io/projected/455cfb34-8878-4260-84bd-320ec5bffb0c-kube-api-access-4k2j4\") pod \"downloads-76f99584f4-q8rmz\" (UID: \"455cfb34-8878-4260-84bd-320ec5bffb0c\") " pod="openshift-console/downloads-76f99584f4-q8rmz"
Sep 10 22:03:25.798510 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:25.798488    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k2j4\" (UniqueName: \"kubernetes.io/projected/455cfb34-8878-4260-84bd-320ec5bffb0c-kube-api-access-4k2j4\") pod \"downloads-76f99584f4-q8rmz\" (UID: \"455cfb34-8878-4260-84bd-320ec5bffb0c\") " pod="openshift-console/downloads-76f99584f4-q8rmz"
Sep 10 22:03:25.871361 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:25.871282    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-q8rmz"
Sep 10 22:03:26.146358 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:26.146326    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-q8rmz"]
Sep 10 22:03:26.150438 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:03:26.150410    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod455cfb34_8878_4260_84bd_320ec5bffb0c.slice/crio-1bc74c0362bcb56b2d3af60fdc97fb60588614bcf9a90f01373e9177b3f8eabc WatchSource:0}: Error finding container 1bc74c0362bcb56b2d3af60fdc97fb60588614bcf9a90f01373e9177b3f8eabc: Status 404 returned error can't find the container with id 1bc74c0362bcb56b2d3af60fdc97fb60588614bcf9a90f01373e9177b3f8eabc
Sep 10 22:03:26.264164 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:26.264132    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w524p"
Sep 10 22:03:26.293367 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:26.293339    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-75cf558f89-v4s46"
Sep 10 22:03:26.310467 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:26.310430    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-q8rmz" event={"ID":"455cfb34-8878-4260-84bd-320ec5bffb0c","Type":"ContainerStarted","Data":"1bc74c0362bcb56b2d3af60fdc97fb60588614bcf9a90f01373e9177b3f8eabc"}
Sep 10 22:03:36.413247 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.413211    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cc887d74c-zkbdp"]
Sep 10 22:03:36.416154 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.416133    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:36.419110 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.418894    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 22:03:36.419110 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.418918    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 22:03:36.419110 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.418968    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8xjnx\""
Sep 10 22:03:36.419110 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.418994    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 22:03:36.419110 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.418994    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 22:03:36.419453 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.419141    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 22:03:36.426479 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.426454    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cc887d74c-zkbdp"]
Sep 10 22:03:36.475395 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.475355    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1a98ea4-9bfe-4c57-98ca-c997347407a0-console-serving-cert\") pod \"console-5cc887d74c-zkbdp\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") " pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:36.475574 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.475437    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1a98ea4-9bfe-4c57-98ca-c997347407a0-console-oauth-config\") pod \"console-5cc887d74c-zkbdp\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") " pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:36.475574 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.475509    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1a98ea4-9bfe-4c57-98ca-c997347407a0-console-config\") pod \"console-5cc887d74c-zkbdp\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") " pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:36.475574 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.475563    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1a98ea4-9bfe-4c57-98ca-c997347407a0-service-ca\") pod \"console-5cc887d74c-zkbdp\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") " pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:36.475811 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.475600    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64h8j\" (UniqueName: \"kubernetes.io/projected/e1a98ea4-9bfe-4c57-98ca-c997347407a0-kube-api-access-64h8j\") pod \"console-5cc887d74c-zkbdp\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") " pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:36.475811 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.475668    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1a98ea4-9bfe-4c57-98ca-c997347407a0-oauth-serving-cert\") pod \"console-5cc887d74c-zkbdp\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") " pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:36.576846 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.576813    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1a98ea4-9bfe-4c57-98ca-c997347407a0-console-serving-cert\") pod \"console-5cc887d74c-zkbdp\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") " pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:36.577049 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.576898    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1a98ea4-9bfe-4c57-98ca-c997347407a0-console-oauth-config\") pod \"console-5cc887d74c-zkbdp\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") " pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:36.577049 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.576944    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1a98ea4-9bfe-4c57-98ca-c997347407a0-console-config\") pod \"console-5cc887d74c-zkbdp\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") " pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:36.577049 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.576971    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1a98ea4-9bfe-4c57-98ca-c997347407a0-service-ca\") pod \"console-5cc887d74c-zkbdp\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") " pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:36.577049 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.576997    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64h8j\" (UniqueName: \"kubernetes.io/projected/e1a98ea4-9bfe-4c57-98ca-c997347407a0-kube-api-access-64h8j\") pod \"console-5cc887d74c-zkbdp\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") " pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:36.577049 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.577042    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1a98ea4-9bfe-4c57-98ca-c997347407a0-oauth-serving-cert\") pod \"console-5cc887d74c-zkbdp\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") " pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:36.577861 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.577831    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1a98ea4-9bfe-4c57-98ca-c997347407a0-console-config\") pod \"console-5cc887d74c-zkbdp\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") " pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:36.578186 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.578076    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1a98ea4-9bfe-4c57-98ca-c997347407a0-oauth-serving-cert\") pod \"console-5cc887d74c-zkbdp\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") " pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:36.578393 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.578352    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1a98ea4-9bfe-4c57-98ca-c997347407a0-service-ca\") pod \"console-5cc887d74c-zkbdp\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") " pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:36.580478 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.580451    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1a98ea4-9bfe-4c57-98ca-c997347407a0-console-serving-cert\") pod \"console-5cc887d74c-zkbdp\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") " pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:36.580616 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.580592    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1a98ea4-9bfe-4c57-98ca-c997347407a0-console-oauth-config\") pod \"console-5cc887d74c-zkbdp\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") " pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:36.586409 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.586379    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64h8j\" (UniqueName: \"kubernetes.io/projected/e1a98ea4-9bfe-4c57-98ca-c997347407a0-kube-api-access-64h8j\") pod \"console-5cc887d74c-zkbdp\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") " pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:36.726711 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.726622    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:36.976106 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.976069    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:36.976279 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:36.976147    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:42.141629 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:42.141594    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cc887d74c-zkbdp"]
Sep 10 22:03:42.144409 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:03:42.144372    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1a98ea4_9bfe_4c57_98ca_c997347407a0.slice/crio-5e9d5d3c89fba55cda33d80540c154f9e54108a0270d0135b8fd59d96fb39f3d WatchSource:0}: Error finding container 5e9d5d3c89fba55cda33d80540c154f9e54108a0270d0135b8fd59d96fb39f3d: Status 404 returned error can't find the container with id 5e9d5d3c89fba55cda33d80540c154f9e54108a0270d0135b8fd59d96fb39f3d
Sep 10 22:03:42.379044 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:42.379002    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-q8rmz" event={"ID":"455cfb34-8878-4260-84bd-320ec5bffb0c","Type":"ContainerStarted","Data":"3f521b73773cc034d28351b2fbd7d668b6d0b6d355b0dfff2a47838d1b0488a7"}
Sep 10 22:03:42.379234 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:42.379204    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-q8rmz"
Sep 10 22:03:42.380487 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:42.380451    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc887d74c-zkbdp" event={"ID":"e1a98ea4-9bfe-4c57-98ca-c997347407a0","Type":"ContainerStarted","Data":"5e9d5d3c89fba55cda33d80540c154f9e54108a0270d0135b8fd59d96fb39f3d"}
Sep 10 22:03:42.382409 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:42.382381    2577 generic.go:356] "Generic (PLEG): container finished" podID="56d34526-ae4c-41ef-ae43-5974a7d7a865" containerID="2d1022dc02dccd35de7aa39c28ac3562c070598fd5d4ec185113a406da220c2b" exitCode=0
Sep 10 22:03:42.382543 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:42.382416    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9zl6k" event={"ID":"56d34526-ae4c-41ef-ae43-5974a7d7a865","Type":"ContainerDied","Data":"2d1022dc02dccd35de7aa39c28ac3562c070598fd5d4ec185113a406da220c2b"}
Sep 10 22:03:42.382707 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:42.382692    2577 scope.go:117] "RemoveContainer" containerID="2d1022dc02dccd35de7aa39c28ac3562c070598fd5d4ec185113a406da220c2b"
Sep 10 22:03:42.386171 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:42.386146    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-q8rmz"
Sep 10 22:03:42.393998 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:42.393926    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-q8rmz" podStartSLOduration=1.602334309 podStartE2EDuration="17.393909382s" totalImagesPullingTime="15.791575073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:03:42.39303133 +0000 UTC m=+127.065129253" watchObservedRunningTime="2026-09-10 22:03:42.393909382 +0000 UTC m=+127.066007303"
Sep 10 22:03:43.391174 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:43.391124    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9zl6k" event={"ID":"56d34526-ae4c-41ef-ae43-5974a7d7a865","Type":"ContainerStarted","Data":"a6c582bf681998b20b6cc4fdf8871d9c2943fa0351d0a329006bb956d55168f8"}
Sep 10 22:03:45.666737 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:45.666678    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs\") pod \"network-metrics-daemon-8gghw\" (UID: \"d8a674c6-a1ec-4c69-885b-bb1a7b052aef\") " pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:03:45.669433 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:45.669403    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8a674c6-a1ec-4c69-885b-bb1a7b052aef-metrics-certs\") pod \"network-metrics-daemon-8gghw\" (UID: \"d8a674c6-a1ec-4c69-885b-bb1a7b052aef\") " pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:03:45.857143 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:45.857111    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vfb6l\""
Sep 10 22:03:45.863892 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:45.863864    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f9b9dfbc5-pm5p2"]
Sep 10 22:03:45.866204 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:45.866179    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gghw"
Sep 10 22:03:45.878731 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:45.878693    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f9b9dfbc5-pm5p2"]
Sep 10 22:03:45.878895 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:45.878830    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:45.885797 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:45.885751    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 22:03:45.969874 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:45.969762    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95af71e6-405c-46ec-89a9-fee04b338c35-console-serving-cert\") pod \"console-f9b9dfbc5-pm5p2\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") " pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:45.970042 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:45.969884    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-service-ca\") pod \"console-f9b9dfbc5-pm5p2\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") " pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:45.970042 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:45.969959    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-trusted-ca-bundle\") pod \"console-f9b9dfbc5-pm5p2\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") " pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:45.970042 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:45.970034    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95af71e6-405c-46ec-89a9-fee04b338c35-console-oauth-config\") pod \"console-f9b9dfbc5-pm5p2\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") " pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:45.970180 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:45.970067    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-oauth-serving-cert\") pod \"console-f9b9dfbc5-pm5p2\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") " pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:45.970180 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:45.970097    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5fqm\" (UniqueName: \"kubernetes.io/projected/95af71e6-405c-46ec-89a9-fee04b338c35-kube-api-access-f5fqm\") pod \"console-f9b9dfbc5-pm5p2\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") " pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:45.970180 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:45.970135    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-console-config\") pod \"console-f9b9dfbc5-pm5p2\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") " pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:46.070934 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.070893    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-trusted-ca-bundle\") pod \"console-f9b9dfbc5-pm5p2\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") " pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:46.071128 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.070963    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95af71e6-405c-46ec-89a9-fee04b338c35-console-oauth-config\") pod \"console-f9b9dfbc5-pm5p2\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") " pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:46.071128 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.071092    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-oauth-serving-cert\") pod \"console-f9b9dfbc5-pm5p2\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") " pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:46.071241 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.071141    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5fqm\" (UniqueName: \"kubernetes.io/projected/95af71e6-405c-46ec-89a9-fee04b338c35-kube-api-access-f5fqm\") pod \"console-f9b9dfbc5-pm5p2\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") " pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:46.071241 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.071187    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-console-config\") pod \"console-f9b9dfbc5-pm5p2\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") " pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:46.071241 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.071236    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95af71e6-405c-46ec-89a9-fee04b338c35-console-serving-cert\") pod \"console-f9b9dfbc5-pm5p2\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") " pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:46.071388 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.071266    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-service-ca\") pod \"console-f9b9dfbc5-pm5p2\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") " pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:46.072008 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.071972    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-console-config\") pod \"console-f9b9dfbc5-pm5p2\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") " pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:46.072008 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.071998    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-service-ca\") pod \"console-f9b9dfbc5-pm5p2\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") " pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:46.072173 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.072011    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-trusted-ca-bundle\") pod \"console-f9b9dfbc5-pm5p2\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") " pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:46.072402 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.072378    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-oauth-serving-cert\") pod \"console-f9b9dfbc5-pm5p2\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") " pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:46.075186 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.075160    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95af71e6-405c-46ec-89a9-fee04b338c35-console-oauth-config\") pod \"console-f9b9dfbc5-pm5p2\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") " pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:46.075306 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.075160    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95af71e6-405c-46ec-89a9-fee04b338c35-console-serving-cert\") pod \"console-f9b9dfbc5-pm5p2\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") " pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:46.079933 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.079902    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5fqm\" (UniqueName: \"kubernetes.io/projected/95af71e6-405c-46ec-89a9-fee04b338c35-kube-api-access-f5fqm\") pod \"console-f9b9dfbc5-pm5p2\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") " pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:46.191852 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.191814    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:46.375469 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.375433    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8gghw"]
Sep 10 22:03:46.378971 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:03:46.378935    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8a674c6_a1ec_4c69_885b_bb1a7b052aef.slice/crio-140464b9d06840b320a345bd568b12f1082dd3433a55a61fd3d5abb7bf134d91 WatchSource:0}: Error finding container 140464b9d06840b320a345bd568b12f1082dd3433a55a61fd3d5abb7bf134d91: Status 404 returned error can't find the container with id 140464b9d06840b320a345bd568b12f1082dd3433a55a61fd3d5abb7bf134d91
Sep 10 22:03:46.407489 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.407448    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8gghw" event={"ID":"d8a674c6-a1ec-4c69-885b-bb1a7b052aef","Type":"ContainerStarted","Data":"140464b9d06840b320a345bd568b12f1082dd3433a55a61fd3d5abb7bf134d91"}
Sep 10 22:03:46.409685 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.409653    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc887d74c-zkbdp" event={"ID":"e1a98ea4-9bfe-4c57-98ca-c997347407a0","Type":"ContainerStarted","Data":"a8694aa6238543454da1dc05b50194331a2f1783f7e4f8c1a9c0975998819995"}
Sep 10 22:03:46.429800 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.428181    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cc887d74c-zkbdp" podStartSLOduration=6.474419202 podStartE2EDuration="10.428159329s" totalImagesPullingTime="3.953740127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:03:46.425524146 +0000 UTC m=+131.097622061" watchObservedRunningTime="2026-09-10 22:03:46.428159329 +0000 UTC m=+131.100257251"
Sep 10 22:03:46.500450 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.500376    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f9b9dfbc5-pm5p2"]
Sep 10 22:03:46.503409 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:03:46.503380    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95af71e6_405c_46ec_89a9_fee04b338c35.slice/crio-6dbb8e7fd690c404dc25d0d175a8dd8c47fe4734abee9172ce3ca2a30f95d17d WatchSource:0}: Error finding container 6dbb8e7fd690c404dc25d0d175a8dd8c47fe4734abee9172ce3ca2a30f95d17d: Status 404 returned error can't find the container with id 6dbb8e7fd690c404dc25d0d175a8dd8c47fe4734abee9172ce3ca2a30f95d17d
Sep 10 22:03:46.727362 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.727307    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:46.727852 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.727390    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:46.733072 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:46.733040    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:47.417099 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:47.417052    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9b9dfbc5-pm5p2" event={"ID":"95af71e6-405c-46ec-89a9-fee04b338c35","Type":"ContainerStarted","Data":"ceb84771c57dd40fd552a5ef6508cf7bc06046edf16bb70ae09841ab4a8d3b8c"}
Sep 10 22:03:47.417291 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:47.417118    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9b9dfbc5-pm5p2" event={"ID":"95af71e6-405c-46ec-89a9-fee04b338c35","Type":"ContainerStarted","Data":"6dbb8e7fd690c404dc25d0d175a8dd8c47fe4734abee9172ce3ca2a30f95d17d"}
Sep 10 22:03:47.422336 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:47.422277    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:03:47.435173 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:47.435110    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f9b9dfbc5-pm5p2" podStartSLOduration=2.435087068 podStartE2EDuration="2.435087068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:03:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:03:47.43303025 +0000 UTC m=+132.105128172" watchObservedRunningTime="2026-09-10 22:03:47.435087068 +0000 UTC m=+132.107185295"
Sep 10 22:03:48.424235 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:48.424129    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8gghw" event={"ID":"d8a674c6-a1ec-4c69-885b-bb1a7b052aef","Type":"ContainerStarted","Data":"9dd16c35e63f018064b02d3a0abd9b3767e8823b72c147aae50b710d1181c736"}
Sep 10 22:03:48.424235 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:48.424201    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8gghw" event={"ID":"d8a674c6-a1ec-4c69-885b-bb1a7b052aef","Type":"ContainerStarted","Data":"a75ce7c3e84ee7a5f7cfe707cd308ad369c368229a76d14bdf13070681a1f34c"}
Sep 10 22:03:48.439569 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:48.439511    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8gghw" podStartSLOduration=131.817328497 podStartE2EDuration="2m13.439486434s" totalImagesPullingTime="1.622157937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:03:48.438209857 +0000 UTC m=+133.110307777" watchObservedRunningTime="2026-09-10 22:03:48.439486434 +0000 UTC m=+133.111584359"
Sep 10 22:03:56.192830 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:56.192788    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:56.193370 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:56.192853    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:56.197845 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:56.197819    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:56.464444 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:56.464363    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:03:56.510388 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:56.510352    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cc887d74c-zkbdp"]
Sep 10 22:03:56.981249 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:56.981221    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:03:56.985290 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:03:56.985264    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-58cc978fcd-wvt2b"
Sep 10 22:04:21.535270 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:21.535220    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cc887d74c-zkbdp" podUID="e1a98ea4-9bfe-4c57-98ca-c997347407a0" containerName="console" containerID="cri-o://a8694aa6238543454da1dc05b50194331a2f1783f7e4f8c1a9c0975998819995" gracePeriod=15
Sep 10 22:04:21.806680 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:21.806605    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:04:21.879065 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:21.879030    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1a98ea4-9bfe-4c57-98ca-c997347407a0-console-serving-cert\") pod \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") "
Sep 10 22:04:21.879065 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:21.879063    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1a98ea4-9bfe-4c57-98ca-c997347407a0-console-oauth-config\") pod \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") "
Sep 10 22:04:21.879292 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:21.879086    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1a98ea4-9bfe-4c57-98ca-c997347407a0-oauth-serving-cert\") pod \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") "
Sep 10 22:04:21.879292 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:21.879147    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1a98ea4-9bfe-4c57-98ca-c997347407a0-console-config\") pod \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") "
Sep 10 22:04:21.879292 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:21.879211    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64h8j\" (UniqueName: \"kubernetes.io/projected/e1a98ea4-9bfe-4c57-98ca-c997347407a0-kube-api-access-64h8j\") pod \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") "
Sep 10 22:04:21.879292 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:21.879264    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1a98ea4-9bfe-4c57-98ca-c997347407a0-service-ca\") pod \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\" (UID: \"e1a98ea4-9bfe-4c57-98ca-c997347407a0\") "
Sep 10 22:04:21.879661 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:21.879631    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1a98ea4-9bfe-4c57-98ca-c997347407a0-console-config" (OuterVolumeSpecName: "console-config") pod "e1a98ea4-9bfe-4c57-98ca-c997347407a0" (UID: "e1a98ea4-9bfe-4c57-98ca-c997347407a0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:04:21.879661 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:21.879648    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1a98ea4-9bfe-4c57-98ca-c997347407a0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e1a98ea4-9bfe-4c57-98ca-c997347407a0" (UID: "e1a98ea4-9bfe-4c57-98ca-c997347407a0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:04:21.880047 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:21.879718    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1a98ea4-9bfe-4c57-98ca-c997347407a0-service-ca" (OuterVolumeSpecName: "service-ca") pod "e1a98ea4-9bfe-4c57-98ca-c997347407a0" (UID: "e1a98ea4-9bfe-4c57-98ca-c997347407a0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:04:21.881561 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:21.881537    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1a98ea4-9bfe-4c57-98ca-c997347407a0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e1a98ea4-9bfe-4c57-98ca-c997347407a0" (UID: "e1a98ea4-9bfe-4c57-98ca-c997347407a0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:04:21.881666 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:21.881588    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1a98ea4-9bfe-4c57-98ca-c997347407a0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e1a98ea4-9bfe-4c57-98ca-c997347407a0" (UID: "e1a98ea4-9bfe-4c57-98ca-c997347407a0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:04:21.881666 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:21.881601    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1a98ea4-9bfe-4c57-98ca-c997347407a0-kube-api-access-64h8j" (OuterVolumeSpecName: "kube-api-access-64h8j") pod "e1a98ea4-9bfe-4c57-98ca-c997347407a0" (UID: "e1a98ea4-9bfe-4c57-98ca-c997347407a0"). InnerVolumeSpecName "kube-api-access-64h8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:04:21.980762 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:21.980729    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1a98ea4-9bfe-4c57-98ca-c997347407a0-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:04:21.980762 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:21.980765    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1a98ea4-9bfe-4c57-98ca-c997347407a0-console-serving-cert\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:04:21.980970 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:21.980810    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1a98ea4-9bfe-4c57-98ca-c997347407a0-console-oauth-config\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:04:21.980970 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:21.980825    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1a98ea4-9bfe-4c57-98ca-c997347407a0-oauth-serving-cert\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:04:21.980970 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:21.980838    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1a98ea4-9bfe-4c57-98ca-c997347407a0-console-config\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:04:21.980970 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:21.980852    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64h8j\" (UniqueName: \"kubernetes.io/projected/e1a98ea4-9bfe-4c57-98ca-c997347407a0-kube-api-access-64h8j\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:04:22.561888 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:22.561853    2577 generic.go:356] "Generic (PLEG): container finished" podID="e1a98ea4-9bfe-4c57-98ca-c997347407a0" containerID="a8694aa6238543454da1dc05b50194331a2f1783f7e4f8c1a9c0975998819995" exitCode=0
Sep 10 22:04:22.562328 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:22.561904    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc887d74c-zkbdp"
Sep 10 22:04:22.562328 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:22.561944    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc887d74c-zkbdp" event={"ID":"e1a98ea4-9bfe-4c57-98ca-c997347407a0","Type":"ContainerDied","Data":"a8694aa6238543454da1dc05b50194331a2f1783f7e4f8c1a9c0975998819995"}
Sep 10 22:04:22.562328 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:22.562002    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc887d74c-zkbdp" event={"ID":"e1a98ea4-9bfe-4c57-98ca-c997347407a0","Type":"ContainerDied","Data":"5e9d5d3c89fba55cda33d80540c154f9e54108a0270d0135b8fd59d96fb39f3d"}
Sep 10 22:04:22.562328 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:22.562024    2577 scope.go:117] "RemoveContainer" containerID="a8694aa6238543454da1dc05b50194331a2f1783f7e4f8c1a9c0975998819995"
Sep 10 22:04:22.575610 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:22.575588    2577 scope.go:117] "RemoveContainer" containerID="a8694aa6238543454da1dc05b50194331a2f1783f7e4f8c1a9c0975998819995"
Sep 10 22:04:22.575936 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:04:22.575916    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8694aa6238543454da1dc05b50194331a2f1783f7e4f8c1a9c0975998819995\": container with ID starting with a8694aa6238543454da1dc05b50194331a2f1783f7e4f8c1a9c0975998819995 not found: ID does not exist" containerID="a8694aa6238543454da1dc05b50194331a2f1783f7e4f8c1a9c0975998819995"
Sep 10 22:04:22.576009 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:22.575944    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8694aa6238543454da1dc05b50194331a2f1783f7e4f8c1a9c0975998819995"} err="failed to get container status \"a8694aa6238543454da1dc05b50194331a2f1783f7e4f8c1a9c0975998819995\": rpc error: code = NotFound desc = could not find container \"a8694aa6238543454da1dc05b50194331a2f1783f7e4f8c1a9c0975998819995\": container with ID starting with a8694aa6238543454da1dc05b50194331a2f1783f7e4f8c1a9c0975998819995 not found: ID does not exist"
Sep 10 22:04:22.581671 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:22.581650    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cc887d74c-zkbdp"]
Sep 10 22:04:22.585645 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:22.585625    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cc887d74c-zkbdp"]
Sep 10 22:04:23.846502 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:23.846472    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1a98ea4-9bfe-4c57-98ca-c997347407a0" path="/var/lib/kubelet/pods/e1a98ea4-9bfe-4c57-98ca-c997347407a0/volumes"
Sep 10 22:04:39.498034 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.497991    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5984bc8b4d-rmzvq"]
Sep 10 22:04:39.498542 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.498312    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1a98ea4-9bfe-4c57-98ca-c997347407a0" containerName="console"
Sep 10 22:04:39.498542 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.498325    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1a98ea4-9bfe-4c57-98ca-c997347407a0" containerName="console"
Sep 10 22:04:39.498542 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.498385    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1a98ea4-9bfe-4c57-98ca-c997347407a0" containerName="console"
Sep 10 22:04:39.500344 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.500327    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:39.519878 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.519850    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5984bc8b4d-rmzvq"]
Sep 10 22:04:39.623854 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.623811    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-console-oauth-config\") pod \"console-5984bc8b4d-rmzvq\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") " pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:39.623854 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.623869    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-service-ca\") pod \"console-5984bc8b4d-rmzvq\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") " pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:39.624070 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.623886    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-oauth-serving-cert\") pod \"console-5984bc8b4d-rmzvq\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") " pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:39.624070 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.623941    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-trusted-ca-bundle\") pod \"console-5984bc8b4d-rmzvq\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") " pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:39.624070 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.623962    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-console-serving-cert\") pod \"console-5984bc8b4d-rmzvq\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") " pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:39.624070 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.623989    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-console-config\") pod \"console-5984bc8b4d-rmzvq\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") " pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:39.624070 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.624023    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdxdb\" (UniqueName: \"kubernetes.io/projected/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-kube-api-access-gdxdb\") pod \"console-5984bc8b4d-rmzvq\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") " pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:39.724389 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.724346    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-console-oauth-config\") pod \"console-5984bc8b4d-rmzvq\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") " pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:39.724389 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.724394    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-service-ca\") pod \"console-5984bc8b4d-rmzvq\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") " pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:39.724650 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.724411    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-oauth-serving-cert\") pod \"console-5984bc8b4d-rmzvq\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") " pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:39.724650 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.724446    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-trusted-ca-bundle\") pod \"console-5984bc8b4d-rmzvq\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") " pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:39.724650 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.724466    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-console-serving-cert\") pod \"console-5984bc8b4d-rmzvq\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") " pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:39.724650 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.724486    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-console-config\") pod \"console-5984bc8b4d-rmzvq\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") " pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:39.724650 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.724539    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdxdb\" (UniqueName: \"kubernetes.io/projected/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-kube-api-access-gdxdb\") pod \"console-5984bc8b4d-rmzvq\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") " pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:39.725284 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.725258    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-oauth-serving-cert\") pod \"console-5984bc8b4d-rmzvq\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") " pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:39.725375 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.725363    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-trusted-ca-bundle\") pod \"console-5984bc8b4d-rmzvq\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") " pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:39.725454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.725433    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-service-ca\") pod \"console-5984bc8b4d-rmzvq\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") " pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:39.725593 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.725571    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-console-config\") pod \"console-5984bc8b4d-rmzvq\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") " pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:39.727200 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.727179    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-console-oauth-config\") pod \"console-5984bc8b4d-rmzvq\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") " pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:39.727296 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.727265    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-console-serving-cert\") pod \"console-5984bc8b4d-rmzvq\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") " pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:39.733380 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.733355    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdxdb\" (UniqueName: \"kubernetes.io/projected/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-kube-api-access-gdxdb\") pod \"console-5984bc8b4d-rmzvq\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") " pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:39.809051 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:39.808949    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:40.083502 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:40.083425    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5984bc8b4d-rmzvq"]
Sep 10 22:04:40.086814 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:04:40.086767    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa45b0f7_0f8e_4ece_a53b_56cdce88780e.slice/crio-d3c93543c52a169ef0b04c5d869e1f0ce15c16e4a7e4ba777238bef902dd424d WatchSource:0}: Error finding container d3c93543c52a169ef0b04c5d869e1f0ce15c16e4a7e4ba777238bef902dd424d: Status 404 returned error can't find the container with id d3c93543c52a169ef0b04c5d869e1f0ce15c16e4a7e4ba777238bef902dd424d
Sep 10 22:04:40.634750 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:40.634715    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5984bc8b4d-rmzvq" event={"ID":"fa45b0f7-0f8e-4ece-a53b-56cdce88780e","Type":"ContainerStarted","Data":"8b526d27c85a59a9efbb9e46beff268dedcd9bbd153a7ac9b7c331ccb16983f1"}
Sep 10 22:04:40.635199 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:40.634766    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5984bc8b4d-rmzvq" event={"ID":"fa45b0f7-0f8e-4ece-a53b-56cdce88780e","Type":"ContainerStarted","Data":"d3c93543c52a169ef0b04c5d869e1f0ce15c16e4a7e4ba777238bef902dd424d"}
Sep 10 22:04:40.653935 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:40.653875    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5984bc8b4d-rmzvq" podStartSLOduration=1.653853799 podStartE2EDuration="1.653853799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:04:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:04:40.653295956 +0000 UTC m=+185.325393880" watchObservedRunningTime="2026-09-10 22:04:40.653853799 +0000 UTC m=+185.325951721"
Sep 10 22:04:49.810123 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:49.810065    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:49.810752 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:49.810159    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:49.816092 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:49.816065    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:50.676394 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:50.676365    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:04:50.720665 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:04:50.720636    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f9b9dfbc5-pm5p2"]
Sep 10 22:05:15.740130 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:15.740068    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f9b9dfbc5-pm5p2" podUID="95af71e6-405c-46ec-89a9-fee04b338c35" containerName="console" containerID="cri-o://ceb84771c57dd40fd552a5ef6508cf7bc06046edf16bb70ae09841ab4a8d3b8c" gracePeriod=15
Sep 10 22:05:15.982822 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:15.982796    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:05:16.133103 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.133000    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5fqm\" (UniqueName: \"kubernetes.io/projected/95af71e6-405c-46ec-89a9-fee04b338c35-kube-api-access-f5fqm\") pod \"95af71e6-405c-46ec-89a9-fee04b338c35\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") "
Sep 10 22:05:16.133103 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.133044    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95af71e6-405c-46ec-89a9-fee04b338c35-console-serving-cert\") pod \"95af71e6-405c-46ec-89a9-fee04b338c35\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") "
Sep 10 22:05:16.133103 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.133064    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-service-ca\") pod \"95af71e6-405c-46ec-89a9-fee04b338c35\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") "
Sep 10 22:05:16.133103 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.133093    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95af71e6-405c-46ec-89a9-fee04b338c35-console-oauth-config\") pod \"95af71e6-405c-46ec-89a9-fee04b338c35\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") "
Sep 10 22:05:16.133436 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.133249    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-console-config\") pod \"95af71e6-405c-46ec-89a9-fee04b338c35\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") "
Sep 10 22:05:16.133436 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.133336    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-oauth-serving-cert\") pod \"95af71e6-405c-46ec-89a9-fee04b338c35\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") "
Sep 10 22:05:16.133436 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.133413    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-trusted-ca-bundle\") pod \"95af71e6-405c-46ec-89a9-fee04b338c35\" (UID: \"95af71e6-405c-46ec-89a9-fee04b338c35\") "
Sep 10 22:05:16.133588 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.133556    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-service-ca" (OuterVolumeSpecName: "service-ca") pod "95af71e6-405c-46ec-89a9-fee04b338c35" (UID: "95af71e6-405c-46ec-89a9-fee04b338c35"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:05:16.133714 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.133689    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:05:16.133714 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.133684    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-console-config" (OuterVolumeSpecName: "console-config") pod "95af71e6-405c-46ec-89a9-fee04b338c35" (UID: "95af71e6-405c-46ec-89a9-fee04b338c35"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:05:16.134094 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.133743    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "95af71e6-405c-46ec-89a9-fee04b338c35" (UID: "95af71e6-405c-46ec-89a9-fee04b338c35"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:05:16.134094 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.133867    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "95af71e6-405c-46ec-89a9-fee04b338c35" (UID: "95af71e6-405c-46ec-89a9-fee04b338c35"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:05:16.135512 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.135476    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95af71e6-405c-46ec-89a9-fee04b338c35-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "95af71e6-405c-46ec-89a9-fee04b338c35" (UID: "95af71e6-405c-46ec-89a9-fee04b338c35"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:05:16.135512 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.135501    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95af71e6-405c-46ec-89a9-fee04b338c35-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "95af71e6-405c-46ec-89a9-fee04b338c35" (UID: "95af71e6-405c-46ec-89a9-fee04b338c35"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:05:16.135660 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.135540    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95af71e6-405c-46ec-89a9-fee04b338c35-kube-api-access-f5fqm" (OuterVolumeSpecName: "kube-api-access-f5fqm") pod "95af71e6-405c-46ec-89a9-fee04b338c35" (UID: "95af71e6-405c-46ec-89a9-fee04b338c35"). InnerVolumeSpecName "kube-api-access-f5fqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:05:16.234961 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.234924    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-oauth-serving-cert\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:05:16.234961 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.234955    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-trusted-ca-bundle\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:05:16.234961 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.234965    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5fqm\" (UniqueName: \"kubernetes.io/projected/95af71e6-405c-46ec-89a9-fee04b338c35-kube-api-access-f5fqm\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:05:16.234961 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.234974    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95af71e6-405c-46ec-89a9-fee04b338c35-console-serving-cert\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:05:16.235226 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.234982    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95af71e6-405c-46ec-89a9-fee04b338c35-console-oauth-config\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:05:16.235226 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.234991    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95af71e6-405c-46ec-89a9-fee04b338c35-console-config\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:05:16.781206 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.781172    2577 generic.go:356] "Generic (PLEG): container finished" podID="95af71e6-405c-46ec-89a9-fee04b338c35" containerID="ceb84771c57dd40fd552a5ef6508cf7bc06046edf16bb70ae09841ab4a8d3b8c" exitCode=0
Sep 10 22:05:16.781603 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.781213    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9b9dfbc5-pm5p2" event={"ID":"95af71e6-405c-46ec-89a9-fee04b338c35","Type":"ContainerDied","Data":"ceb84771c57dd40fd552a5ef6508cf7bc06046edf16bb70ae09841ab4a8d3b8c"}
Sep 10 22:05:16.781603 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.781225    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9b9dfbc5-pm5p2"
Sep 10 22:05:16.781603 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.781250    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9b9dfbc5-pm5p2" event={"ID":"95af71e6-405c-46ec-89a9-fee04b338c35","Type":"ContainerDied","Data":"6dbb8e7fd690c404dc25d0d175a8dd8c47fe4734abee9172ce3ca2a30f95d17d"}
Sep 10 22:05:16.781603 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.781271    2577 scope.go:117] "RemoveContainer" containerID="ceb84771c57dd40fd552a5ef6508cf7bc06046edf16bb70ae09841ab4a8d3b8c"
Sep 10 22:05:16.789857 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.789840    2577 scope.go:117] "RemoveContainer" containerID="ceb84771c57dd40fd552a5ef6508cf7bc06046edf16bb70ae09841ab4a8d3b8c"
Sep 10 22:05:16.790175 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:05:16.790159    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ceb84771c57dd40fd552a5ef6508cf7bc06046edf16bb70ae09841ab4a8d3b8c\": container with ID starting with ceb84771c57dd40fd552a5ef6508cf7bc06046edf16bb70ae09841ab4a8d3b8c not found: ID does not exist" containerID="ceb84771c57dd40fd552a5ef6508cf7bc06046edf16bb70ae09841ab4a8d3b8c"
Sep 10 22:05:16.790219 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.790185    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceb84771c57dd40fd552a5ef6508cf7bc06046edf16bb70ae09841ab4a8d3b8c"} err="failed to get container status \"ceb84771c57dd40fd552a5ef6508cf7bc06046edf16bb70ae09841ab4a8d3b8c\": rpc error: code = NotFound desc = could not find container \"ceb84771c57dd40fd552a5ef6508cf7bc06046edf16bb70ae09841ab4a8d3b8c\": container with ID starting with ceb84771c57dd40fd552a5ef6508cf7bc06046edf16bb70ae09841ab4a8d3b8c not found: ID does not exist"
Sep 10 22:05:16.800636 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.800603    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f9b9dfbc5-pm5p2"]
Sep 10 22:05:16.802997 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:16.802966    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f9b9dfbc5-pm5p2"]
Sep 10 22:05:17.846254 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:05:17.846213    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95af71e6-405c-46ec-89a9-fee04b338c35" path="/var/lib/kubelet/pods/95af71e6-405c-46ec-89a9-fee04b338c35/volumes"
Sep 10 22:06:05.298942 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.298859    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c6cc445cd-88zxc"]
Sep 10 22:06:05.299330 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.299168    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95af71e6-405c-46ec-89a9-fee04b338c35" containerName="console"
Sep 10 22:06:05.299330 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.299181    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="95af71e6-405c-46ec-89a9-fee04b338c35" containerName="console"
Sep 10 22:06:05.299330 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.299234    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="95af71e6-405c-46ec-89a9-fee04b338c35" containerName="console"
Sep 10 22:06:05.300866 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.300840    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.319291 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.319264    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c6cc445cd-88zxc"]
Sep 10 22:06:05.398022 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.397985    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-console-oauth-config\") pod \"console-7c6cc445cd-88zxc\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") " pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.398022 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.398029    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdjmz\" (UniqueName: \"kubernetes.io/projected/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-kube-api-access-bdjmz\") pod \"console-7c6cc445cd-88zxc\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") " pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.398274 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.398057    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-service-ca\") pod \"console-7c6cc445cd-88zxc\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") " pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.398274 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.398110    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-oauth-serving-cert\") pod \"console-7c6cc445cd-88zxc\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") " pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.398274 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.398135    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-console-config\") pod \"console-7c6cc445cd-88zxc\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") " pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.398274 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.398193    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-console-serving-cert\") pod \"console-7c6cc445cd-88zxc\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") " pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.398274 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.398219    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-trusted-ca-bundle\") pod \"console-7c6cc445cd-88zxc\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") " pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.498972 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.498936    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-trusted-ca-bundle\") pod \"console-7c6cc445cd-88zxc\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") " pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.499161 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.498992    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-console-oauth-config\") pod \"console-7c6cc445cd-88zxc\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") " pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.499161 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.499026    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdjmz\" (UniqueName: \"kubernetes.io/projected/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-kube-api-access-bdjmz\") pod \"console-7c6cc445cd-88zxc\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") " pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.499161 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.499050    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-service-ca\") pod \"console-7c6cc445cd-88zxc\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") " pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.499161 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.499082    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-oauth-serving-cert\") pod \"console-7c6cc445cd-88zxc\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") " pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.499161 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.499124    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-console-config\") pod \"console-7c6cc445cd-88zxc\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") " pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.499388 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.499168    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-console-serving-cert\") pod \"console-7c6cc445cd-88zxc\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") " pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.499962 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.499925    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-oauth-serving-cert\") pod \"console-7c6cc445cd-88zxc\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") " pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.499962 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.499945    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-service-ca\") pod \"console-7c6cc445cd-88zxc\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") " pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.500123 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.500017    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-console-config\") pod \"console-7c6cc445cd-88zxc\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") " pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.500369 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.500346    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-trusted-ca-bundle\") pod \"console-7c6cc445cd-88zxc\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") " pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.501747 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.501729    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-console-serving-cert\") pod \"console-7c6cc445cd-88zxc\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") " pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.501849 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.501825    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-console-oauth-config\") pod \"console-7c6cc445cd-88zxc\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") " pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.512423 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.512401    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdjmz\" (UniqueName: \"kubernetes.io/projected/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-kube-api-access-bdjmz\") pod \"console-7c6cc445cd-88zxc\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") " pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.610117 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.610034    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:05.886287 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.886250    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c6cc445cd-88zxc"]
Sep 10 22:06:05.889880 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:06:05.889849    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9decd3d_d8c2_4b0f_bfe0_4d84f90b753e.slice/crio-8d710db9dcd3f45564cd50b1defb84f1d2d9ad3bbb3ad36b9b515a5f978c7767 WatchSource:0}: Error finding container 8d710db9dcd3f45564cd50b1defb84f1d2d9ad3bbb3ad36b9b515a5f978c7767: Status 404 returned error can't find the container with id 8d710db9dcd3f45564cd50b1defb84f1d2d9ad3bbb3ad36b9b515a5f978c7767
Sep 10 22:06:05.957946 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.957909    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6cc445cd-88zxc" event={"ID":"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e","Type":"ContainerStarted","Data":"f7813af3446d4e32aa356f8ffa0a8d7f1cf77601d021a14344d48db9fd2b485d"}
Sep 10 22:06:05.958068 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.957961    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6cc445cd-88zxc" event={"ID":"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e","Type":"ContainerStarted","Data":"8d710db9dcd3f45564cd50b1defb84f1d2d9ad3bbb3ad36b9b515a5f978c7767"}
Sep 10 22:06:05.982752 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:05.982695    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c6cc445cd-88zxc" podStartSLOduration=0.982675943 podStartE2EDuration="982.675943ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:06:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:06:05.980152061 +0000 UTC m=+270.652250003" watchObservedRunningTime="2026-09-10 22:06:05.982675943 +0000 UTC m=+270.654773864"
Sep 10 22:06:15.610858 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:15.610816    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:15.611321 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:15.610878    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:15.615632 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:15.615608    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:15.999285 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:15.999257    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:06:16.046853 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:16.046821    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5984bc8b4d-rmzvq"]
Sep 10 22:06:35.719309 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:35.719285    2577 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 22:06:41.067464 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.067393    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5984bc8b4d-rmzvq" podUID="fa45b0f7-0f8e-4ece-a53b-56cdce88780e" containerName="console" containerID="cri-o://8b526d27c85a59a9efbb9e46beff268dedcd9bbd153a7ac9b7c331ccb16983f1" gracePeriod=15
Sep 10 22:06:41.306583 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.306561    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:06:41.390617 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.390588    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-console-oauth-config\") pod \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") "
Sep 10 22:06:41.390833 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.390626    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-console-serving-cert\") pod \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") "
Sep 10 22:06:41.390833 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.390656    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-oauth-serving-cert\") pod \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") "
Sep 10 22:06:41.390833 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.390677    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdxdb\" (UniqueName: \"kubernetes.io/projected/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-kube-api-access-gdxdb\") pod \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") "
Sep 10 22:06:41.390833 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.390740    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-trusted-ca-bundle\") pod \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") "
Sep 10 22:06:41.390833 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.390802    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-console-config\") pod \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") "
Sep 10 22:06:41.391086 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.390855    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-service-ca\") pod \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\" (UID: \"fa45b0f7-0f8e-4ece-a53b-56cdce88780e\") "
Sep 10 22:06:41.391158 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.391126    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fa45b0f7-0f8e-4ece-a53b-56cdce88780e" (UID: "fa45b0f7-0f8e-4ece-a53b-56cdce88780e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:06:41.391220 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.391191    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-console-config" (OuterVolumeSpecName: "console-config") pod "fa45b0f7-0f8e-4ece-a53b-56cdce88780e" (UID: "fa45b0f7-0f8e-4ece-a53b-56cdce88780e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:06:41.391341 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.391257    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fa45b0f7-0f8e-4ece-a53b-56cdce88780e" (UID: "fa45b0f7-0f8e-4ece-a53b-56cdce88780e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:06:41.391398 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.391358    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-service-ca" (OuterVolumeSpecName: "service-ca") pod "fa45b0f7-0f8e-4ece-a53b-56cdce88780e" (UID: "fa45b0f7-0f8e-4ece-a53b-56cdce88780e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:06:41.393034 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.393004    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fa45b0f7-0f8e-4ece-a53b-56cdce88780e" (UID: "fa45b0f7-0f8e-4ece-a53b-56cdce88780e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:06:41.393134 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.393040    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fa45b0f7-0f8e-4ece-a53b-56cdce88780e" (UID: "fa45b0f7-0f8e-4ece-a53b-56cdce88780e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:06:41.393134 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.393084    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-kube-api-access-gdxdb" (OuterVolumeSpecName: "kube-api-access-gdxdb") pod "fa45b0f7-0f8e-4ece-a53b-56cdce88780e" (UID: "fa45b0f7-0f8e-4ece-a53b-56cdce88780e"). InnerVolumeSpecName "kube-api-access-gdxdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:06:41.491422 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.491384    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:06:41.491422 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.491415    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-console-oauth-config\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:06:41.491422 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.491424    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-console-serving-cert\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:06:41.491631 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.491433    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-oauth-serving-cert\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:06:41.491631 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.491442    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdxdb\" (UniqueName: \"kubernetes.io/projected/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-kube-api-access-gdxdb\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:06:41.491631 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.491451    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-trusted-ca-bundle\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:06:41.491631 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:41.491461    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa45b0f7-0f8e-4ece-a53b-56cdce88780e-console-config\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:06:42.089821 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:42.089761    2577 generic.go:356] "Generic (PLEG): container finished" podID="fa45b0f7-0f8e-4ece-a53b-56cdce88780e" containerID="8b526d27c85a59a9efbb9e46beff268dedcd9bbd153a7ac9b7c331ccb16983f1" exitCode=0
Sep 10 22:06:42.090289 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:42.089832    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5984bc8b4d-rmzvq"
Sep 10 22:06:42.090289 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:42.089839    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5984bc8b4d-rmzvq" event={"ID":"fa45b0f7-0f8e-4ece-a53b-56cdce88780e","Type":"ContainerDied","Data":"8b526d27c85a59a9efbb9e46beff268dedcd9bbd153a7ac9b7c331ccb16983f1"}
Sep 10 22:06:42.090289 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:42.089882    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5984bc8b4d-rmzvq" event={"ID":"fa45b0f7-0f8e-4ece-a53b-56cdce88780e","Type":"ContainerDied","Data":"d3c93543c52a169ef0b04c5d869e1f0ce15c16e4a7e4ba777238bef902dd424d"}
Sep 10 22:06:42.090289 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:42.089902    2577 scope.go:117] "RemoveContainer" containerID="8b526d27c85a59a9efbb9e46beff268dedcd9bbd153a7ac9b7c331ccb16983f1"
Sep 10 22:06:42.098159 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:42.098141    2577 scope.go:117] "RemoveContainer" containerID="8b526d27c85a59a9efbb9e46beff268dedcd9bbd153a7ac9b7c331ccb16983f1"
Sep 10 22:06:42.098399 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:06:42.098377    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b526d27c85a59a9efbb9e46beff268dedcd9bbd153a7ac9b7c331ccb16983f1\": container with ID starting with 8b526d27c85a59a9efbb9e46beff268dedcd9bbd153a7ac9b7c331ccb16983f1 not found: ID does not exist" containerID="8b526d27c85a59a9efbb9e46beff268dedcd9bbd153a7ac9b7c331ccb16983f1"
Sep 10 22:06:42.098462 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:42.098407    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b526d27c85a59a9efbb9e46beff268dedcd9bbd153a7ac9b7c331ccb16983f1"} err="failed to get container status \"8b526d27c85a59a9efbb9e46beff268dedcd9bbd153a7ac9b7c331ccb16983f1\": rpc error: code = NotFound desc = could not find container \"8b526d27c85a59a9efbb9e46beff268dedcd9bbd153a7ac9b7c331ccb16983f1\": container with ID starting with 8b526d27c85a59a9efbb9e46beff268dedcd9bbd153a7ac9b7c331ccb16983f1 not found: ID does not exist"
Sep 10 22:06:42.117539 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:42.117480    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5984bc8b4d-rmzvq"]
Sep 10 22:06:42.125063 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:42.125044    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5984bc8b4d-rmzvq"]
Sep 10 22:06:43.846440 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:43.846403    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa45b0f7-0f8e-4ece-a53b-56cdce88780e" path="/var/lib/kubelet/pods/fa45b0f7-0f8e-4ece-a53b-56cdce88780e/volumes"
Sep 10 22:06:44.141954 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:44.141913    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9"]
Sep 10 22:06:44.142292 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:44.142275    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa45b0f7-0f8e-4ece-a53b-56cdce88780e" containerName="console"
Sep 10 22:06:44.142367 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:44.142294    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa45b0f7-0f8e-4ece-a53b-56cdce88780e" containerName="console"
Sep 10 22:06:44.142423 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:44.142366    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa45b0f7-0f8e-4ece-a53b-56cdce88780e" containerName="console"
Sep 10 22:06:44.144956 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:44.144934    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9"
Sep 10 22:06:44.147147 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:44.147113    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 22:06:44.147147 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:44.147141    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 22:06:44.147617 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:44.147598    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bb482\""
Sep 10 22:06:44.155915 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:44.155894    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9"]
Sep 10 22:06:44.206665 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:44.206614    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82cc68d4-7d7b-44af-9a30-eed9bdaca3d9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9\" (UID: \"82cc68d4-7d7b-44af-9a30-eed9bdaca3d9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9"
Sep 10 22:06:44.206880 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:44.206691    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkq68\" (UniqueName: \"kubernetes.io/projected/82cc68d4-7d7b-44af-9a30-eed9bdaca3d9-kube-api-access-mkq68\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9\" (UID: \"82cc68d4-7d7b-44af-9a30-eed9bdaca3d9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9"
Sep 10 22:06:44.206880 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:44.206725    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82cc68d4-7d7b-44af-9a30-eed9bdaca3d9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9\" (UID: \"82cc68d4-7d7b-44af-9a30-eed9bdaca3d9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9"
Sep 10 22:06:44.307459 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:44.307400    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkq68\" (UniqueName: \"kubernetes.io/projected/82cc68d4-7d7b-44af-9a30-eed9bdaca3d9-kube-api-access-mkq68\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9\" (UID: \"82cc68d4-7d7b-44af-9a30-eed9bdaca3d9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9"
Sep 10 22:06:44.307459 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:44.307472    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82cc68d4-7d7b-44af-9a30-eed9bdaca3d9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9\" (UID: \"82cc68d4-7d7b-44af-9a30-eed9bdaca3d9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9"
Sep 10 22:06:44.307747 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:44.307509    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82cc68d4-7d7b-44af-9a30-eed9bdaca3d9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9\" (UID: \"82cc68d4-7d7b-44af-9a30-eed9bdaca3d9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9"
Sep 10 22:06:44.307881 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:44.307865    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82cc68d4-7d7b-44af-9a30-eed9bdaca3d9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9\" (UID: \"82cc68d4-7d7b-44af-9a30-eed9bdaca3d9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9"
Sep 10 22:06:44.307917 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:44.307897    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82cc68d4-7d7b-44af-9a30-eed9bdaca3d9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9\" (UID: \"82cc68d4-7d7b-44af-9a30-eed9bdaca3d9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9"
Sep 10 22:06:44.315491 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:44.315458    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkq68\" (UniqueName: \"kubernetes.io/projected/82cc68d4-7d7b-44af-9a30-eed9bdaca3d9-kube-api-access-mkq68\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9\" (UID: \"82cc68d4-7d7b-44af-9a30-eed9bdaca3d9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9"
Sep 10 22:06:44.454360 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:44.454269    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9"
Sep 10 22:06:44.728570 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:44.728440    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9"]
Sep 10 22:06:44.731320 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:06:44.731292    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82cc68d4_7d7b_44af_9a30_eed9bdaca3d9.slice/crio-f8fb51c2a098fdb24340a964a13a07bf0900f13542e5ab0c8a07e28173c6d537 WatchSource:0}: Error finding container f8fb51c2a098fdb24340a964a13a07bf0900f13542e5ab0c8a07e28173c6d537: Status 404 returned error can't find the container with id f8fb51c2a098fdb24340a964a13a07bf0900f13542e5ab0c8a07e28173c6d537
Sep 10 22:06:44.733168 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:44.733153    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 22:06:45.103867 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:45.103767    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9" event={"ID":"82cc68d4-7d7b-44af-9a30-eed9bdaca3d9","Type":"ContainerStarted","Data":"f8fb51c2a098fdb24340a964a13a07bf0900f13542e5ab0c8a07e28173c6d537"}
Sep 10 22:06:51.132039 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:51.131949    2577 generic.go:356] "Generic (PLEG): container finished" podID="82cc68d4-7d7b-44af-9a30-eed9bdaca3d9" containerID="67a18ecfdda755585e3de025538b25b9bc396c7337896f8259192d2ccb9ca112" exitCode=0
Sep 10 22:06:51.132380 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:51.132031    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9" event={"ID":"82cc68d4-7d7b-44af-9a30-eed9bdaca3d9","Type":"ContainerDied","Data":"67a18ecfdda755585e3de025538b25b9bc396c7337896f8259192d2ccb9ca112"}
Sep 10 22:06:54.146612 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:54.146575    2577 generic.go:356] "Generic (PLEG): container finished" podID="82cc68d4-7d7b-44af-9a30-eed9bdaca3d9" containerID="7ae9c802ee5b4ce19237e2ee9b98fcfca1d4bd6cf9a559d1e35673a829f7e959" exitCode=0
Sep 10 22:06:54.147006 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:06:54.146652    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9" event={"ID":"82cc68d4-7d7b-44af-9a30-eed9bdaca3d9","Type":"ContainerDied","Data":"7ae9c802ee5b4ce19237e2ee9b98fcfca1d4bd6cf9a559d1e35673a829f7e959"}
Sep 10 22:07:01.179540 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:01.179504    2577 generic.go:356] "Generic (PLEG): container finished" podID="82cc68d4-7d7b-44af-9a30-eed9bdaca3d9" containerID="0dc606e725172e04c85fe22e2a24b00f8e1cfb49c54743f8c9b79644ee739f51" exitCode=0
Sep 10 22:07:01.180002 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:01.179593    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9" event={"ID":"82cc68d4-7d7b-44af-9a30-eed9bdaca3d9","Type":"ContainerDied","Data":"0dc606e725172e04c85fe22e2a24b00f8e1cfb49c54743f8c9b79644ee739f51"}
Sep 10 22:07:02.309264 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:02.309237    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9"
Sep 10 22:07:02.363716 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:02.363677    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82cc68d4-7d7b-44af-9a30-eed9bdaca3d9-bundle\") pod \"82cc68d4-7d7b-44af-9a30-eed9bdaca3d9\" (UID: \"82cc68d4-7d7b-44af-9a30-eed9bdaca3d9\") "
Sep 10 22:07:02.363716 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:02.363726    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82cc68d4-7d7b-44af-9a30-eed9bdaca3d9-util\") pod \"82cc68d4-7d7b-44af-9a30-eed9bdaca3d9\" (UID: \"82cc68d4-7d7b-44af-9a30-eed9bdaca3d9\") "
Sep 10 22:07:02.363974 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:02.363760    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkq68\" (UniqueName: \"kubernetes.io/projected/82cc68d4-7d7b-44af-9a30-eed9bdaca3d9-kube-api-access-mkq68\") pod \"82cc68d4-7d7b-44af-9a30-eed9bdaca3d9\" (UID: \"82cc68d4-7d7b-44af-9a30-eed9bdaca3d9\") "
Sep 10 22:07:02.364588 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:02.364557    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82cc68d4-7d7b-44af-9a30-eed9bdaca3d9-bundle" (OuterVolumeSpecName: "bundle") pod "82cc68d4-7d7b-44af-9a30-eed9bdaca3d9" (UID: "82cc68d4-7d7b-44af-9a30-eed9bdaca3d9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:07:02.366205 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:02.366182    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82cc68d4-7d7b-44af-9a30-eed9bdaca3d9-kube-api-access-mkq68" (OuterVolumeSpecName: "kube-api-access-mkq68") pod "82cc68d4-7d7b-44af-9a30-eed9bdaca3d9" (UID: "82cc68d4-7d7b-44af-9a30-eed9bdaca3d9"). InnerVolumeSpecName "kube-api-access-mkq68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:07:02.368132 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:02.368113    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82cc68d4-7d7b-44af-9a30-eed9bdaca3d9-util" (OuterVolumeSpecName: "util") pod "82cc68d4-7d7b-44af-9a30-eed9bdaca3d9" (UID: "82cc68d4-7d7b-44af-9a30-eed9bdaca3d9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:07:02.465107 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:02.465020    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82cc68d4-7d7b-44af-9a30-eed9bdaca3d9-bundle\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:07:02.465107 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:02.465049    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82cc68d4-7d7b-44af-9a30-eed9bdaca3d9-util\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:07:02.465107 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:02.465059    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkq68\" (UniqueName: \"kubernetes.io/projected/82cc68d4-7d7b-44af-9a30-eed9bdaca3d9-kube-api-access-mkq68\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:07:03.188132 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:03.188098    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9" event={"ID":"82cc68d4-7d7b-44af-9a30-eed9bdaca3d9","Type":"ContainerDied","Data":"f8fb51c2a098fdb24340a964a13a07bf0900f13542e5ab0c8a07e28173c6d537"}
Sep 10 22:07:03.188132 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:03.188130    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zckk9"
Sep 10 22:07:03.188330 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:03.188145    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8fb51c2a098fdb24340a964a13a07bf0900f13542e5ab0c8a07e28173c6d537"
Sep 10 22:07:07.140605 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:07.140564    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4g92j"]
Sep 10 22:07:07.141059 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:07.140880    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82cc68d4-7d7b-44af-9a30-eed9bdaca3d9" containerName="util"
Sep 10 22:07:07.141059 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:07.140892    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="82cc68d4-7d7b-44af-9a30-eed9bdaca3d9" containerName="util"
Sep 10 22:07:07.141059 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:07.140901    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82cc68d4-7d7b-44af-9a30-eed9bdaca3d9" containerName="pull"
Sep 10 22:07:07.141059 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:07.140907    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="82cc68d4-7d7b-44af-9a30-eed9bdaca3d9" containerName="pull"
Sep 10 22:07:07.141059 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:07.140922    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82cc68d4-7d7b-44af-9a30-eed9bdaca3d9" containerName="extract"
Sep 10 22:07:07.141059 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:07.140928    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="82cc68d4-7d7b-44af-9a30-eed9bdaca3d9" containerName="extract"
Sep 10 22:07:07.141059 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:07.140983    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="82cc68d4-7d7b-44af-9a30-eed9bdaca3d9" containerName="extract"
Sep 10 22:07:07.144024 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:07.144009    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4g92j"
Sep 10 22:07:07.146355 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:07.146325    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-cgqt6\""
Sep 10 22:07:07.146355 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:07.146342    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 10 22:07:07.146483 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:07.146342    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 10 22:07:07.158350 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:07.158320    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4g92j"]
Sep 10 22:07:07.205851 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:07.205821    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b622602b-341d-49c2-81e5-8e1f6d62f40e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4g92j\" (UID: \"b622602b-341d-49c2-81e5-8e1f6d62f40e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4g92j"
Sep 10 22:07:07.206025 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:07.205884    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j77j\" (UniqueName: \"kubernetes.io/projected/b622602b-341d-49c2-81e5-8e1f6d62f40e-kube-api-access-5j77j\") pod \"cert-manager-operator-controller-manager-55c444bf86-4g92j\" (UID: \"b622602b-341d-49c2-81e5-8e1f6d62f40e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4g92j"
Sep 10 22:07:07.306656 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:07.306605    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b622602b-341d-49c2-81e5-8e1f6d62f40e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4g92j\" (UID: \"b622602b-341d-49c2-81e5-8e1f6d62f40e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4g92j"
Sep 10 22:07:07.306835 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:07.306710    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j77j\" (UniqueName: \"kubernetes.io/projected/b622602b-341d-49c2-81e5-8e1f6d62f40e-kube-api-access-5j77j\") pod \"cert-manager-operator-controller-manager-55c444bf86-4g92j\" (UID: \"b622602b-341d-49c2-81e5-8e1f6d62f40e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4g92j"
Sep 10 22:07:07.307104 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:07.307084    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b622602b-341d-49c2-81e5-8e1f6d62f40e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4g92j\" (UID: \"b622602b-341d-49c2-81e5-8e1f6d62f40e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4g92j"
Sep 10 22:07:07.315946 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:07.315910    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j77j\" (UniqueName: \"kubernetes.io/projected/b622602b-341d-49c2-81e5-8e1f6d62f40e-kube-api-access-5j77j\") pod \"cert-manager-operator-controller-manager-55c444bf86-4g92j\" (UID: \"b622602b-341d-49c2-81e5-8e1f6d62f40e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4g92j"
Sep 10 22:07:07.453707 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:07.453619    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4g92j"
Sep 10 22:07:07.731285 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:07.731208    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4g92j"]
Sep 10 22:07:07.734567 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:07:07.734537    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb622602b_341d_49c2_81e5_8e1f6d62f40e.slice/crio-3bdc603a75c27be271bd9e133a2c7df8852c244d99c4777f53142d832b71048e WatchSource:0}: Error finding container 3bdc603a75c27be271bd9e133a2c7df8852c244d99c4777f53142d832b71048e: Status 404 returned error can't find the container with id 3bdc603a75c27be271bd9e133a2c7df8852c244d99c4777f53142d832b71048e
Sep 10 22:07:08.209287 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:08.209254    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4g92j" event={"ID":"b622602b-341d-49c2-81e5-8e1f6d62f40e","Type":"ContainerStarted","Data":"3bdc603a75c27be271bd9e133a2c7df8852c244d99c4777f53142d832b71048e"}
Sep 10 22:07:10.220304 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:10.220269    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4g92j" event={"ID":"b622602b-341d-49c2-81e5-8e1f6d62f40e","Type":"ContainerStarted","Data":"4780c79be2c520eaf31225d3758cccd26297186a11d05b2bc3889560e9bde93f"}
Sep 10 22:07:10.242243 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:10.242190    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4g92j" podStartSLOduration=1.656060434 podStartE2EDuration="3.242172177s" totalImagesPullingTime="1.586111743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:07:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:07:10.240386902 +0000 UTC m=+334.912484815" watchObservedRunningTime="2026-09-10 22:07:10.242172177 +0000 UTC m=+334.914270098"
Sep 10 22:07:10.874699 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:10.874665    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh"]
Sep 10 22:07:10.876945 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:10.876928    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh"
Sep 10 22:07:10.879955 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:10.879933    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 22:07:10.880165 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:10.880151    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bb482\""
Sep 10 22:07:10.880407 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:10.880391    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 22:07:10.893933 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:10.893912    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh"]
Sep 10 22:07:10.936317 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:10.936291    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ndhk\" (UniqueName: \"kubernetes.io/projected/d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036-kube-api-access-8ndhk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh\" (UID: \"d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh"
Sep 10 22:07:10.936463 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:10.936336    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh\" (UID: \"d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh"
Sep 10 22:07:10.936463 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:10.936391    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh\" (UID: \"d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh"
Sep 10 22:07:11.037481 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:11.037428    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ndhk\" (UniqueName: \"kubernetes.io/projected/d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036-kube-api-access-8ndhk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh\" (UID: \"d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh"
Sep 10 22:07:11.037481 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:11.037495    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh\" (UID: \"d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh"
Sep 10 22:07:11.037703 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:11.037529    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh\" (UID: \"d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh"
Sep 10 22:07:11.037953 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:11.037937    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh\" (UID: \"d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh"
Sep 10 22:07:11.038001 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:11.037938    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh\" (UID: \"d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh"
Sep 10 22:07:11.061481 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:11.061449    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ndhk\" (UniqueName: \"kubernetes.io/projected/d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036-kube-api-access-8ndhk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh\" (UID: \"d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh"
Sep 10 22:07:11.185392 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:11.185359    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh"
Sep 10 22:07:11.360842 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:11.360806    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rsxtb"]
Sep 10 22:07:11.362999 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:11.362982    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rsxtb"
Sep 10 22:07:11.365105 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:11.365084    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 22:07:11.365206 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:11.365190    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 22:07:11.377124 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:11.377096    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rsxtb"]
Sep 10 22:07:11.440647 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:11.440566    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq6gb\" (UniqueName: \"kubernetes.io/projected/23d3dec0-190d-48a7-aa66-173500328b08-kube-api-access-fq6gb\") pod \"cert-manager-webhook-6486ffd997-rsxtb\" (UID: \"23d3dec0-190d-48a7-aa66-173500328b08\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rsxtb"
Sep 10 22:07:11.440647 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:11.440607    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23d3dec0-190d-48a7-aa66-173500328b08-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rsxtb\" (UID: \"23d3dec0-190d-48a7-aa66-173500328b08\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rsxtb"
Sep 10 22:07:11.458527 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:11.458350    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh"]
Sep 10 22:07:11.461092 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:07:11.461068    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9cb2b54_ab14_4f76_a4a1_7aa9ffd78036.slice/crio-f5fb1777e12f4f2811a54f24533e88abe8330f928f395ccc0140c5dac1dd7451 WatchSource:0}: Error finding container f5fb1777e12f4f2811a54f24533e88abe8330f928f395ccc0140c5dac1dd7451: Status 404 returned error can't find the container with id f5fb1777e12f4f2811a54f24533e88abe8330f928f395ccc0140c5dac1dd7451
Sep 10 22:07:11.541169 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:11.541142    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq6gb\" (UniqueName: \"kubernetes.io/projected/23d3dec0-190d-48a7-aa66-173500328b08-kube-api-access-fq6gb\") pod \"cert-manager-webhook-6486ffd997-rsxtb\" (UID: \"23d3dec0-190d-48a7-aa66-173500328b08\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rsxtb"
Sep 10 22:07:11.541312 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:11.541179    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23d3dec0-190d-48a7-aa66-173500328b08-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rsxtb\" (UID: \"23d3dec0-190d-48a7-aa66-173500328b08\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rsxtb"
Sep 10 22:07:11.549678 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:11.549653    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23d3dec0-190d-48a7-aa66-173500328b08-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rsxtb\" (UID: \"23d3dec0-190d-48a7-aa66-173500328b08\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rsxtb"
Sep 10 22:07:11.549838 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:11.549820    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq6gb\" (UniqueName: \"kubernetes.io/projected/23d3dec0-190d-48a7-aa66-173500328b08-kube-api-access-fq6gb\") pod \"cert-manager-webhook-6486ffd997-rsxtb\" (UID: \"23d3dec0-190d-48a7-aa66-173500328b08\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rsxtb"
Sep 10 22:07:11.672367 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:11.672331    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rsxtb"
Sep 10 22:07:11.942392 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:11.942278    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rsxtb"]
Sep 10 22:07:11.945009 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:07:11.944987    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23d3dec0_190d_48a7_aa66_173500328b08.slice/crio-267f0ae957492621bb2a8ace330fd1908f6451b1cdb4950f0d8bc370134ab912 WatchSource:0}: Error finding container 267f0ae957492621bb2a8ace330fd1908f6451b1cdb4950f0d8bc370134ab912: Status 404 returned error can't find the container with id 267f0ae957492621bb2a8ace330fd1908f6451b1cdb4950f0d8bc370134ab912
Sep 10 22:07:12.231277 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:12.231243    2577 generic.go:356] "Generic (PLEG): container finished" podID="d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036" containerID="41fb32df93ebfd0fa3f6d8484bf0a8b7e27bc159e86ea57a2554d4bdecbc19a3" exitCode=0
Sep 10 22:07:12.231478 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:12.231341    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh" event={"ID":"d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036","Type":"ContainerDied","Data":"41fb32df93ebfd0fa3f6d8484bf0a8b7e27bc159e86ea57a2554d4bdecbc19a3"}
Sep 10 22:07:12.231478 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:12.231392    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh" event={"ID":"d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036","Type":"ContainerStarted","Data":"f5fb1777e12f4f2811a54f24533e88abe8330f928f395ccc0140c5dac1dd7451"}
Sep 10 22:07:12.232609 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:12.232589    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rsxtb" event={"ID":"23d3dec0-190d-48a7-aa66-173500328b08","Type":"ContainerStarted","Data":"267f0ae957492621bb2a8ace330fd1908f6451b1cdb4950f0d8bc370134ab912"}
Sep 10 22:07:15.249606 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:15.249566    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh" event={"ID":"d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036","Type":"ContainerStarted","Data":"a78bea7f19077cadb212ee5fb75363c38648772ca7d32a268ca16e3252d3e202"}
Sep 10 22:07:15.251384 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:15.251354    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rsxtb" event={"ID":"23d3dec0-190d-48a7-aa66-173500328b08","Type":"ContainerStarted","Data":"eea060de676736ee93df65ba36e23e22374a8a7b4049fc24b8e282bf0cbb4a44"}
Sep 10 22:07:15.251537 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:15.251422    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rsxtb"
Sep 10 22:07:15.280485 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:15.280434    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-rsxtb" podStartSLOduration=1.106103962 podStartE2EDuration="4.280417802s" totalImagesPullingTime="3.17431384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:07:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:07:15.279463405 +0000 UTC m=+339.951561329" watchObservedRunningTime="2026-09-10 22:07:15.280417802 +0000 UTC m=+339.952515723"
Sep 10 22:07:16.257167 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:16.257129    2577 generic.go:356] "Generic (PLEG): container finished" podID="d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036" containerID="a78bea7f19077cadb212ee5fb75363c38648772ca7d32a268ca16e3252d3e202" exitCode=0
Sep 10 22:07:16.257551 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:16.257203    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh" event={"ID":"d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036","Type":"ContainerDied","Data":"a78bea7f19077cadb212ee5fb75363c38648772ca7d32a268ca16e3252d3e202"}
Sep 10 22:07:17.263683 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:17.263650    2577 generic.go:356] "Generic (PLEG): container finished" podID="d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036" containerID="c2288f0b2aae829cb2960c7d64e9283868210c276c8ba3550700b0ba8127e9aa" exitCode=0
Sep 10 22:07:17.264115 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:17.263711    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh" event={"ID":"d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036","Type":"ContainerDied","Data":"c2288f0b2aae829cb2960c7d64e9283868210c276c8ba3550700b0ba8127e9aa"}
Sep 10 22:07:18.390741 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:18.390712    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh"
Sep 10 22:07:18.502442 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:18.502406    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036-bundle\") pod \"d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036\" (UID: \"d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036\") "
Sep 10 22:07:18.502629 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:18.502465    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ndhk\" (UniqueName: \"kubernetes.io/projected/d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036-kube-api-access-8ndhk\") pod \"d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036\" (UID: \"d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036\") "
Sep 10 22:07:18.502629 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:18.502552    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036-util\") pod \"d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036\" (UID: \"d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036\") "
Sep 10 22:07:18.502920 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:18.502895    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036-bundle" (OuterVolumeSpecName: "bundle") pod "d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036" (UID: "d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:07:18.504850 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:18.504820    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036-kube-api-access-8ndhk" (OuterVolumeSpecName: "kube-api-access-8ndhk") pod "d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036" (UID: "d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036"). InnerVolumeSpecName "kube-api-access-8ndhk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:07:18.506959 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:18.506924    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036-util" (OuterVolumeSpecName: "util") pod "d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036" (UID: "d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:07:18.603338 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:18.603256    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036-util\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:07:18.603338 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:18.603284    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036-bundle\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:07:18.603338 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:18.603295    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ndhk\" (UniqueName: \"kubernetes.io/projected/d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036-kube-api-access-8ndhk\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:07:19.273499 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:19.273458    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh" event={"ID":"d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036","Type":"ContainerDied","Data":"f5fb1777e12f4f2811a54f24533e88abe8330f928f395ccc0140c5dac1dd7451"}
Sep 10 22:07:19.273499 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:19.273507    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5fb1777e12f4f2811a54f24533e88abe8330f928f395ccc0140c5dac1dd7451"
Sep 10 22:07:19.273701 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:19.273473    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdbwlh"
Sep 10 22:07:21.259343 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:21.259314    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rsxtb"
Sep 10 22:07:24.000702 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:24.000666    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m2xlz"]
Sep 10 22:07:24.001091 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:24.000961    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036" containerName="util"
Sep 10 22:07:24.001091 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:24.000973    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036" containerName="util"
Sep 10 22:07:24.001091 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:24.000985    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036" containerName="pull"
Sep 10 22:07:24.001091 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:24.000990    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036" containerName="pull"
Sep 10 22:07:24.001091 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:24.001003    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036" containerName="extract"
Sep 10 22:07:24.001091 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:24.001008    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036" containerName="extract"
Sep 10 22:07:24.001091 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:24.001059    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9cb2b54-ab14-4f76-a4a1-7aa9ffd78036" containerName="extract"
Sep 10 22:07:24.002936 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:24.002920    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-m2xlz"
Sep 10 22:07:24.005124 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:24.005107    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-l7zfb\""
Sep 10 22:07:24.012714 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:24.012693    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m2xlz"]
Sep 10 22:07:24.150678 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:24.150644    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlnl7\" (UniqueName: \"kubernetes.io/projected/7760e2f6-5ba3-4e3d-854d-32ffeac123bc-kube-api-access-rlnl7\") pod \"cert-manager-55b4d954d5-m2xlz\" (UID: \"7760e2f6-5ba3-4e3d-854d-32ffeac123bc\") " pod="cert-manager/cert-manager-55b4d954d5-m2xlz"
Sep 10 22:07:24.150678 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:24.150683    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7760e2f6-5ba3-4e3d-854d-32ffeac123bc-bound-sa-token\") pod \"cert-manager-55b4d954d5-m2xlz\" (UID: \"7760e2f6-5ba3-4e3d-854d-32ffeac123bc\") " pod="cert-manager/cert-manager-55b4d954d5-m2xlz"
Sep 10 22:07:24.251470 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:24.251374    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlnl7\" (UniqueName: \"kubernetes.io/projected/7760e2f6-5ba3-4e3d-854d-32ffeac123bc-kube-api-access-rlnl7\") pod \"cert-manager-55b4d954d5-m2xlz\" (UID: \"7760e2f6-5ba3-4e3d-854d-32ffeac123bc\") " pod="cert-manager/cert-manager-55b4d954d5-m2xlz"
Sep 10 22:07:24.251470 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:24.251427    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7760e2f6-5ba3-4e3d-854d-32ffeac123bc-bound-sa-token\") pod \"cert-manager-55b4d954d5-m2xlz\" (UID: \"7760e2f6-5ba3-4e3d-854d-32ffeac123bc\") " pod="cert-manager/cert-manager-55b4d954d5-m2xlz"
Sep 10 22:07:24.260957 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:24.260927    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7760e2f6-5ba3-4e3d-854d-32ffeac123bc-bound-sa-token\") pod \"cert-manager-55b4d954d5-m2xlz\" (UID: \"7760e2f6-5ba3-4e3d-854d-32ffeac123bc\") " pod="cert-manager/cert-manager-55b4d954d5-m2xlz"
Sep 10 22:07:24.261100 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:24.261048    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlnl7\" (UniqueName: \"kubernetes.io/projected/7760e2f6-5ba3-4e3d-854d-32ffeac123bc-kube-api-access-rlnl7\") pod \"cert-manager-55b4d954d5-m2xlz\" (UID: \"7760e2f6-5ba3-4e3d-854d-32ffeac123bc\") " pod="cert-manager/cert-manager-55b4d954d5-m2xlz"
Sep 10 22:07:24.311723 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:24.311694    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-m2xlz"
Sep 10 22:07:24.582636 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:24.582531    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m2xlz"]
Sep 10 22:07:24.585529 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:07:24.585502    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7760e2f6_5ba3_4e3d_854d_32ffeac123bc.slice/crio-047e098705bb6c4f3c28c55e9f1b239279220417b6aabce8cc66c84ae1e9ccbb WatchSource:0}: Error finding container 047e098705bb6c4f3c28c55e9f1b239279220417b6aabce8cc66c84ae1e9ccbb: Status 404 returned error can't find the container with id 047e098705bb6c4f3c28c55e9f1b239279220417b6aabce8cc66c84ae1e9ccbb
Sep 10 22:07:25.301598 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:25.301557    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-m2xlz" event={"ID":"7760e2f6-5ba3-4e3d-854d-32ffeac123bc","Type":"ContainerStarted","Data":"39976c248311b694393b64fdc0fa033bc7209b0839c7636dd0ae2a9e1375f252"}
Sep 10 22:07:25.301991 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:25.301610    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-m2xlz" event={"ID":"7760e2f6-5ba3-4e3d-854d-32ffeac123bc","Type":"ContainerStarted","Data":"047e098705bb6c4f3c28c55e9f1b239279220417b6aabce8cc66c84ae1e9ccbb"}
Sep 10 22:07:25.320986 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:25.320927    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-m2xlz" podStartSLOduration=2.320909726 podStartE2EDuration="2.320909726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:07:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:07:25.319000366 +0000 UTC m=+349.991098286" watchObservedRunningTime="2026-09-10 22:07:25.320909726 +0000 UTC m=+349.993007646"
Sep 10 22:07:35.782067 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:35.782027    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h"]
Sep 10 22:07:35.784564 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:35.784540    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h"
Sep 10 22:07:35.786888 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:35.786863    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 22:07:35.787011 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:35.786991    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 22:07:35.787317 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:35.787299    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bb482\""
Sep 10 22:07:35.802097 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:35.802066    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h"]
Sep 10 22:07:35.951844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:35.951806    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72cfd927-8cf4-49d3-bc81-070795d45a3e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h\" (UID: \"72cfd927-8cf4-49d3-bc81-070795d45a3e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h"
Sep 10 22:07:35.952019 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:35.951854    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kq8f\" (UniqueName: \"kubernetes.io/projected/72cfd927-8cf4-49d3-bc81-070795d45a3e-kube-api-access-2kq8f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h\" (UID: \"72cfd927-8cf4-49d3-bc81-070795d45a3e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h"
Sep 10 22:07:35.952019 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:35.951967    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72cfd927-8cf4-49d3-bc81-070795d45a3e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h\" (UID: \"72cfd927-8cf4-49d3-bc81-070795d45a3e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h"
Sep 10 22:07:36.052544 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:36.052463    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72cfd927-8cf4-49d3-bc81-070795d45a3e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h\" (UID: \"72cfd927-8cf4-49d3-bc81-070795d45a3e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h"
Sep 10 22:07:36.052544 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:36.052506    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kq8f\" (UniqueName: \"kubernetes.io/projected/72cfd927-8cf4-49d3-bc81-070795d45a3e-kube-api-access-2kq8f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h\" (UID: \"72cfd927-8cf4-49d3-bc81-070795d45a3e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h"
Sep 10 22:07:36.052544 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:36.052540    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72cfd927-8cf4-49d3-bc81-070795d45a3e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h\" (UID: \"72cfd927-8cf4-49d3-bc81-070795d45a3e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h"
Sep 10 22:07:36.052907 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:36.052892    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72cfd927-8cf4-49d3-bc81-070795d45a3e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h\" (UID: \"72cfd927-8cf4-49d3-bc81-070795d45a3e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h"
Sep 10 22:07:36.052954 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:36.052889    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72cfd927-8cf4-49d3-bc81-070795d45a3e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h\" (UID: \"72cfd927-8cf4-49d3-bc81-070795d45a3e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h"
Sep 10 22:07:36.060563 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:36.060522    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kq8f\" (UniqueName: \"kubernetes.io/projected/72cfd927-8cf4-49d3-bc81-070795d45a3e-kube-api-access-2kq8f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h\" (UID: \"72cfd927-8cf4-49d3-bc81-070795d45a3e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h"
Sep 10 22:07:36.093438 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:36.093404    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h"
Sep 10 22:07:36.363455 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:36.363351    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h"]
Sep 10 22:07:36.366028 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:07:36.365993    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72cfd927_8cf4_49d3_bc81_070795d45a3e.slice/crio-6b97b6ab0641d68132fae941376de95c22b004e5ae2b206320c699576fd562b7 WatchSource:0}: Error finding container 6b97b6ab0641d68132fae941376de95c22b004e5ae2b206320c699576fd562b7: Status 404 returned error can't find the container with id 6b97b6ab0641d68132fae941376de95c22b004e5ae2b206320c699576fd562b7
Sep 10 22:07:37.357319 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:37.357218    2577 generic.go:356] "Generic (PLEG): container finished" podID="72cfd927-8cf4-49d3-bc81-070795d45a3e" containerID="cc943eb557b66020e792141f8fdda89cbde77433158e39ae0a57e40088905557" exitCode=0
Sep 10 22:07:37.357319 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:37.357304    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h" event={"ID":"72cfd927-8cf4-49d3-bc81-070795d45a3e","Type":"ContainerDied","Data":"cc943eb557b66020e792141f8fdda89cbde77433158e39ae0a57e40088905557"}
Sep 10 22:07:37.357708 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:37.357361    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h" event={"ID":"72cfd927-8cf4-49d3-bc81-070795d45a3e","Type":"ContainerStarted","Data":"6b97b6ab0641d68132fae941376de95c22b004e5ae2b206320c699576fd562b7"}
Sep 10 22:07:38.365608 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:38.365517    2577 generic.go:356] "Generic (PLEG): container finished" podID="72cfd927-8cf4-49d3-bc81-070795d45a3e" containerID="7cf126911e1cb6f0389c72a1b2b6cca360366add44c34f109f3dd9142db73993" exitCode=0
Sep 10 22:07:38.365608 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:38.365593    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h" event={"ID":"72cfd927-8cf4-49d3-bc81-070795d45a3e","Type":"ContainerDied","Data":"7cf126911e1cb6f0389c72a1b2b6cca360366add44c34f109f3dd9142db73993"}
Sep 10 22:07:39.372711 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:39.372676    2577 generic.go:356] "Generic (PLEG): container finished" podID="72cfd927-8cf4-49d3-bc81-070795d45a3e" containerID="027cdadfdcb8a7ef07a88b216880ac61212cc40557b2392555c25e969c332339" exitCode=0
Sep 10 22:07:39.373124 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:39.372761    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h" event={"ID":"72cfd927-8cf4-49d3-bc81-070795d45a3e","Type":"ContainerDied","Data":"027cdadfdcb8a7ef07a88b216880ac61212cc40557b2392555c25e969c332339"}
Sep 10 22:07:40.502792 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:40.502753    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h"
Sep 10 22:07:40.685669 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:40.685638    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72cfd927-8cf4-49d3-bc81-070795d45a3e-bundle\") pod \"72cfd927-8cf4-49d3-bc81-070795d45a3e\" (UID: \"72cfd927-8cf4-49d3-bc81-070795d45a3e\") "
Sep 10 22:07:40.685880 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:40.685680    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72cfd927-8cf4-49d3-bc81-070795d45a3e-util\") pod \"72cfd927-8cf4-49d3-bc81-070795d45a3e\" (UID: \"72cfd927-8cf4-49d3-bc81-070795d45a3e\") "
Sep 10 22:07:40.685880 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:40.685708    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kq8f\" (UniqueName: \"kubernetes.io/projected/72cfd927-8cf4-49d3-bc81-070795d45a3e-kube-api-access-2kq8f\") pod \"72cfd927-8cf4-49d3-bc81-070795d45a3e\" (UID: \"72cfd927-8cf4-49d3-bc81-070795d45a3e\") "
Sep 10 22:07:40.686415 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:40.686387    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72cfd927-8cf4-49d3-bc81-070795d45a3e-bundle" (OuterVolumeSpecName: "bundle") pod "72cfd927-8cf4-49d3-bc81-070795d45a3e" (UID: "72cfd927-8cf4-49d3-bc81-070795d45a3e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:07:40.688016 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:40.687974    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72cfd927-8cf4-49d3-bc81-070795d45a3e-kube-api-access-2kq8f" (OuterVolumeSpecName: "kube-api-access-2kq8f") pod "72cfd927-8cf4-49d3-bc81-070795d45a3e" (UID: "72cfd927-8cf4-49d3-bc81-070795d45a3e"). InnerVolumeSpecName "kube-api-access-2kq8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:07:40.691084 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:40.691052    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72cfd927-8cf4-49d3-bc81-070795d45a3e-util" (OuterVolumeSpecName: "util") pod "72cfd927-8cf4-49d3-bc81-070795d45a3e" (UID: "72cfd927-8cf4-49d3-bc81-070795d45a3e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:07:40.786368 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:40.786331    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72cfd927-8cf4-49d3-bc81-070795d45a3e-util\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:07:40.786368 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:40.786362    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kq8f\" (UniqueName: \"kubernetes.io/projected/72cfd927-8cf4-49d3-bc81-070795d45a3e-kube-api-access-2kq8f\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:07:40.786368 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:40.786374    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72cfd927-8cf4-49d3-bc81-070795d45a3e-bundle\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:07:41.383293 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:41.383264    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h"
Sep 10 22:07:41.383293 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:41.383276    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4qt2h" event={"ID":"72cfd927-8cf4-49d3-bc81-070795d45a3e","Type":"ContainerDied","Data":"6b97b6ab0641d68132fae941376de95c22b004e5ae2b206320c699576fd562b7"}
Sep 10 22:07:41.383496 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:41.383318    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b97b6ab0641d68132fae941376de95c22b004e5ae2b206320c699576fd562b7"
Sep 10 22:07:46.007420 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.007384    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc"]
Sep 10 22:07:46.007825 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.007671    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72cfd927-8cf4-49d3-bc81-070795d45a3e" containerName="util"
Sep 10 22:07:46.007825 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.007681    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="72cfd927-8cf4-49d3-bc81-070795d45a3e" containerName="util"
Sep 10 22:07:46.007825 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.007697    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72cfd927-8cf4-49d3-bc81-070795d45a3e" containerName="pull"
Sep 10 22:07:46.007825 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.007703    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="72cfd927-8cf4-49d3-bc81-070795d45a3e" containerName="pull"
Sep 10 22:07:46.007825 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.007710    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72cfd927-8cf4-49d3-bc81-070795d45a3e" containerName="extract"
Sep 10 22:07:46.007825 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.007715    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="72cfd927-8cf4-49d3-bc81-070795d45a3e" containerName="extract"
Sep 10 22:07:46.007825 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.007769    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="72cfd927-8cf4-49d3-bc81-070795d45a3e" containerName="extract"
Sep 10 22:07:46.010451 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.010434    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc"
Sep 10 22:07:46.012705 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.012682    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 22:07:46.012858 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.012731    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 22:07:46.014214 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.014197    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bb482\""
Sep 10 22:07:46.018663 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.018641    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd6688d5-f375-473e-9f5a-7eefc984c60e-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc\" (UID: \"bd6688d5-f375-473e-9f5a-7eefc984c60e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc"
Sep 10 22:07:46.018663 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.018667    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd6688d5-f375-473e-9f5a-7eefc984c60e-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc\" (UID: \"bd6688d5-f375-473e-9f5a-7eefc984c60e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc"
Sep 10 22:07:46.019145 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.018696    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxkt8\" (UniqueName: \"kubernetes.io/projected/bd6688d5-f375-473e-9f5a-7eefc984c60e-kube-api-access-bxkt8\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc\" (UID: \"bd6688d5-f375-473e-9f5a-7eefc984c60e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc"
Sep 10 22:07:46.020508 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.020481    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc"]
Sep 10 22:07:46.119833 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.119765    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd6688d5-f375-473e-9f5a-7eefc984c60e-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc\" (UID: \"bd6688d5-f375-473e-9f5a-7eefc984c60e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc"
Sep 10 22:07:46.120032 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.119838    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd6688d5-f375-473e-9f5a-7eefc984c60e-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc\" (UID: \"bd6688d5-f375-473e-9f5a-7eefc984c60e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc"
Sep 10 22:07:46.120032 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.119869    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxkt8\" (UniqueName: \"kubernetes.io/projected/bd6688d5-f375-473e-9f5a-7eefc984c60e-kube-api-access-bxkt8\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc\" (UID: \"bd6688d5-f375-473e-9f5a-7eefc984c60e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc"
Sep 10 22:07:46.120233 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.120208    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd6688d5-f375-473e-9f5a-7eefc984c60e-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc\" (UID: \"bd6688d5-f375-473e-9f5a-7eefc984c60e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc"
Sep 10 22:07:46.120233 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.120225    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd6688d5-f375-473e-9f5a-7eefc984c60e-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc\" (UID: \"bd6688d5-f375-473e-9f5a-7eefc984c60e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc"
Sep 10 22:07:46.128328 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.128303    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxkt8\" (UniqueName: \"kubernetes.io/projected/bd6688d5-f375-473e-9f5a-7eefc984c60e-kube-api-access-bxkt8\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc\" (UID: \"bd6688d5-f375-473e-9f5a-7eefc984c60e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc"
Sep 10 22:07:46.319265 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.319181    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc"
Sep 10 22:07:46.598295 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:46.598220    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc"]
Sep 10 22:07:46.601389 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:07:46.601364    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd6688d5_f375_473e_9f5a_7eefc984c60e.slice/crio-15e6d61ea44894f189b9158d2693a5647a4d8b0138ecb9c44d6e5c1bfffa79d5 WatchSource:0}: Error finding container 15e6d61ea44894f189b9158d2693a5647a4d8b0138ecb9c44d6e5c1bfffa79d5: Status 404 returned error can't find the container with id 15e6d61ea44894f189b9158d2693a5647a4d8b0138ecb9c44d6e5c1bfffa79d5
Sep 10 22:07:47.409692 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:47.409653    2577 generic.go:356] "Generic (PLEG): container finished" podID="bd6688d5-f375-473e-9f5a-7eefc984c60e" containerID="c0ff16dcfa379f2d8cd9e035a30c4327f971c870bb9a9ab88e6abeed4b26dc0a" exitCode=0
Sep 10 22:07:47.410213 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:47.409741    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc" event={"ID":"bd6688d5-f375-473e-9f5a-7eefc984c60e","Type":"ContainerDied","Data":"c0ff16dcfa379f2d8cd9e035a30c4327f971c870bb9a9ab88e6abeed4b26dc0a"}
Sep 10 22:07:47.410213 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:47.409813    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc" event={"ID":"bd6688d5-f375-473e-9f5a-7eefc984c60e","Type":"ContainerStarted","Data":"15e6d61ea44894f189b9158d2693a5647a4d8b0138ecb9c44d6e5c1bfffa79d5"}
Sep 10 22:07:48.416018 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.415987    2577 generic.go:356] "Generic (PLEG): container finished" podID="bd6688d5-f375-473e-9f5a-7eefc984c60e" containerID="841fc0e327333420770c8a4d13861b660d6127cdda4381ae155a9ff4644e8eae" exitCode=0
Sep 10 22:07:48.416385 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.416025    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc" event={"ID":"bd6688d5-f375-473e-9f5a-7eefc984c60e","Type":"ContainerDied","Data":"841fc0e327333420770c8a4d13861b660d6127cdda4381ae155a9ff4644e8eae"}
Sep 10 22:07:48.474091 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.474067    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc"]
Sep 10 22:07:48.476559 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.476536    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc"
Sep 10 22:07:48.478439 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.478420    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 22:07:48.478564 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.478544    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 22:07:48.478659 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.478627    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 22:07:48.478891 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.478878    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5r2tg\""
Sep 10 22:07:48.478979 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.478960    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 22:07:48.495338 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.495311    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc"]
Sep 10 22:07:48.537286 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.537241    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5781a3c3-0e6d-4b74-b015-e7d9e74b295d-manifests\") pod \"opendatahub-operator-controller-manager-76d44b6d5b-8k7wc\" (UID: \"5781a3c3-0e6d-4b74-b015-e7d9e74b295d\") " pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc"
Sep 10 22:07:48.537484 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.537375    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr5rv\" (UniqueName: \"kubernetes.io/projected/5781a3c3-0e6d-4b74-b015-e7d9e74b295d-kube-api-access-fr5rv\") pod \"opendatahub-operator-controller-manager-76d44b6d5b-8k7wc\" (UID: \"5781a3c3-0e6d-4b74-b015-e7d9e74b295d\") " pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc"
Sep 10 22:07:48.537484 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.537421    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5781a3c3-0e6d-4b74-b015-e7d9e74b295d-tmp\") pod \"opendatahub-operator-controller-manager-76d44b6d5b-8k7wc\" (UID: \"5781a3c3-0e6d-4b74-b015-e7d9e74b295d\") " pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc"
Sep 10 22:07:48.537484 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.537446    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5781a3c3-0e6d-4b74-b015-e7d9e74b295d-webhook-cert\") pod \"opendatahub-operator-controller-manager-76d44b6d5b-8k7wc\" (UID: \"5781a3c3-0e6d-4b74-b015-e7d9e74b295d\") " pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc"
Sep 10 22:07:48.537644 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.537563    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5781a3c3-0e6d-4b74-b015-e7d9e74b295d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76d44b6d5b-8k7wc\" (UID: \"5781a3c3-0e6d-4b74-b015-e7d9e74b295d\") " pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc"
Sep 10 22:07:48.638127 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.638092    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr5rv\" (UniqueName: \"kubernetes.io/projected/5781a3c3-0e6d-4b74-b015-e7d9e74b295d-kube-api-access-fr5rv\") pod \"opendatahub-operator-controller-manager-76d44b6d5b-8k7wc\" (UID: \"5781a3c3-0e6d-4b74-b015-e7d9e74b295d\") " pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc"
Sep 10 22:07:48.638292 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.638134    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5781a3c3-0e6d-4b74-b015-e7d9e74b295d-tmp\") pod \"opendatahub-operator-controller-manager-76d44b6d5b-8k7wc\" (UID: \"5781a3c3-0e6d-4b74-b015-e7d9e74b295d\") " pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc"
Sep 10 22:07:48.638292 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.638159    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5781a3c3-0e6d-4b74-b015-e7d9e74b295d-webhook-cert\") pod \"opendatahub-operator-controller-manager-76d44b6d5b-8k7wc\" (UID: \"5781a3c3-0e6d-4b74-b015-e7d9e74b295d\") " pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc"
Sep 10 22:07:48.638292 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.638191    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5781a3c3-0e6d-4b74-b015-e7d9e74b295d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76d44b6d5b-8k7wc\" (UID: \"5781a3c3-0e6d-4b74-b015-e7d9e74b295d\") " pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc"
Sep 10 22:07:48.638292 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.638230    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5781a3c3-0e6d-4b74-b015-e7d9e74b295d-manifests\") pod \"opendatahub-operator-controller-manager-76d44b6d5b-8k7wc\" (UID: \"5781a3c3-0e6d-4b74-b015-e7d9e74b295d\") " pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc"
Sep 10 22:07:48.638544 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.638524    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5781a3c3-0e6d-4b74-b015-e7d9e74b295d-manifests\") pod \"opendatahub-operator-controller-manager-76d44b6d5b-8k7wc\" (UID: \"5781a3c3-0e6d-4b74-b015-e7d9e74b295d\") " pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc"
Sep 10 22:07:48.640661 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.640635    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5781a3c3-0e6d-4b74-b015-e7d9e74b295d-tmp\") pod \"opendatahub-operator-controller-manager-76d44b6d5b-8k7wc\" (UID: \"5781a3c3-0e6d-4b74-b015-e7d9e74b295d\") " pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc"
Sep 10 22:07:48.640769 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.640693    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5781a3c3-0e6d-4b74-b015-e7d9e74b295d-webhook-cert\") pod \"opendatahub-operator-controller-manager-76d44b6d5b-8k7wc\" (UID: \"5781a3c3-0e6d-4b74-b015-e7d9e74b295d\") " pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc"
Sep 10 22:07:48.640883 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.640867    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5781a3c3-0e6d-4b74-b015-e7d9e74b295d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76d44b6d5b-8k7wc\" (UID: \"5781a3c3-0e6d-4b74-b015-e7d9e74b295d\") " pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc"
Sep 10 22:07:48.647650 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.647624    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr5rv\" (UniqueName: \"kubernetes.io/projected/5781a3c3-0e6d-4b74-b015-e7d9e74b295d-kube-api-access-fr5rv\") pod \"opendatahub-operator-controller-manager-76d44b6d5b-8k7wc\" (UID: \"5781a3c3-0e6d-4b74-b015-e7d9e74b295d\") " pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc"
Sep 10 22:07:48.789136 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:48.789051    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc"
Sep 10 22:07:49.084248 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:49.084220    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc"]
Sep 10 22:07:49.086820 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:07:49.086793    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5781a3c3_0e6d_4b74_b015_e7d9e74b295d.slice/crio-753b04d0fcd129ad83e5f0569ef4a7f9e074bf4b2ae0596429257a88e8f7c2a9 WatchSource:0}: Error finding container 753b04d0fcd129ad83e5f0569ef4a7f9e074bf4b2ae0596429257a88e8f7c2a9: Status 404 returned error can't find the container with id 753b04d0fcd129ad83e5f0569ef4a7f9e074bf4b2ae0596429257a88e8f7c2a9
Sep 10 22:07:49.423398 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:49.423358    2577 generic.go:356] "Generic (PLEG): container finished" podID="bd6688d5-f375-473e-9f5a-7eefc984c60e" containerID="aba9c5900fb45388a983593363653c43e44832763822cdd3f42f7c8b36bfcef4" exitCode=0
Sep 10 22:07:49.423916 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:49.423431    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc" event={"ID":"bd6688d5-f375-473e-9f5a-7eefc984c60e","Type":"ContainerDied","Data":"aba9c5900fb45388a983593363653c43e44832763822cdd3f42f7c8b36bfcef4"}
Sep 10 22:07:49.424828 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:49.424804    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc" event={"ID":"5781a3c3-0e6d-4b74-b015-e7d9e74b295d","Type":"ContainerStarted","Data":"753b04d0fcd129ad83e5f0569ef4a7f9e074bf4b2ae0596429257a88e8f7c2a9"}
Sep 10 22:07:51.192848 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:51.192816    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc"
Sep 10 22:07:51.255843 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:51.255807    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd6688d5-f375-473e-9f5a-7eefc984c60e-util\") pod \"bd6688d5-f375-473e-9f5a-7eefc984c60e\" (UID: \"bd6688d5-f375-473e-9f5a-7eefc984c60e\") "
Sep 10 22:07:51.256023 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:51.255859    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd6688d5-f375-473e-9f5a-7eefc984c60e-bundle\") pod \"bd6688d5-f375-473e-9f5a-7eefc984c60e\" (UID: \"bd6688d5-f375-473e-9f5a-7eefc984c60e\") "
Sep 10 22:07:51.256023 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:51.255922    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxkt8\" (UniqueName: \"kubernetes.io/projected/bd6688d5-f375-473e-9f5a-7eefc984c60e-kube-api-access-bxkt8\") pod \"bd6688d5-f375-473e-9f5a-7eefc984c60e\" (UID: \"bd6688d5-f375-473e-9f5a-7eefc984c60e\") "
Sep 10 22:07:51.256846 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:51.256805    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd6688d5-f375-473e-9f5a-7eefc984c60e-bundle" (OuterVolumeSpecName: "bundle") pod "bd6688d5-f375-473e-9f5a-7eefc984c60e" (UID: "bd6688d5-f375-473e-9f5a-7eefc984c60e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:07:51.258570 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:51.258537    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd6688d5-f375-473e-9f5a-7eefc984c60e-kube-api-access-bxkt8" (OuterVolumeSpecName: "kube-api-access-bxkt8") pod "bd6688d5-f375-473e-9f5a-7eefc984c60e" (UID: "bd6688d5-f375-473e-9f5a-7eefc984c60e"). InnerVolumeSpecName "kube-api-access-bxkt8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:07:51.262188 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:51.262162    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd6688d5-f375-473e-9f5a-7eefc984c60e-util" (OuterVolumeSpecName: "util") pod "bd6688d5-f375-473e-9f5a-7eefc984c60e" (UID: "bd6688d5-f375-473e-9f5a-7eefc984c60e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:07:51.356897 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:51.356859    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd6688d5-f375-473e-9f5a-7eefc984c60e-util\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:07:51.356897 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:51.356892    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd6688d5-f375-473e-9f5a-7eefc984c60e-bundle\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:07:51.356897 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:51.356902    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxkt8\" (UniqueName: \"kubernetes.io/projected/bd6688d5-f375-473e-9f5a-7eefc984c60e-kube-api-access-bxkt8\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:07:51.442663 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:51.442578    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc" event={"ID":"bd6688d5-f375-473e-9f5a-7eefc984c60e","Type":"ContainerDied","Data":"15e6d61ea44894f189b9158d2693a5647a4d8b0138ecb9c44d6e5c1bfffa79d5"}
Sep 10 22:07:51.442663 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:51.442645    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15e6d61ea44894f189b9158d2693a5647a4d8b0138ecb9c44d6e5c1bfffa79d5"
Sep 10 22:07:51.442663 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:51.442588    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hnpgc"
Sep 10 22:07:52.449087 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:52.449051    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc" event={"ID":"5781a3c3-0e6d-4b74-b015-e7d9e74b295d","Type":"ContainerStarted","Data":"434d882ac4b22855857b5a18f18867a6e2451b6b66f3261b2b4f707a02e8059f"}
Sep 10 22:07:53.455704 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:53.455669    2577 generic.go:356] "Generic (PLEG): container finished" podID="5781a3c3-0e6d-4b74-b015-e7d9e74b295d" containerID="434d882ac4b22855857b5a18f18867a6e2451b6b66f3261b2b4f707a02e8059f" exitCode=0
Sep 10 22:07:53.456135 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:53.455760    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc" event={"ID":"5781a3c3-0e6d-4b74-b015-e7d9e74b295d","Type":"ContainerDied","Data":"434d882ac4b22855857b5a18f18867a6e2451b6b66f3261b2b4f707a02e8059f"}
Sep 10 22:07:54.463723 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:54.463687    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc" event={"ID":"5781a3c3-0e6d-4b74-b015-e7d9e74b295d","Type":"ContainerStarted","Data":"0fa4989e90310e57e192f3ebb5125cdf680df6d3af30a84148a27181ed6fe005"}
Sep 10 22:07:54.464224 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:54.463833    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc"
Sep 10 22:07:54.488051 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:07:54.488000    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc" podStartSLOduration=2.139704967 podStartE2EDuration="6.48798367s" totalImagesPullingTime="3.282673875s" totalInitContainerRuntime="1.065604828s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:07:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:07:54.486455647 +0000 UTC m=+379.158553604" watchObservedRunningTime="2026-09-10 22:07:54.48798367 +0000 UTC m=+379.160081591"
Sep 10 22:08:05.470993 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:05.470958    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76d44b6d5b-8k7wc"
Sep 10 22:08:08.432480 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.432429    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-69ccfddbf-hhltp"]
Sep 10 22:08:08.432911 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.432885    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd6688d5-f375-473e-9f5a-7eefc984c60e" containerName="extract"
Sep 10 22:08:08.432911 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.432901    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd6688d5-f375-473e-9f5a-7eefc984c60e" containerName="extract"
Sep 10 22:08:08.433033 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.432918    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd6688d5-f375-473e-9f5a-7eefc984c60e" containerName="util"
Sep 10 22:08:08.433033 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.432927    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd6688d5-f375-473e-9f5a-7eefc984c60e" containerName="util"
Sep 10 22:08:08.433033 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.432946    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd6688d5-f375-473e-9f5a-7eefc984c60e" containerName="pull"
Sep 10 22:08:08.433033 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.432953    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd6688d5-f375-473e-9f5a-7eefc984c60e" containerName="pull"
Sep 10 22:08:08.433033 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.433032    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd6688d5-f375-473e-9f5a-7eefc984c60e" containerName="extract"
Sep 10 22:08:08.440262 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.440237    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69ccfddbf-hhltp"
Sep 10 22:08:08.442357 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.442298    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 10 22:08:08.442525 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.442314    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 10 22:08:08.442525 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.442505    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-z59kw\""
Sep 10 22:08:08.442915 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.442895    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 22:08:08.442915 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.442905    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 22:08:08.454480 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.454458    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69ccfddbf-hhltp"]
Sep 10 22:08:08.493665 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.493629    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nft8\" (UniqueName: \"kubernetes.io/projected/406fc6d2-bd67-4933-bbd2-2d083a618df4-kube-api-access-7nft8\") pod \"kube-auth-proxy-69ccfddbf-hhltp\" (UID: \"406fc6d2-bd67-4933-bbd2-2d083a618df4\") " pod="openshift-ingress/kube-auth-proxy-69ccfddbf-hhltp"
Sep 10 22:08:08.493665 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.493667    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/406fc6d2-bd67-4933-bbd2-2d083a618df4-tmp\") pod \"kube-auth-proxy-69ccfddbf-hhltp\" (UID: \"406fc6d2-bd67-4933-bbd2-2d083a618df4\") " pod="openshift-ingress/kube-auth-proxy-69ccfddbf-hhltp"
Sep 10 22:08:08.493900 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.493810    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/406fc6d2-bd67-4933-bbd2-2d083a618df4-tls-certs\") pod \"kube-auth-proxy-69ccfddbf-hhltp\" (UID: \"406fc6d2-bd67-4933-bbd2-2d083a618df4\") " pod="openshift-ingress/kube-auth-proxy-69ccfddbf-hhltp"
Sep 10 22:08:08.595293 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.595256    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nft8\" (UniqueName: \"kubernetes.io/projected/406fc6d2-bd67-4933-bbd2-2d083a618df4-kube-api-access-7nft8\") pod \"kube-auth-proxy-69ccfddbf-hhltp\" (UID: \"406fc6d2-bd67-4933-bbd2-2d083a618df4\") " pod="openshift-ingress/kube-auth-proxy-69ccfddbf-hhltp"
Sep 10 22:08:08.595293 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.595298    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/406fc6d2-bd67-4933-bbd2-2d083a618df4-tmp\") pod \"kube-auth-proxy-69ccfddbf-hhltp\" (UID: \"406fc6d2-bd67-4933-bbd2-2d083a618df4\") " pod="openshift-ingress/kube-auth-proxy-69ccfddbf-hhltp"
Sep 10 22:08:08.595541 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.595356    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/406fc6d2-bd67-4933-bbd2-2d083a618df4-tls-certs\") pod \"kube-auth-proxy-69ccfddbf-hhltp\" (UID: \"406fc6d2-bd67-4933-bbd2-2d083a618df4\") " pod="openshift-ingress/kube-auth-proxy-69ccfddbf-hhltp"
Sep 10 22:08:08.595541 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:08:08.595506    2577 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 10 22:08:08.595665 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:08:08.595589    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/406fc6d2-bd67-4933-bbd2-2d083a618df4-tls-certs podName:406fc6d2-bd67-4933-bbd2-2d083a618df4 nodeName:}" failed. No retries permitted until 2026-09-10 22:08:09.095567645 +0000 UTC m=+393.767665564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/406fc6d2-bd67-4933-bbd2-2d083a618df4-tls-certs") pod "kube-auth-proxy-69ccfddbf-hhltp" (UID: "406fc6d2-bd67-4933-bbd2-2d083a618df4") : secret "kube-auth-proxy-tls" not found
Sep 10 22:08:08.597824 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.597796    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/406fc6d2-bd67-4933-bbd2-2d083a618df4-tmp\") pod \"kube-auth-proxy-69ccfddbf-hhltp\" (UID: \"406fc6d2-bd67-4933-bbd2-2d083a618df4\") " pod="openshift-ingress/kube-auth-proxy-69ccfddbf-hhltp"
Sep 10 22:08:08.604644 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:08.604623    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nft8\" (UniqueName: \"kubernetes.io/projected/406fc6d2-bd67-4933-bbd2-2d083a618df4-kube-api-access-7nft8\") pod \"kube-auth-proxy-69ccfddbf-hhltp\" (UID: \"406fc6d2-bd67-4933-bbd2-2d083a618df4\") " pod="openshift-ingress/kube-auth-proxy-69ccfddbf-hhltp"
Sep 10 22:08:09.099742 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:09.099708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/406fc6d2-bd67-4933-bbd2-2d083a618df4-tls-certs\") pod \"kube-auth-proxy-69ccfddbf-hhltp\" (UID: \"406fc6d2-bd67-4933-bbd2-2d083a618df4\") " pod="openshift-ingress/kube-auth-proxy-69ccfddbf-hhltp"
Sep 10 22:08:09.102284 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:09.102261    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/406fc6d2-bd67-4933-bbd2-2d083a618df4-tls-certs\") pod \"kube-auth-proxy-69ccfddbf-hhltp\" (UID: \"406fc6d2-bd67-4933-bbd2-2d083a618df4\") " pod="openshift-ingress/kube-auth-proxy-69ccfddbf-hhltp"
Sep 10 22:08:09.350629 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:09.350547    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69ccfddbf-hhltp"
Sep 10 22:08:09.648533 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:09.648502    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69ccfddbf-hhltp"]
Sep 10 22:08:09.653009 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:08:09.652985    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod406fc6d2_bd67_4933_bbd2_2d083a618df4.slice/crio-6e95c312a0993a7eb7c76d3337120e9e1b56ec962bd699029460d4a6a36aa710 WatchSource:0}: Error finding container 6e95c312a0993a7eb7c76d3337120e9e1b56ec962bd699029460d4a6a36aa710: Status 404 returned error can't find the container with id 6e95c312a0993a7eb7c76d3337120e9e1b56ec962bd699029460d4a6a36aa710
Sep 10 22:08:10.145347 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.145316    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"]
Sep 10 22:08:10.149742 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.149726    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.151925 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.151896    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-p8mrv\""
Sep 10 22:08:10.152045 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.151992    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 22:08:10.152119 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.152097    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 22:08:10.152277 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.152265    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 22:08:10.152374 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.152281    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 22:08:10.172519 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.172486    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"]
Sep 10 22:08:10.208989 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.208930    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-qnjs8\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.208989 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.208965    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-qnjs8\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.208989 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.208985    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfj4z\" (UniqueName: \"kubernetes.io/projected/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-kube-api-access-zfj4z\") pod \"istiod-openshift-gateway-7b7995d5cd-qnjs8\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.209245 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.209039    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-qnjs8\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.209245 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.209079    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-qnjs8\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.209245 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.209131    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-qnjs8\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.209245 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.209180    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-qnjs8\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.310025 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.309984    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-qnjs8\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.310223 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.310047    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-qnjs8\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.310223 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.310100    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-qnjs8\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.310223 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.310124    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-qnjs8\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.310223 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.310151    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfj4z\" (UniqueName: \"kubernetes.io/projected/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-kube-api-access-zfj4z\") pod \"istiod-openshift-gateway-7b7995d5cd-qnjs8\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.310223 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.310204    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-qnjs8\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.310486 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.310232    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-qnjs8\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.311015 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.310961    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-qnjs8\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.313207 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.313174    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-qnjs8\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.313207 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.313185    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-qnjs8\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.314062 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.314040    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-qnjs8\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.314614 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.314593    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-qnjs8\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.320729 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.320666    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-qnjs8\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.322818 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.322762    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfj4z\" (UniqueName: \"kubernetes.io/projected/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-kube-api-access-zfj4z\") pod \"istiod-openshift-gateway-7b7995d5cd-qnjs8\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.460093 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.460014    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:10.544226 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.544079    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69ccfddbf-hhltp" event={"ID":"406fc6d2-bd67-4933-bbd2-2d083a618df4","Type":"ContainerStarted","Data":"6e95c312a0993a7eb7c76d3337120e9e1b56ec962bd699029460d4a6a36aa710"}
Sep 10 22:08:10.758240 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:10.758159    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"]
Sep 10 22:08:10.761627 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:08:10.761589    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9c64cde_348e_45c2_afe9_f5d846ebbe6c.slice/crio-3c2a1e0a2528c118f5b5227d404b46d4035c97dc9c7900e0b88b7f8d086a00fb WatchSource:0}: Error finding container 3c2a1e0a2528c118f5b5227d404b46d4035c97dc9c7900e0b88b7f8d086a00fb: Status 404 returned error can't find the container with id 3c2a1e0a2528c118f5b5227d404b46d4035c97dc9c7900e0b88b7f8d086a00fb
Sep 10 22:08:11.551261 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:11.551227    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8" event={"ID":"c9c64cde-348e-45c2-afe9-f5d846ebbe6c","Type":"ContainerStarted","Data":"3c2a1e0a2528c118f5b5227d404b46d4035c97dc9c7900e0b88b7f8d086a00fb"}
Sep 10 22:08:12.559007 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:12.558966    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69ccfddbf-hhltp" event={"ID":"406fc6d2-bd67-4933-bbd2-2d083a618df4","Type":"ContainerStarted","Data":"e0b9951847deeb652931f88f14e4701f01a743d918dcb73cd218f77b1d101416"}
Sep 10 22:08:12.579598 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:12.579542    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-69ccfddbf-hhltp" podStartSLOduration=1.864613309 podStartE2EDuration="4.579509189s" totalImagesPullingTime="2.71489588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:08:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:08:12.578370039 +0000 UTC m=+397.250467961" watchObservedRunningTime="2026-09-10 22:08:12.579509189 +0000 UTC m=+397.251607111"
Sep 10 22:08:14.284271 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:14.284232    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:08:14.284566 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:14.284302    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:08:14.571178 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:14.571072    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8" event={"ID":"c9c64cde-348e-45c2-afe9-f5d846ebbe6c","Type":"ContainerStarted","Data":"92c2daa5b0808c8104038022186a736e3999a259b15e11585a3255a939f43fab"}
Sep 10 22:08:14.571346 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:14.571266    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:15.578070 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:15.578039    2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-qnjs8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 22:08:15.578441 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:15.578098    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8" podUID="c9c64cde-348e-45c2-afe9-f5d846ebbe6c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 22:08:18.577720 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:18.577687    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:18.597388 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:18.597325    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8" podStartSLOduration=5.07705429 podStartE2EDuration="8.597303988s" totalImagesPullingTime="3.520249698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:08:14.590550148 +0000 UTC m=+399.262648067" watchObservedRunningTime="2026-09-10 22:08:18.597303988 +0000 UTC m=+403.269401910"
Sep 10 22:08:29.161237 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.161205    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rrr7z"]
Sep 10 22:08:29.164372 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.164354    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rrr7z"
Sep 10 22:08:29.167447 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.167426    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 10 22:08:29.167561 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.167492    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8blmn\""
Sep 10 22:08:29.176268 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.176244    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rrr7z"]
Sep 10 22:08:29.183704 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.183680    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-l6xkk"]
Sep 10 22:08:29.189952 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.189930    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l6xkk"
Sep 10 22:08:29.193742 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.193720    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-bprxj\""
Sep 10 22:08:29.196110 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.196091    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 10 22:08:29.201719 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.201696    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-l6xkk"]
Sep 10 22:08:29.278258 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.278223    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e45c2274-fc79-486b-a9a1-02867a157683-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-l6xkk\" (UID: \"e45c2274-fc79-486b-a9a1-02867a157683\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l6xkk"
Sep 10 22:08:29.278425 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.278273    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e8e6ac4f-459f-4139-8feb-85795da91b07-cert\") pod \"kserve-controller-manager-d6f4b65b8-rrr7z\" (UID: \"e8e6ac4f-459f-4139-8feb-85795da91b07\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rrr7z"
Sep 10 22:08:29.278425 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.278398    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hprlr\" (UniqueName: \"kubernetes.io/projected/e8e6ac4f-459f-4139-8feb-85795da91b07-kube-api-access-hprlr\") pod \"kserve-controller-manager-d6f4b65b8-rrr7z\" (UID: \"e8e6ac4f-459f-4139-8feb-85795da91b07\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rrr7z"
Sep 10 22:08:29.278499 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.278452    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpzfc\" (UniqueName: \"kubernetes.io/projected/e45c2274-fc79-486b-a9a1-02867a157683-kube-api-access-fpzfc\") pod \"llmisvc-controller-manager-777c6bd7d5-l6xkk\" (UID: \"e45c2274-fc79-486b-a9a1-02867a157683\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l6xkk"
Sep 10 22:08:29.378909 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.378879    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e8e6ac4f-459f-4139-8feb-85795da91b07-cert\") pod \"kserve-controller-manager-d6f4b65b8-rrr7z\" (UID: \"e8e6ac4f-459f-4139-8feb-85795da91b07\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rrr7z"
Sep 10 22:08:29.379071 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.378953    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hprlr\" (UniqueName: \"kubernetes.io/projected/e8e6ac4f-459f-4139-8feb-85795da91b07-kube-api-access-hprlr\") pod \"kserve-controller-manager-d6f4b65b8-rrr7z\" (UID: \"e8e6ac4f-459f-4139-8feb-85795da91b07\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rrr7z"
Sep 10 22:08:29.379071 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.378990    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpzfc\" (UniqueName: \"kubernetes.io/projected/e45c2274-fc79-486b-a9a1-02867a157683-kube-api-access-fpzfc\") pod \"llmisvc-controller-manager-777c6bd7d5-l6xkk\" (UID: \"e45c2274-fc79-486b-a9a1-02867a157683\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l6xkk"
Sep 10 22:08:29.379071 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.379006    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e45c2274-fc79-486b-a9a1-02867a157683-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-l6xkk\" (UID: \"e45c2274-fc79-486b-a9a1-02867a157683\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l6xkk"
Sep 10 22:08:29.381459 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.381424    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e8e6ac4f-459f-4139-8feb-85795da91b07-cert\") pod \"kserve-controller-manager-d6f4b65b8-rrr7z\" (UID: \"e8e6ac4f-459f-4139-8feb-85795da91b07\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rrr7z"
Sep 10 22:08:29.381602 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.381582    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e45c2274-fc79-486b-a9a1-02867a157683-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-l6xkk\" (UID: \"e45c2274-fc79-486b-a9a1-02867a157683\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l6xkk"
Sep 10 22:08:29.387270 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.387247    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpzfc\" (UniqueName: \"kubernetes.io/projected/e45c2274-fc79-486b-a9a1-02867a157683-kube-api-access-fpzfc\") pod \"llmisvc-controller-manager-777c6bd7d5-l6xkk\" (UID: \"e45c2274-fc79-486b-a9a1-02867a157683\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l6xkk"
Sep 10 22:08:29.387520 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.387497    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hprlr\" (UniqueName: \"kubernetes.io/projected/e8e6ac4f-459f-4139-8feb-85795da91b07-kube-api-access-hprlr\") pod \"kserve-controller-manager-d6f4b65b8-rrr7z\" (UID: \"e8e6ac4f-459f-4139-8feb-85795da91b07\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rrr7z"
Sep 10 22:08:29.475693 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.475614    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rrr7z"
Sep 10 22:08:29.505854 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.505827    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l6xkk"
Sep 10 22:08:29.753373 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.753348    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rrr7z"]
Sep 10 22:08:29.755790 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:08:29.755753    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e6ac4f_459f_4139_8feb_85795da91b07.slice/crio-622991ce70525007778acc91ee70c6a8adb470e4ebebb0370db13a987863e370 WatchSource:0}: Error finding container 622991ce70525007778acc91ee70c6a8adb470e4ebebb0370db13a987863e370: Status 404 returned error can't find the container with id 622991ce70525007778acc91ee70c6a8adb470e4ebebb0370db13a987863e370
Sep 10 22:08:29.806073 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:29.806044    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-l6xkk"]
Sep 10 22:08:29.807983 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:08:29.807959    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode45c2274_fc79_486b_a9a1_02867a157683.slice/crio-5116a83d0ad716a1fdc2786942e107b074985d9d7adc650cf06bde305e6e31d7 WatchSource:0}: Error finding container 5116a83d0ad716a1fdc2786942e107b074985d9d7adc650cf06bde305e6e31d7: Status 404 returned error can't find the container with id 5116a83d0ad716a1fdc2786942e107b074985d9d7adc650cf06bde305e6e31d7
Sep 10 22:08:30.469574 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:30.469542    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"]
Sep 10 22:08:30.470089 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:30.469796    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8" podUID="c9c64cde-348e-45c2-afe9-f5d846ebbe6c" containerName="discovery" containerID="cri-o://92c2daa5b0808c8104038022186a736e3999a259b15e11585a3255a939f43fab" gracePeriod=30
Sep 10 22:08:30.577426 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:30.577355    2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-qnjs8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.32:8080/ready\": dial tcp 10.134.0.32:8080: connect: connection refused" start-of-body=
Sep 10 22:08:30.577606 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:30.577425    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8" podUID="c9c64cde-348e-45c2-afe9-f5d846ebbe6c" containerName="discovery" probeResult="failure" output="Get \"http://10.134.0.32:8080/ready\": dial tcp 10.134.0.32:8080: connect: connection refused"
Sep 10 22:08:30.656888 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:30.656848    2577 generic.go:356] "Generic (PLEG): container finished" podID="c9c64cde-348e-45c2-afe9-f5d846ebbe6c" containerID="92c2daa5b0808c8104038022186a736e3999a259b15e11585a3255a939f43fab" exitCode=0
Sep 10 22:08:30.657056 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:30.656933    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8" event={"ID":"c9c64cde-348e-45c2-afe9-f5d846ebbe6c","Type":"ContainerDied","Data":"92c2daa5b0808c8104038022186a736e3999a259b15e11585a3255a939f43fab"}
Sep 10 22:08:30.658797 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:30.658755    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rrr7z" event={"ID":"e8e6ac4f-459f-4139-8feb-85795da91b07","Type":"ContainerStarted","Data":"622991ce70525007778acc91ee70c6a8adb470e4ebebb0370db13a987863e370"}
Sep 10 22:08:30.660381 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:30.660350    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l6xkk" event={"ID":"e45c2274-fc79-486b-a9a1-02867a157683","Type":"ContainerStarted","Data":"5116a83d0ad716a1fdc2786942e107b074985d9d7adc650cf06bde305e6e31d7"}
Sep 10 22:08:30.907582 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:30.907262    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:30.996361 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:30.996325    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-csr-dns-cert\") pod \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") "
Sep 10 22:08:30.996503 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:30.996420    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-cacerts\") pod \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") "
Sep 10 22:08:30.996503 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:30.996468    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-token\") pod \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") "
Sep 10 22:08:30.996587 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:30.996503    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfj4z\" (UniqueName: \"kubernetes.io/projected/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-kube-api-access-zfj4z\") pod \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") "
Sep 10 22:08:30.996587 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:30.996555    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-kubeconfig\") pod \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") "
Sep 10 22:08:30.996646 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:30.996588    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-local-certs\") pod \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") "
Sep 10 22:08:30.996646 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:30.996618    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-csr-ca-configmap\") pod \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\" (UID: \"c9c64cde-348e-45c2-afe9-f5d846ebbe6c\") "
Sep 10 22:08:30.997282 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:30.997230    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "c9c64cde-348e-45c2-afe9-f5d846ebbe6c" (UID: "c9c64cde-348e-45c2-afe9-f5d846ebbe6c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:08:31.002133 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:31.002092    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-cacerts" (OuterVolumeSpecName: "cacerts") pod "c9c64cde-348e-45c2-afe9-f5d846ebbe6c" (UID: "c9c64cde-348e-45c2-afe9-f5d846ebbe6c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:08:31.002537 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:31.002436    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-local-certs" (OuterVolumeSpecName: "local-certs") pod "c9c64cde-348e-45c2-afe9-f5d846ebbe6c" (UID: "c9c64cde-348e-45c2-afe9-f5d846ebbe6c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:08:31.002537 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:31.002515    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-token" (OuterVolumeSpecName: "istio-token") pod "c9c64cde-348e-45c2-afe9-f5d846ebbe6c" (UID: "c9c64cde-348e-45c2-afe9-f5d846ebbe6c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:08:31.002694 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:31.002617    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-kube-api-access-zfj4z" (OuterVolumeSpecName: "kube-api-access-zfj4z") pod "c9c64cde-348e-45c2-afe9-f5d846ebbe6c" (UID: "c9c64cde-348e-45c2-afe9-f5d846ebbe6c"). InnerVolumeSpecName "kube-api-access-zfj4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:08:31.003821 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:31.003770    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "c9c64cde-348e-45c2-afe9-f5d846ebbe6c" (UID: "c9c64cde-348e-45c2-afe9-f5d846ebbe6c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:08:31.004183 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:31.004151    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "c9c64cde-348e-45c2-afe9-f5d846ebbe6c" (UID: "c9c64cde-348e-45c2-afe9-f5d846ebbe6c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:08:31.097848 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:31.097712    2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-csr-dns-cert\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:08:31.097848 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:31.097748    2577 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-cacerts\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:08:31.097848 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:31.097762    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-token\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:08:31.097848 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:31.097804    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfj4z\" (UniqueName: \"kubernetes.io/projected/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-kube-api-access-zfj4z\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:08:31.097848 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:31.097818    2577 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-kubeconfig\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:08:31.097848 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:31.097831    2577 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-local-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:08:31.097848 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:31.097843    2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c9c64cde-348e-45c2-afe9-f5d846ebbe6c-istio-csr-ca-configmap\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:08:31.668317 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:31.668226    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8" event={"ID":"c9c64cde-348e-45c2-afe9-f5d846ebbe6c","Type":"ContainerDied","Data":"3c2a1e0a2528c118f5b5227d404b46d4035c97dc9c7900e0b88b7f8d086a00fb"}
Sep 10 22:08:31.668317 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:31.668253    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"
Sep 10 22:08:31.668317 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:31.668297    2577 scope.go:117] "RemoveContainer" containerID="92c2daa5b0808c8104038022186a736e3999a259b15e11585a3255a939f43fab"
Sep 10 22:08:31.701022 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:31.700993    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"]
Sep 10 22:08:31.706355 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:31.706328    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnjs8"]
Sep 10 22:08:31.849232 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:31.849201    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9c64cde-348e-45c2-afe9-f5d846ebbe6c" path="/var/lib/kubelet/pods/c9c64cde-348e-45c2-afe9-f5d846ebbe6c/volumes"
Sep 10 22:08:32.677346 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:32.677305    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rrr7z" event={"ID":"e8e6ac4f-459f-4139-8feb-85795da91b07","Type":"ContainerStarted","Data":"f712bcae34e7490cbd9b6c3daf1aa119726675ad328d608c9e834a08071e74e1"}
Sep 10 22:08:32.677877 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:32.677457    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rrr7z"
Sep 10 22:08:32.704032 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:32.703961    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rrr7z" podStartSLOduration=1.3358384380000001 podStartE2EDuration="3.703937833s" totalImagesPullingTime="2.368099395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:08:32.703104256 +0000 UTC m=+417.375202178" watchObservedRunningTime="2026-09-10 22:08:32.703937833 +0000 UTC m=+417.376035757"
Sep 10 22:08:33.684159 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:33.684122    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l6xkk" event={"ID":"e45c2274-fc79-486b-a9a1-02867a157683","Type":"ContainerStarted","Data":"e14c005ab3bb220fb1aafbddc5f2589e32feec179f540d3210c6b57574e98fde"}
Sep 10 22:08:33.684533 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:33.684286    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l6xkk"
Sep 10 22:08:33.716872 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:33.716821    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l6xkk" podStartSLOduration=1.748757763 podStartE2EDuration="4.716804437s" totalImagesPullingTime="2.968046674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:08:33.715676214 +0000 UTC m=+418.387774131" watchObservedRunningTime="2026-09-10 22:08:33.716804437 +0000 UTC m=+418.388902355"
Sep 10 22:08:45.987566 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:45.987532    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b65d6f984-hh95x"]
Sep 10 22:08:45.988075 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:45.987891    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9c64cde-348e-45c2-afe9-f5d846ebbe6c" containerName="discovery"
Sep 10 22:08:45.988075 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:45.987904    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9c64cde-348e-45c2-afe9-f5d846ebbe6c" containerName="discovery"
Sep 10 22:08:45.988075 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:45.987961    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9c64cde-348e-45c2-afe9-f5d846ebbe6c" containerName="discovery"
Sep 10 22:08:45.994848 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:45.994818    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.006113 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.006088    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b65d6f984-hh95x"]
Sep 10 22:08:46.136220 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.136184    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3937a68-45f8-4372-95aa-9092b209dfe6-service-ca\") pod \"console-6b65d6f984-hh95x\" (UID: \"d3937a68-45f8-4372-95aa-9092b209dfe6\") " pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.136220 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.136226    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3937a68-45f8-4372-95aa-9092b209dfe6-console-oauth-config\") pod \"console-6b65d6f984-hh95x\" (UID: \"d3937a68-45f8-4372-95aa-9092b209dfe6\") " pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.136453 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.136272    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3937a68-45f8-4372-95aa-9092b209dfe6-console-config\") pod \"console-6b65d6f984-hh95x\" (UID: \"d3937a68-45f8-4372-95aa-9092b209dfe6\") " pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.136453 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.136311    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdn5v\" (UniqueName: \"kubernetes.io/projected/d3937a68-45f8-4372-95aa-9092b209dfe6-kube-api-access-mdn5v\") pod \"console-6b65d6f984-hh95x\" (UID: \"d3937a68-45f8-4372-95aa-9092b209dfe6\") " pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.136453 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.136338    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3937a68-45f8-4372-95aa-9092b209dfe6-console-serving-cert\") pod \"console-6b65d6f984-hh95x\" (UID: \"d3937a68-45f8-4372-95aa-9092b209dfe6\") " pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.136453 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.136369    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3937a68-45f8-4372-95aa-9092b209dfe6-trusted-ca-bundle\") pod \"console-6b65d6f984-hh95x\" (UID: \"d3937a68-45f8-4372-95aa-9092b209dfe6\") " pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.136453 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.136395    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3937a68-45f8-4372-95aa-9092b209dfe6-oauth-serving-cert\") pod \"console-6b65d6f984-hh95x\" (UID: \"d3937a68-45f8-4372-95aa-9092b209dfe6\") " pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.237321 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.237294    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3937a68-45f8-4372-95aa-9092b209dfe6-oauth-serving-cert\") pod \"console-6b65d6f984-hh95x\" (UID: \"d3937a68-45f8-4372-95aa-9092b209dfe6\") " pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.237513 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.237334    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3937a68-45f8-4372-95aa-9092b209dfe6-service-ca\") pod \"console-6b65d6f984-hh95x\" (UID: \"d3937a68-45f8-4372-95aa-9092b209dfe6\") " pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.237513 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.237355    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3937a68-45f8-4372-95aa-9092b209dfe6-console-oauth-config\") pod \"console-6b65d6f984-hh95x\" (UID: \"d3937a68-45f8-4372-95aa-9092b209dfe6\") " pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.237513 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.237393    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3937a68-45f8-4372-95aa-9092b209dfe6-console-config\") pod \"console-6b65d6f984-hh95x\" (UID: \"d3937a68-45f8-4372-95aa-9092b209dfe6\") " pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.237513 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.237413    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdn5v\" (UniqueName: \"kubernetes.io/projected/d3937a68-45f8-4372-95aa-9092b209dfe6-kube-api-access-mdn5v\") pod \"console-6b65d6f984-hh95x\" (UID: \"d3937a68-45f8-4372-95aa-9092b209dfe6\") " pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.237513 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.237450    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3937a68-45f8-4372-95aa-9092b209dfe6-console-serving-cert\") pod \"console-6b65d6f984-hh95x\" (UID: \"d3937a68-45f8-4372-95aa-9092b209dfe6\") " pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.237513 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.237475    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3937a68-45f8-4372-95aa-9092b209dfe6-trusted-ca-bundle\") pod \"console-6b65d6f984-hh95x\" (UID: \"d3937a68-45f8-4372-95aa-9092b209dfe6\") " pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.238244 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.238175    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3937a68-45f8-4372-95aa-9092b209dfe6-service-ca\") pod \"console-6b65d6f984-hh95x\" (UID: \"d3937a68-45f8-4372-95aa-9092b209dfe6\") " pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.238359 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.238256    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3937a68-45f8-4372-95aa-9092b209dfe6-console-config\") pod \"console-6b65d6f984-hh95x\" (UID: \"d3937a68-45f8-4372-95aa-9092b209dfe6\") " pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.238412 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.238355    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3937a68-45f8-4372-95aa-9092b209dfe6-oauth-serving-cert\") pod \"console-6b65d6f984-hh95x\" (UID: \"d3937a68-45f8-4372-95aa-9092b209dfe6\") " pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.238412 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.238385    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3937a68-45f8-4372-95aa-9092b209dfe6-trusted-ca-bundle\") pod \"console-6b65d6f984-hh95x\" (UID: \"d3937a68-45f8-4372-95aa-9092b209dfe6\") " pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.240117 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.240093    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3937a68-45f8-4372-95aa-9092b209dfe6-console-serving-cert\") pod \"console-6b65d6f984-hh95x\" (UID: \"d3937a68-45f8-4372-95aa-9092b209dfe6\") " pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.240193 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.240096    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3937a68-45f8-4372-95aa-9092b209dfe6-console-oauth-config\") pod \"console-6b65d6f984-hh95x\" (UID: \"d3937a68-45f8-4372-95aa-9092b209dfe6\") " pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.245169 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.245147    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdn5v\" (UniqueName: \"kubernetes.io/projected/d3937a68-45f8-4372-95aa-9092b209dfe6-kube-api-access-mdn5v\") pod \"console-6b65d6f984-hh95x\" (UID: \"d3937a68-45f8-4372-95aa-9092b209dfe6\") " pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.305237 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.305212    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:46.612230 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.612141    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b65d6f984-hh95x"]
Sep 10 22:08:46.614493 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:08:46.614460    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3937a68_45f8_4372_95aa_9092b209dfe6.slice/crio-ac9de48035c1d95e10bd291e2fb1dce42d6cb459b821b97e054b7a2948a9a55e WatchSource:0}: Error finding container ac9de48035c1d95e10bd291e2fb1dce42d6cb459b821b97e054b7a2948a9a55e: Status 404 returned error can't find the container with id ac9de48035c1d95e10bd291e2fb1dce42d6cb459b821b97e054b7a2948a9a55e
Sep 10 22:08:46.744429 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:46.744400    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b65d6f984-hh95x" event={"ID":"d3937a68-45f8-4372-95aa-9092b209dfe6","Type":"ContainerStarted","Data":"ac9de48035c1d95e10bd291e2fb1dce42d6cb459b821b97e054b7a2948a9a55e"}
Sep 10 22:08:47.750586 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:47.750553    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b65d6f984-hh95x" event={"ID":"d3937a68-45f8-4372-95aa-9092b209dfe6","Type":"ContainerStarted","Data":"5ad2e6d3088eb259acac9bb0a277fa9a07a0e5dec601c042d55cf53e1d8f5364"}
Sep 10 22:08:56.305595 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:56.305556    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:56.306131 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:56.305623    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:56.310210 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:56.310184    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:56.335164 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:56.335121    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b65d6f984-hh95x" podStartSLOduration=11.335105021 podStartE2EDuration="11.335105021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:08:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:08:47.780953513 +0000 UTC m=+432.453051446" watchObservedRunningTime="2026-09-10 22:08:56.335105021 +0000 UTC m=+441.007202942"
Sep 10 22:08:56.799418 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:56.799388    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b65d6f984-hh95x"
Sep 10 22:08:56.891014 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:08:56.890974    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c6cc445cd-88zxc"]
Sep 10 22:09:03.690181 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:03.690154    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rrr7z"
Sep 10 22:09:04.690771 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:04.690741    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l6xkk"
Sep 10 22:09:21.912239 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:21.912169    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c6cc445cd-88zxc" podUID="a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e" containerName="console" containerID="cri-o://f7813af3446d4e32aa356f8ffa0a8d7f1cf77601d021a14344d48db9fd2b485d" gracePeriod=15
Sep 10 22:09:22.152957 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.152935    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:09:22.244217 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.244133    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-oauth-serving-cert\") pod \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") "
Sep 10 22:09:22.244217 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.244172    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-trusted-ca-bundle\") pod \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") "
Sep 10 22:09:22.244217 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.244209    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-console-oauth-config\") pod \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") "
Sep 10 22:09:22.244490 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.244224    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-console-serving-cert\") pod \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") "
Sep 10 22:09:22.244490 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.244293    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdjmz\" (UniqueName: \"kubernetes.io/projected/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-kube-api-access-bdjmz\") pod \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") "
Sep 10 22:09:22.244490 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.244331    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-service-ca\") pod \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") "
Sep 10 22:09:22.244490 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.244375    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-console-config\") pod \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\" (UID: \"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e\") "
Sep 10 22:09:22.244697 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.244555    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e" (UID: "a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:09:22.244697 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.244644    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e" (UID: "a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:09:22.244697 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.244665    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-oauth-serving-cert\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:09:22.244938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.244714    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-service-ca" (OuterVolumeSpecName: "service-ca") pod "a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e" (UID: "a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:09:22.244938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.244907    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-console-config" (OuterVolumeSpecName: "console-config") pod "a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e" (UID: "a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:09:22.246502 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.246476    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e" (UID: "a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:09:22.247014 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.246993    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e" (UID: "a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:09:22.247087 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.247019    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-kube-api-access-bdjmz" (OuterVolumeSpecName: "kube-api-access-bdjmz") pod "a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e" (UID: "a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e"). InnerVolumeSpecName "kube-api-access-bdjmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:09:22.345468 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.345430    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-trusted-ca-bundle\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:09:22.345468 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.345462    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-console-oauth-config\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:09:22.345468 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.345472    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-console-serving-cert\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:09:22.345699 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.345481    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdjmz\" (UniqueName: \"kubernetes.io/projected/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-kube-api-access-bdjmz\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:09:22.345699 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.345491    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:09:22.345699 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.345499    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e-console-config\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:09:22.927396 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.927348    2577 generic.go:356] "Generic (PLEG): container finished" podID="a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e" containerID="f7813af3446d4e32aa356f8ffa0a8d7f1cf77601d021a14344d48db9fd2b485d" exitCode=0
Sep 10 22:09:22.927901 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.927392    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6cc445cd-88zxc" event={"ID":"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e","Type":"ContainerDied","Data":"f7813af3446d4e32aa356f8ffa0a8d7f1cf77601d021a14344d48db9fd2b485d"}
Sep 10 22:09:22.927901 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.927420    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6cc445cd-88zxc"
Sep 10 22:09:22.927901 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.927456    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6cc445cd-88zxc" event={"ID":"a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e","Type":"ContainerDied","Data":"8d710db9dcd3f45564cd50b1defb84f1d2d9ad3bbb3ad36b9b515a5f978c7767"}
Sep 10 22:09:22.927901 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.927485    2577 scope.go:117] "RemoveContainer" containerID="f7813af3446d4e32aa356f8ffa0a8d7f1cf77601d021a14344d48db9fd2b485d"
Sep 10 22:09:22.937056 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.937040    2577 scope.go:117] "RemoveContainer" containerID="f7813af3446d4e32aa356f8ffa0a8d7f1cf77601d021a14344d48db9fd2b485d"
Sep 10 22:09:22.937333 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:09:22.937314    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7813af3446d4e32aa356f8ffa0a8d7f1cf77601d021a14344d48db9fd2b485d\": container with ID starting with f7813af3446d4e32aa356f8ffa0a8d7f1cf77601d021a14344d48db9fd2b485d not found: ID does not exist" containerID="f7813af3446d4e32aa356f8ffa0a8d7f1cf77601d021a14344d48db9fd2b485d"
Sep 10 22:09:22.937377 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.937342    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7813af3446d4e32aa356f8ffa0a8d7f1cf77601d021a14344d48db9fd2b485d"} err="failed to get container status \"f7813af3446d4e32aa356f8ffa0a8d7f1cf77601d021a14344d48db9fd2b485d\": rpc error: code = NotFound desc = could not find container \"f7813af3446d4e32aa356f8ffa0a8d7f1cf77601d021a14344d48db9fd2b485d\": container with ID starting with f7813af3446d4e32aa356f8ffa0a8d7f1cf77601d021a14344d48db9fd2b485d not found: ID does not exist"
Sep 10 22:09:22.977624 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.977595    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c6cc445cd-88zxc"]
Sep 10 22:09:22.985342 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:22.985317    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c6cc445cd-88zxc"]
Sep 10 22:09:23.847379 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:23.847349    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e" path="/var/lib/kubelet/pods/a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e/volumes"
Sep 10 22:09:26.482618 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.482583    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk"]
Sep 10 22:09:26.483006 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.482943    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e" containerName="console"
Sep 10 22:09:26.483006 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.482955    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e" containerName="console"
Sep 10 22:09:26.483088 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.483010    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9decd3d-d8c2-4b0f-bfe0-4d84f90b753e" containerName="console"
Sep 10 22:09:26.485676 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.485658    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk"
Sep 10 22:09:26.488375 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.488355    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 22:09:26.488934 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.488920    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bb482\""
Sep 10 22:09:26.489009 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.488930    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 22:09:26.495094 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.495072    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk"]
Sep 10 22:09:26.578942 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.578902    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8wl6\" (UniqueName: \"kubernetes.io/projected/c55c8201-5664-4e92-b186-85023e556773-kube-api-access-d8wl6\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk\" (UID: \"c55c8201-5664-4e92-b186-85023e556773\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk"
Sep 10 22:09:26.578942 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.578945    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c55c8201-5664-4e92-b186-85023e556773-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk\" (UID: \"c55c8201-5664-4e92-b186-85023e556773\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk"
Sep 10 22:09:26.579193 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.579025    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c55c8201-5664-4e92-b186-85023e556773-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk\" (UID: \"c55c8201-5664-4e92-b186-85023e556773\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk"
Sep 10 22:09:26.583710 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.583684    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv"]
Sep 10 22:09:26.586002 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.585988    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv"
Sep 10 22:09:26.596851 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.596830    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv"]
Sep 10 22:09:26.679431 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.679396    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c55c8201-5664-4e92-b186-85023e556773-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk\" (UID: \"c55c8201-5664-4e92-b186-85023e556773\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk"
Sep 10 22:09:26.679431 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.679436    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a19840d3-4820-426d-b895-84edc93c678d-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv\" (UID: \"a19840d3-4820-426d-b895-84edc93c678d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv"
Sep 10 22:09:26.679675 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.679489    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a19840d3-4820-426d-b895-84edc93c678d-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv\" (UID: \"a19840d3-4820-426d-b895-84edc93c678d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv"
Sep 10 22:09:26.679675 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.679508    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkj4c\" (UniqueName: \"kubernetes.io/projected/a19840d3-4820-426d-b895-84edc93c678d-kube-api-access-pkj4c\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv\" (UID: \"a19840d3-4820-426d-b895-84edc93c678d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv"
Sep 10 22:09:26.679675 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.679550    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8wl6\" (UniqueName: \"kubernetes.io/projected/c55c8201-5664-4e92-b186-85023e556773-kube-api-access-d8wl6\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk\" (UID: \"c55c8201-5664-4e92-b186-85023e556773\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk"
Sep 10 22:09:26.679675 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.679575    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c55c8201-5664-4e92-b186-85023e556773-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk\" (UID: \"c55c8201-5664-4e92-b186-85023e556773\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk"
Sep 10 22:09:26.679922 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.679868    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c55c8201-5664-4e92-b186-85023e556773-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk\" (UID: \"c55c8201-5664-4e92-b186-85023e556773\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk"
Sep 10 22:09:26.679922 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.679870    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c55c8201-5664-4e92-b186-85023e556773-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk\" (UID: \"c55c8201-5664-4e92-b186-85023e556773\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk"
Sep 10 22:09:26.684645 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.684619    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc"]
Sep 10 22:09:26.687040 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.687022    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc"
Sep 10 22:09:26.691279 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.691257    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8wl6\" (UniqueName: \"kubernetes.io/projected/c55c8201-5664-4e92-b186-85023e556773-kube-api-access-d8wl6\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk\" (UID: \"c55c8201-5664-4e92-b186-85023e556773\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk"
Sep 10 22:09:26.697085 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.697064    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc"]
Sep 10 22:09:26.780894 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.780805    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a19840d3-4820-426d-b895-84edc93c678d-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv\" (UID: \"a19840d3-4820-426d-b895-84edc93c678d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv"
Sep 10 22:09:26.780894 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.780855    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a19840d3-4820-426d-b895-84edc93c678d-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv\" (UID: \"a19840d3-4820-426d-b895-84edc93c678d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv"
Sep 10 22:09:26.780894 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.780877    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkj4c\" (UniqueName: \"kubernetes.io/projected/a19840d3-4820-426d-b895-84edc93c678d-kube-api-access-pkj4c\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv\" (UID: \"a19840d3-4820-426d-b895-84edc93c678d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv"
Sep 10 22:09:26.781109 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.780899    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df0b1538-d1f1-4131-b57d-b32dcc63c88d-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc\" (UID: \"df0b1538-d1f1-4131-b57d-b32dcc63c88d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc"
Sep 10 22:09:26.781109 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.781015    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4v6z\" (UniqueName: \"kubernetes.io/projected/df0b1538-d1f1-4131-b57d-b32dcc63c88d-kube-api-access-q4v6z\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc\" (UID: \"df0b1538-d1f1-4131-b57d-b32dcc63c88d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc"
Sep 10 22:09:26.781109 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.781091    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df0b1538-d1f1-4131-b57d-b32dcc63c88d-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc\" (UID: \"df0b1538-d1f1-4131-b57d-b32dcc63c88d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc"
Sep 10 22:09:26.781243 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.781224    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a19840d3-4820-426d-b895-84edc93c678d-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv\" (UID: \"a19840d3-4820-426d-b895-84edc93c678d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv"
Sep 10 22:09:26.781286 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.781240    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a19840d3-4820-426d-b895-84edc93c678d-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv\" (UID: \"a19840d3-4820-426d-b895-84edc93c678d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv"
Sep 10 22:09:26.789770 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.789733    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9"]
Sep 10 22:09:26.791701 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.791665    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkj4c\" (UniqueName: \"kubernetes.io/projected/a19840d3-4820-426d-b895-84edc93c678d-kube-api-access-pkj4c\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv\" (UID: \"a19840d3-4820-426d-b895-84edc93c678d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv"
Sep 10 22:09:26.792385 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.792368    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9"
Sep 10 22:09:26.795892 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.795872    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk"
Sep 10 22:09:26.801989 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.801967    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9"]
Sep 10 22:09:26.882547 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.882510    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd7fd838-74f8-4eb9-8e93-f02e22b86acf-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9\" (UID: \"dd7fd838-74f8-4eb9-8e93-f02e22b86acf\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9"
Sep 10 22:09:26.882697 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.882556    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd7fd838-74f8-4eb9-8e93-f02e22b86acf-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9\" (UID: \"dd7fd838-74f8-4eb9-8e93-f02e22b86acf\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9"
Sep 10 22:09:26.882697 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.882575    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78kxr\" (UniqueName: \"kubernetes.io/projected/dd7fd838-74f8-4eb9-8e93-f02e22b86acf-kube-api-access-78kxr\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9\" (UID: \"dd7fd838-74f8-4eb9-8e93-f02e22b86acf\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9"
Sep 10 22:09:26.882697 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.882632    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df0b1538-d1f1-4131-b57d-b32dcc63c88d-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc\" (UID: \"df0b1538-d1f1-4131-b57d-b32dcc63c88d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc"
Sep 10 22:09:26.882935 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.882705    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df0b1538-d1f1-4131-b57d-b32dcc63c88d-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc\" (UID: \"df0b1538-d1f1-4131-b57d-b32dcc63c88d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc"
Sep 10 22:09:26.882935 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.882730    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4v6z\" (UniqueName: \"kubernetes.io/projected/df0b1538-d1f1-4131-b57d-b32dcc63c88d-kube-api-access-q4v6z\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc\" (UID: \"df0b1538-d1f1-4131-b57d-b32dcc63c88d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc"
Sep 10 22:09:26.883090 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.883072    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df0b1538-d1f1-4131-b57d-b32dcc63c88d-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc\" (UID: \"df0b1538-d1f1-4131-b57d-b32dcc63c88d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc"
Sep 10 22:09:26.883151 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.883121    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df0b1538-d1f1-4131-b57d-b32dcc63c88d-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc\" (UID: \"df0b1538-d1f1-4131-b57d-b32dcc63c88d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc"
Sep 10 22:09:26.891486 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.891459    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4v6z\" (UniqueName: \"kubernetes.io/projected/df0b1538-d1f1-4131-b57d-b32dcc63c88d-kube-api-access-q4v6z\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc\" (UID: \"df0b1538-d1f1-4131-b57d-b32dcc63c88d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc"
Sep 10 22:09:26.895224 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.895204    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv"
Sep 10 22:09:26.983229 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.983196    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd7fd838-74f8-4eb9-8e93-f02e22b86acf-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9\" (UID: \"dd7fd838-74f8-4eb9-8e93-f02e22b86acf\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9"
Sep 10 22:09:26.983384 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.983248    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd7fd838-74f8-4eb9-8e93-f02e22b86acf-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9\" (UID: \"dd7fd838-74f8-4eb9-8e93-f02e22b86acf\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9"
Sep 10 22:09:26.983384 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.983279    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78kxr\" (UniqueName: \"kubernetes.io/projected/dd7fd838-74f8-4eb9-8e93-f02e22b86acf-kube-api-access-78kxr\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9\" (UID: \"dd7fd838-74f8-4eb9-8e93-f02e22b86acf\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9"
Sep 10 22:09:26.983698 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.983670    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd7fd838-74f8-4eb9-8e93-f02e22b86acf-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9\" (UID: \"dd7fd838-74f8-4eb9-8e93-f02e22b86acf\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9"
Sep 10 22:09:26.983814 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.983694    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd7fd838-74f8-4eb9-8e93-f02e22b86acf-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9\" (UID: \"dd7fd838-74f8-4eb9-8e93-f02e22b86acf\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9"
Sep 10 22:09:26.992529 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:26.992500    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78kxr\" (UniqueName: \"kubernetes.io/projected/dd7fd838-74f8-4eb9-8e93-f02e22b86acf-kube-api-access-78kxr\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9\" (UID: \"dd7fd838-74f8-4eb9-8e93-f02e22b86acf\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9"
Sep 10 22:09:27.003368 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:27.003343    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc"
Sep 10 22:09:27.074283 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:27.074256    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk"]
Sep 10 22:09:27.076904 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:09:27.076873    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc55c8201_5664_4e92_b186_85023e556773.slice/crio-fa930511395d99cc63c61e90d6e8e6fd1ae3166d7d2b26578a0ad423f95037b7 WatchSource:0}: Error finding container fa930511395d99cc63c61e90d6e8e6fd1ae3166d7d2b26578a0ad423f95037b7: Status 404 returned error can't find the container with id fa930511395d99cc63c61e90d6e8e6fd1ae3166d7d2b26578a0ad423f95037b7
Sep 10 22:09:27.125202 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:27.125177    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9"
Sep 10 22:09:27.207071 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:27.207039    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv"]
Sep 10 22:09:27.236743 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:09:27.236711    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda19840d3_4820_426d_b895_84edc93c678d.slice/crio-0b56bec581c4b2f2cc174b1033731dca23225cd1827e81cf71bd06ab589ab22c WatchSource:0}: Error finding container 0b56bec581c4b2f2cc174b1033731dca23225cd1827e81cf71bd06ab589ab22c: Status 404 returned error can't find the container with id 0b56bec581c4b2f2cc174b1033731dca23225cd1827e81cf71bd06ab589ab22c
Sep 10 22:09:27.293931 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:27.293905    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc"]
Sep 10 22:09:27.301137 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:09:27.301111    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf0b1538_d1f1_4131_b57d_b32dcc63c88d.slice/crio-96e16ecac006065382e45e875a6a316ff1c541e9a803ca491ec672923e4efcd5 WatchSource:0}: Error finding container 96e16ecac006065382e45e875a6a316ff1c541e9a803ca491ec672923e4efcd5: Status 404 returned error can't find the container with id 96e16ecac006065382e45e875a6a316ff1c541e9a803ca491ec672923e4efcd5
Sep 10 22:09:27.403203 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:27.403182    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9"]
Sep 10 22:09:27.456575 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:09:27.456547    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd7fd838_74f8_4eb9_8e93_f02e22b86acf.slice/crio-851ced829c7fa4af5544fd1898df1f27bb30ed5be8baa4e0701608f03788d129 WatchSource:0}: Error finding container 851ced829c7fa4af5544fd1898df1f27bb30ed5be8baa4e0701608f03788d129: Status 404 returned error can't find the container with id 851ced829c7fa4af5544fd1898df1f27bb30ed5be8baa4e0701608f03788d129
Sep 10 22:09:27.955062 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:27.955027    2577 generic.go:356] "Generic (PLEG): container finished" podID="dd7fd838-74f8-4eb9-8e93-f02e22b86acf" containerID="f5f7e0642c643839b2f936f99f64460c549bb9aaa3976e6d34b0f3f283ce0821" exitCode=0
Sep 10 22:09:27.955435 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:27.955112    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9" event={"ID":"dd7fd838-74f8-4eb9-8e93-f02e22b86acf","Type":"ContainerDied","Data":"f5f7e0642c643839b2f936f99f64460c549bb9aaa3976e6d34b0f3f283ce0821"}
Sep 10 22:09:27.955435 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:27.955168    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9" event={"ID":"dd7fd838-74f8-4eb9-8e93-f02e22b86acf","Type":"ContainerStarted","Data":"851ced829c7fa4af5544fd1898df1f27bb30ed5be8baa4e0701608f03788d129"}
Sep 10 22:09:27.956733 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:27.956712    2577 generic.go:356] "Generic (PLEG): container finished" podID="c55c8201-5664-4e92-b186-85023e556773" containerID="4119c3affe51a5ca77e86ac395257cac278e0c3d6203344c31686c343aaaa28a" exitCode=0
Sep 10 22:09:27.956837 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:27.956805    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk" event={"ID":"c55c8201-5664-4e92-b186-85023e556773","Type":"ContainerDied","Data":"4119c3affe51a5ca77e86ac395257cac278e0c3d6203344c31686c343aaaa28a"}
Sep 10 22:09:27.956903 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:27.956848    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk" event={"ID":"c55c8201-5664-4e92-b186-85023e556773","Type":"ContainerStarted","Data":"fa930511395d99cc63c61e90d6e8e6fd1ae3166d7d2b26578a0ad423f95037b7"}
Sep 10 22:09:27.958519 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:27.958497    2577 generic.go:356] "Generic (PLEG): container finished" podID="df0b1538-d1f1-4131-b57d-b32dcc63c88d" containerID="180eb1746ceb1b98b64ab14ad1332e9701be13951c1653072b0577d2b27f8fb8" exitCode=0
Sep 10 22:09:27.958597 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:27.958560    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc" event={"ID":"df0b1538-d1f1-4131-b57d-b32dcc63c88d","Type":"ContainerDied","Data":"180eb1746ceb1b98b64ab14ad1332e9701be13951c1653072b0577d2b27f8fb8"}
Sep 10 22:09:27.958597 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:27.958588    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc" event={"ID":"df0b1538-d1f1-4131-b57d-b32dcc63c88d","Type":"ContainerStarted","Data":"96e16ecac006065382e45e875a6a316ff1c541e9a803ca491ec672923e4efcd5"}
Sep 10 22:09:27.960320 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:27.960301    2577 generic.go:356] "Generic (PLEG): container finished" podID="a19840d3-4820-426d-b895-84edc93c678d" containerID="afb3724b5013638bd3a480762d1957334d16591819081df609099f70397f9f55" exitCode=0
Sep 10 22:09:27.960404 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:27.960373    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv" event={"ID":"a19840d3-4820-426d-b895-84edc93c678d","Type":"ContainerDied","Data":"afb3724b5013638bd3a480762d1957334d16591819081df609099f70397f9f55"}
Sep 10 22:09:27.960524 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:27.960405    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv" event={"ID":"a19840d3-4820-426d-b895-84edc93c678d","Type":"ContainerStarted","Data":"0b56bec581c4b2f2cc174b1033731dca23225cd1827e81cf71bd06ab589ab22c"}
Sep 10 22:09:28.968760 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:28.968697    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9" event={"ID":"dd7fd838-74f8-4eb9-8e93-f02e22b86acf","Type":"ContainerStarted","Data":"016ed13b52be4d95828aa86c2071270cf6c4adc5db9e52dd6018198d2e4ddbd7"}
Sep 10 22:09:28.971198 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:28.971157    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk" event={"ID":"c55c8201-5664-4e92-b186-85023e556773","Type":"ContainerStarted","Data":"9ad64be0d7a5e1e48dbb336188875c4f2bf32927859291b5920e6b993079f61d"}
Sep 10 22:09:28.973682 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:28.973657    2577 generic.go:356] "Generic (PLEG): container finished" podID="df0b1538-d1f1-4131-b57d-b32dcc63c88d" containerID="ae60664cc2fdd597f0934958509521c9835f2823270c871af0c0899c42e3fd38" exitCode=0
Sep 10 22:09:28.973834 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:28.973731    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc" event={"ID":"df0b1538-d1f1-4131-b57d-b32dcc63c88d","Type":"ContainerDied","Data":"ae60664cc2fdd597f0934958509521c9835f2823270c871af0c0899c42e3fd38"}
Sep 10 22:09:28.976347 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:28.976321    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv" event={"ID":"a19840d3-4820-426d-b895-84edc93c678d","Type":"ContainerStarted","Data":"6fd29b79924ee5c3c4507a359490c4dc51ed77e497122d73cc8b0b6f6da40695"}
Sep 10 22:09:29.984568 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:29.984528    2577 generic.go:356] "Generic (PLEG): container finished" podID="df0b1538-d1f1-4131-b57d-b32dcc63c88d" containerID="f9134104c7f7f1dd3959c9bb2e8dc8aaa34de42f3fe6944993986fee79464580" exitCode=0
Sep 10 22:09:29.985019 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:29.984612    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc" event={"ID":"df0b1538-d1f1-4131-b57d-b32dcc63c88d","Type":"ContainerDied","Data":"f9134104c7f7f1dd3959c9bb2e8dc8aaa34de42f3fe6944993986fee79464580"}
Sep 10 22:09:29.986466 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:29.986447    2577 generic.go:356] "Generic (PLEG): container finished" podID="a19840d3-4820-426d-b895-84edc93c678d" containerID="6fd29b79924ee5c3c4507a359490c4dc51ed77e497122d73cc8b0b6f6da40695" exitCode=0
Sep 10 22:09:29.986524 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:29.986475    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv" event={"ID":"a19840d3-4820-426d-b895-84edc93c678d","Type":"ContainerDied","Data":"6fd29b79924ee5c3c4507a359490c4dc51ed77e497122d73cc8b0b6f6da40695"}
Sep 10 22:09:29.988485 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:29.988465    2577 generic.go:356] "Generic (PLEG): container finished" podID="dd7fd838-74f8-4eb9-8e93-f02e22b86acf" containerID="016ed13b52be4d95828aa86c2071270cf6c4adc5db9e52dd6018198d2e4ddbd7" exitCode=0
Sep 10 22:09:29.988572 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:29.988527    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9" event={"ID":"dd7fd838-74f8-4eb9-8e93-f02e22b86acf","Type":"ContainerDied","Data":"016ed13b52be4d95828aa86c2071270cf6c4adc5db9e52dd6018198d2e4ddbd7"}
Sep 10 22:09:29.990582 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:29.990560    2577 generic.go:356] "Generic (PLEG): container finished" podID="c55c8201-5664-4e92-b186-85023e556773" containerID="9ad64be0d7a5e1e48dbb336188875c4f2bf32927859291b5920e6b993079f61d" exitCode=0
Sep 10 22:09:29.990655 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:29.990605    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk" event={"ID":"c55c8201-5664-4e92-b186-85023e556773","Type":"ContainerDied","Data":"9ad64be0d7a5e1e48dbb336188875c4f2bf32927859291b5920e6b993079f61d"}
Sep 10 22:09:30.998260 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:30.998226    2577 generic.go:356] "Generic (PLEG): container finished" podID="dd7fd838-74f8-4eb9-8e93-f02e22b86acf" containerID="79762647477fd9ce9c9618213826513a413637e83b5269e756896997d6a36b8d" exitCode=0
Sep 10 22:09:30.998676 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:30.998308    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9" event={"ID":"dd7fd838-74f8-4eb9-8e93-f02e22b86acf","Type":"ContainerDied","Data":"79762647477fd9ce9c9618213826513a413637e83b5269e756896997d6a36b8d"}
Sep 10 22:09:31.000321 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:31.000299    2577 generic.go:356] "Generic (PLEG): container finished" podID="c55c8201-5664-4e92-b186-85023e556773" containerID="5568872778c2c79e7cfca488093d5d1f5bf9538f6f1db7e7ce86d58ca6b626b2" exitCode=0
Sep 10 22:09:31.000412 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:31.000329    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk" event={"ID":"c55c8201-5664-4e92-b186-85023e556773","Type":"ContainerDied","Data":"5568872778c2c79e7cfca488093d5d1f5bf9538f6f1db7e7ce86d58ca6b626b2"}
Sep 10 22:09:31.002568 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:31.002547    2577 generic.go:356] "Generic (PLEG): container finished" podID="a19840d3-4820-426d-b895-84edc93c678d" containerID="d73dc8ce1a5c49a70bad36f07b5cd68e5cc58f4efdeed51b6cd587c2bed00d1a" exitCode=0
Sep 10 22:09:31.002694 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:31.002626    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv" event={"ID":"a19840d3-4820-426d-b895-84edc93c678d","Type":"ContainerDied","Data":"d73dc8ce1a5c49a70bad36f07b5cd68e5cc58f4efdeed51b6cd587c2bed00d1a"}
Sep 10 22:09:31.142298 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:31.142270    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc"
Sep 10 22:09:31.217811 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:31.217752    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df0b1538-d1f1-4131-b57d-b32dcc63c88d-bundle\") pod \"df0b1538-d1f1-4131-b57d-b32dcc63c88d\" (UID: \"df0b1538-d1f1-4131-b57d-b32dcc63c88d\") "
Sep 10 22:09:31.217811 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:31.217828    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df0b1538-d1f1-4131-b57d-b32dcc63c88d-util\") pod \"df0b1538-d1f1-4131-b57d-b32dcc63c88d\" (UID: \"df0b1538-d1f1-4131-b57d-b32dcc63c88d\") "
Sep 10 22:09:31.218073 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:31.217890    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4v6z\" (UniqueName: \"kubernetes.io/projected/df0b1538-d1f1-4131-b57d-b32dcc63c88d-kube-api-access-q4v6z\") pod \"df0b1538-d1f1-4131-b57d-b32dcc63c88d\" (UID: \"df0b1538-d1f1-4131-b57d-b32dcc63c88d\") "
Sep 10 22:09:31.218291 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:31.218268    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df0b1538-d1f1-4131-b57d-b32dcc63c88d-bundle" (OuterVolumeSpecName: "bundle") pod "df0b1538-d1f1-4131-b57d-b32dcc63c88d" (UID: "df0b1538-d1f1-4131-b57d-b32dcc63c88d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:09:31.220165 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:31.220136    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df0b1538-d1f1-4131-b57d-b32dcc63c88d-kube-api-access-q4v6z" (OuterVolumeSpecName: "kube-api-access-q4v6z") pod "df0b1538-d1f1-4131-b57d-b32dcc63c88d" (UID: "df0b1538-d1f1-4131-b57d-b32dcc63c88d"). InnerVolumeSpecName "kube-api-access-q4v6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:09:31.224916 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:31.224890    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df0b1538-d1f1-4131-b57d-b32dcc63c88d-util" (OuterVolumeSpecName: "util") pod "df0b1538-d1f1-4131-b57d-b32dcc63c88d" (UID: "df0b1538-d1f1-4131-b57d-b32dcc63c88d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:09:31.318888 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:31.318856    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4v6z\" (UniqueName: \"kubernetes.io/projected/df0b1538-d1f1-4131-b57d-b32dcc63c88d-kube-api-access-q4v6z\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:09:31.318888 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:31.318880    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df0b1538-d1f1-4131-b57d-b32dcc63c88d-bundle\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:09:31.318888 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:31.318890    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df0b1538-d1f1-4131-b57d-b32dcc63c88d-util\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:09:32.013528 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.013499    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc"
Sep 10 22:09:32.013935 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.013532    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xblzc" event={"ID":"df0b1538-d1f1-4131-b57d-b32dcc63c88d","Type":"ContainerDied","Data":"96e16ecac006065382e45e875a6a316ff1c541e9a803ca491ec672923e4efcd5"}
Sep 10 22:09:32.013935 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.013584    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96e16ecac006065382e45e875a6a316ff1c541e9a803ca491ec672923e4efcd5"
Sep 10 22:09:32.155439 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.155412    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9"
Sep 10 22:09:32.195799 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.195750    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv"
Sep 10 22:09:32.199664 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.199643    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk"
Sep 10 22:09:32.328428 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.328394    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8wl6\" (UniqueName: \"kubernetes.io/projected/c55c8201-5664-4e92-b186-85023e556773-kube-api-access-d8wl6\") pod \"c55c8201-5664-4e92-b186-85023e556773\" (UID: \"c55c8201-5664-4e92-b186-85023e556773\") "
Sep 10 22:09:32.328428 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.328435    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a19840d3-4820-426d-b895-84edc93c678d-bundle\") pod \"a19840d3-4820-426d-b895-84edc93c678d\" (UID: \"a19840d3-4820-426d-b895-84edc93c678d\") "
Sep 10 22:09:32.328671 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.328456    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkj4c\" (UniqueName: \"kubernetes.io/projected/a19840d3-4820-426d-b895-84edc93c678d-kube-api-access-pkj4c\") pod \"a19840d3-4820-426d-b895-84edc93c678d\" (UID: \"a19840d3-4820-426d-b895-84edc93c678d\") "
Sep 10 22:09:32.328671 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.328489    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c55c8201-5664-4e92-b186-85023e556773-util\") pod \"c55c8201-5664-4e92-b186-85023e556773\" (UID: \"c55c8201-5664-4e92-b186-85023e556773\") "
Sep 10 22:09:32.328671 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.328518    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a19840d3-4820-426d-b895-84edc93c678d-util\") pod \"a19840d3-4820-426d-b895-84edc93c678d\" (UID: \"a19840d3-4820-426d-b895-84edc93c678d\") "
Sep 10 22:09:32.328671 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.328541    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd7fd838-74f8-4eb9-8e93-f02e22b86acf-util\") pod \"dd7fd838-74f8-4eb9-8e93-f02e22b86acf\" (UID: \"dd7fd838-74f8-4eb9-8e93-f02e22b86acf\") "
Sep 10 22:09:32.328671 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.328571    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd7fd838-74f8-4eb9-8e93-f02e22b86acf-bundle\") pod \"dd7fd838-74f8-4eb9-8e93-f02e22b86acf\" (UID: \"dd7fd838-74f8-4eb9-8e93-f02e22b86acf\") "
Sep 10 22:09:32.328671 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.328657    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78kxr\" (UniqueName: \"kubernetes.io/projected/dd7fd838-74f8-4eb9-8e93-f02e22b86acf-kube-api-access-78kxr\") pod \"dd7fd838-74f8-4eb9-8e93-f02e22b86acf\" (UID: \"dd7fd838-74f8-4eb9-8e93-f02e22b86acf\") "
Sep 10 22:09:32.328996 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.328703    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c55c8201-5664-4e92-b186-85023e556773-bundle\") pod \"c55c8201-5664-4e92-b186-85023e556773\" (UID: \"c55c8201-5664-4e92-b186-85023e556773\") "
Sep 10 22:09:32.329445 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.329413    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a19840d3-4820-426d-b895-84edc93c678d-bundle" (OuterVolumeSpecName: "bundle") pod "a19840d3-4820-426d-b895-84edc93c678d" (UID: "a19840d3-4820-426d-b895-84edc93c678d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:09:32.329636 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.329609    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c55c8201-5664-4e92-b186-85023e556773-bundle" (OuterVolumeSpecName: "bundle") pod "c55c8201-5664-4e92-b186-85023e556773" (UID: "c55c8201-5664-4e92-b186-85023e556773"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:09:32.329903 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.329884    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd7fd838-74f8-4eb9-8e93-f02e22b86acf-bundle" (OuterVolumeSpecName: "bundle") pod "dd7fd838-74f8-4eb9-8e93-f02e22b86acf" (UID: "dd7fd838-74f8-4eb9-8e93-f02e22b86acf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:09:32.330964 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.330935    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c55c8201-5664-4e92-b186-85023e556773-kube-api-access-d8wl6" (OuterVolumeSpecName: "kube-api-access-d8wl6") pod "c55c8201-5664-4e92-b186-85023e556773" (UID: "c55c8201-5664-4e92-b186-85023e556773"). InnerVolumeSpecName "kube-api-access-d8wl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:09:32.331049 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.330976    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a19840d3-4820-426d-b895-84edc93c678d-kube-api-access-pkj4c" (OuterVolumeSpecName: "kube-api-access-pkj4c") pod "a19840d3-4820-426d-b895-84edc93c678d" (UID: "a19840d3-4820-426d-b895-84edc93c678d"). InnerVolumeSpecName "kube-api-access-pkj4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:09:32.331809 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.331767    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd7fd838-74f8-4eb9-8e93-f02e22b86acf-kube-api-access-78kxr" (OuterVolumeSpecName: "kube-api-access-78kxr") pod "dd7fd838-74f8-4eb9-8e93-f02e22b86acf" (UID: "dd7fd838-74f8-4eb9-8e93-f02e22b86acf"). InnerVolumeSpecName "kube-api-access-78kxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:09:32.335311 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.335288    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd7fd838-74f8-4eb9-8e93-f02e22b86acf-util" (OuterVolumeSpecName: "util") pod "dd7fd838-74f8-4eb9-8e93-f02e22b86acf" (UID: "dd7fd838-74f8-4eb9-8e93-f02e22b86acf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:09:32.335409 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.335390    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a19840d3-4820-426d-b895-84edc93c678d-util" (OuterVolumeSpecName: "util") pod "a19840d3-4820-426d-b895-84edc93c678d" (UID: "a19840d3-4820-426d-b895-84edc93c678d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:09:32.429641 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.429607    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78kxr\" (UniqueName: \"kubernetes.io/projected/dd7fd838-74f8-4eb9-8e93-f02e22b86acf-kube-api-access-78kxr\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:09:32.429641 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.429639    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c55c8201-5664-4e92-b186-85023e556773-bundle\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:09:32.429853 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.429650    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8wl6\" (UniqueName: \"kubernetes.io/projected/c55c8201-5664-4e92-b186-85023e556773-kube-api-access-d8wl6\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:09:32.429853 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.429659    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a19840d3-4820-426d-b895-84edc93c678d-bundle\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:09:32.429853 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.429668    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkj4c\" (UniqueName: \"kubernetes.io/projected/a19840d3-4820-426d-b895-84edc93c678d-kube-api-access-pkj4c\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:09:32.429853 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.429676    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a19840d3-4820-426d-b895-84edc93c678d-util\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:09:32.429853 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.429684    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd7fd838-74f8-4eb9-8e93-f02e22b86acf-util\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:09:32.429853 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.429691    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd7fd838-74f8-4eb9-8e93-f02e22b86acf-bundle\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:09:32.488829 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.488793    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c55c8201-5664-4e92-b186-85023e556773-util" (OuterVolumeSpecName: "util") pod "c55c8201-5664-4e92-b186-85023e556773" (UID: "c55c8201-5664-4e92-b186-85023e556773"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:09:32.530407 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:32.530380    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c55c8201-5664-4e92-b186-85023e556773-util\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:09:33.021414 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:33.021382    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9" event={"ID":"dd7fd838-74f8-4eb9-8e93-f02e22b86acf","Type":"ContainerDied","Data":"851ced829c7fa4af5544fd1898df1f27bb30ed5be8baa4e0701608f03788d129"}
Sep 10 22:09:33.021857 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:33.021434    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="851ced829c7fa4af5544fd1898df1f27bb30ed5be8baa4e0701608f03788d129"
Sep 10 22:09:33.021857 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:33.021395    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hcxk9"
Sep 10 22:09:33.023514 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:33.023487    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk" event={"ID":"c55c8201-5664-4e92-b186-85023e556773","Type":"ContainerDied","Data":"fa930511395d99cc63c61e90d6e8e6fd1ae3166d7d2b26578a0ad423f95037b7"}
Sep 10 22:09:33.023653 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:33.023529    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa930511395d99cc63c61e90d6e8e6fd1ae3166d7d2b26578a0ad423f95037b7"
Sep 10 22:09:33.023653 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:33.023495    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awjqgk"
Sep 10 22:09:33.025689 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:33.025665    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv" event={"ID":"a19840d3-4820-426d-b895-84edc93c678d","Type":"ContainerDied","Data":"0b56bec581c4b2f2cc174b1033731dca23225cd1827e81cf71bd06ab589ab22c"}
Sep 10 22:09:33.025794 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:33.025690    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c72xtv"
Sep 10 22:09:33.025794 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:33.025703    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b56bec581c4b2f2cc174b1033731dca23225cd1827e81cf71bd06ab589ab22c"
Sep 10 22:09:40.164216 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164179    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"]
Sep 10 22:09:40.164594 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164555    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df0b1538-d1f1-4131-b57d-b32dcc63c88d" containerName="pull"
Sep 10 22:09:40.164594 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164568    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="df0b1538-d1f1-4131-b57d-b32dcc63c88d" containerName="pull"
Sep 10 22:09:40.164594 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164576    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c55c8201-5664-4e92-b186-85023e556773" containerName="extract"
Sep 10 22:09:40.164594 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164581    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55c8201-5664-4e92-b186-85023e556773" containerName="extract"
Sep 10 22:09:40.164594 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164589    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd7fd838-74f8-4eb9-8e93-f02e22b86acf" containerName="util"
Sep 10 22:09:40.164745 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164597    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd7fd838-74f8-4eb9-8e93-f02e22b86acf" containerName="util"
Sep 10 22:09:40.164745 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164614    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df0b1538-d1f1-4131-b57d-b32dcc63c88d" containerName="util"
Sep 10 22:09:40.164745 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164619    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="df0b1538-d1f1-4131-b57d-b32dcc63c88d" containerName="util"
Sep 10 22:09:40.164745 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164627    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd7fd838-74f8-4eb9-8e93-f02e22b86acf" containerName="extract"
Sep 10 22:09:40.164745 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164632    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd7fd838-74f8-4eb9-8e93-f02e22b86acf" containerName="extract"
Sep 10 22:09:40.164745 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164641    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c55c8201-5664-4e92-b186-85023e556773" containerName="util"
Sep 10 22:09:40.164745 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164646    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55c8201-5664-4e92-b186-85023e556773" containerName="util"
Sep 10 22:09:40.164745 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164654    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c55c8201-5664-4e92-b186-85023e556773" containerName="pull"
Sep 10 22:09:40.164745 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164659    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55c8201-5664-4e92-b186-85023e556773" containerName="pull"
Sep 10 22:09:40.164745 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164664    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd7fd838-74f8-4eb9-8e93-f02e22b86acf" containerName="pull"
Sep 10 22:09:40.164745 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164669    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd7fd838-74f8-4eb9-8e93-f02e22b86acf" containerName="pull"
Sep 10 22:09:40.164745 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164676    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a19840d3-4820-426d-b895-84edc93c678d" containerName="util"
Sep 10 22:09:40.164745 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164685    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a19840d3-4820-426d-b895-84edc93c678d" containerName="util"
Sep 10 22:09:40.164745 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164693    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df0b1538-d1f1-4131-b57d-b32dcc63c88d" containerName="extract"
Sep 10 22:09:40.164745 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164698    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="df0b1538-d1f1-4131-b57d-b32dcc63c88d" containerName="extract"
Sep 10 22:09:40.164745 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164703    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a19840d3-4820-426d-b895-84edc93c678d" containerName="extract"
Sep 10 22:09:40.164745 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164708    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a19840d3-4820-426d-b895-84edc93c678d" containerName="extract"
Sep 10 22:09:40.164745 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164713    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a19840d3-4820-426d-b895-84edc93c678d" containerName="pull"
Sep 10 22:09:40.164745 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164719    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a19840d3-4820-426d-b895-84edc93c678d" containerName="pull"
Sep 10 22:09:40.165346 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164771    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="df0b1538-d1f1-4131-b57d-b32dcc63c88d" containerName="extract"
Sep 10 22:09:40.165346 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164799    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a19840d3-4820-426d-b895-84edc93c678d" containerName="extract"
Sep 10 22:09:40.165346 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164806    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c55c8201-5664-4e92-b186-85023e556773" containerName="extract"
Sep 10 22:09:40.165346 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.164814    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd7fd838-74f8-4eb9-8e93-f02e22b86acf" containerName="extract"
Sep 10 22:09:40.167436 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.167421    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"
Sep 10 22:09:40.171532 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.171503    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 22:09:40.171907 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.171874    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 22:09:40.172168 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.172152    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6bd9z\""
Sep 10 22:09:40.185960 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.185934    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"]
Sep 10 22:09:40.297890 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.297864    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87rbj\" (UniqueName: \"kubernetes.io/projected/f66db47e-af90-4869-9390-3fbee3f4ef8f-kube-api-access-87rbj\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qs4kr\" (UID: \"f66db47e-af90-4869-9390-3fbee3f4ef8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"
Sep 10 22:09:40.298039 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.297926    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f66db47e-af90-4869-9390-3fbee3f4ef8f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qs4kr\" (UID: \"f66db47e-af90-4869-9390-3fbee3f4ef8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"
Sep 10 22:09:40.399091 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.399065    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87rbj\" (UniqueName: \"kubernetes.io/projected/f66db47e-af90-4869-9390-3fbee3f4ef8f-kube-api-access-87rbj\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qs4kr\" (UID: \"f66db47e-af90-4869-9390-3fbee3f4ef8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"
Sep 10 22:09:40.399257 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.399121    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f66db47e-af90-4869-9390-3fbee3f4ef8f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qs4kr\" (UID: \"f66db47e-af90-4869-9390-3fbee3f4ef8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"
Sep 10 22:09:40.399496 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.399479    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f66db47e-af90-4869-9390-3fbee3f4ef8f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qs4kr\" (UID: \"f66db47e-af90-4869-9390-3fbee3f4ef8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"
Sep 10 22:09:40.415977 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.415907    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87rbj\" (UniqueName: \"kubernetes.io/projected/f66db47e-af90-4869-9390-3fbee3f4ef8f-kube-api-access-87rbj\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qs4kr\" (UID: \"f66db47e-af90-4869-9390-3fbee3f4ef8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"
Sep 10 22:09:40.477814 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.477768    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"
Sep 10 22:09:40.770467 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:40.770444    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"]
Sep 10 22:09:40.772970 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:09:40.772943    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf66db47e_af90_4869_9390_3fbee3f4ef8f.slice/crio-735b43790b025eed8d25d8dd32d6b137c03388cc73e495018027287b5cb59b65 WatchSource:0}: Error finding container 735b43790b025eed8d25d8dd32d6b137c03388cc73e495018027287b5cb59b65: Status 404 returned error can't find the container with id 735b43790b025eed8d25d8dd32d6b137c03388cc73e495018027287b5cb59b65
Sep 10 22:09:41.067671 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:41.067587    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr" event={"ID":"f66db47e-af90-4869-9390-3fbee3f4ef8f","Type":"ContainerStarted","Data":"735b43790b025eed8d25d8dd32d6b137c03388cc73e495018027287b5cb59b65"}
Sep 10 22:09:42.647342 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:42.647308    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-hqtr4"]
Sep 10 22:09:42.652835 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:42.652805    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-hqtr4"
Sep 10 22:09:42.655570 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:42.655542    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-b2ln8\""
Sep 10 22:09:42.665845 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:42.665819    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-hqtr4"]
Sep 10 22:09:42.720916 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:42.720879    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6rjb\" (UniqueName: \"kubernetes.io/projected/0c3e9139-151c-435b-89ea-cbd91c8c0b95-kube-api-access-w6rjb\") pod \"authorino-operator-76b478bd78-hqtr4\" (UID: \"0c3e9139-151c-435b-89ea-cbd91c8c0b95\") " pod="kuadrant-system/authorino-operator-76b478bd78-hqtr4"
Sep 10 22:09:42.821559 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:42.821419    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6rjb\" (UniqueName: \"kubernetes.io/projected/0c3e9139-151c-435b-89ea-cbd91c8c0b95-kube-api-access-w6rjb\") pod \"authorino-operator-76b478bd78-hqtr4\" (UID: \"0c3e9139-151c-435b-89ea-cbd91c8c0b95\") " pod="kuadrant-system/authorino-operator-76b478bd78-hqtr4"
Sep 10 22:09:42.831583 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:42.831556    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6rjb\" (UniqueName: \"kubernetes.io/projected/0c3e9139-151c-435b-89ea-cbd91c8c0b95-kube-api-access-w6rjb\") pod \"authorino-operator-76b478bd78-hqtr4\" (UID: \"0c3e9139-151c-435b-89ea-cbd91c8c0b95\") " pod="kuadrant-system/authorino-operator-76b478bd78-hqtr4"
Sep 10 22:09:42.970072 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:42.969989    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-hqtr4"
Sep 10 22:09:43.545813 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:43.545770    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-hqtr4"]
Sep 10 22:09:43.548265 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:09:43.548229    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c3e9139_151c_435b_89ea_cbd91c8c0b95.slice/crio-c93aa231768c8eaff08cba29d77b1ea258af90c2860d4cbb038ce99cfaa5b50e WatchSource:0}: Error finding container c93aa231768c8eaff08cba29d77b1ea258af90c2860d4cbb038ce99cfaa5b50e: Status 404 returned error can't find the container with id c93aa231768c8eaff08cba29d77b1ea258af90c2860d4cbb038ce99cfaa5b50e
Sep 10 22:09:44.088593 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:44.088554    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-hqtr4" event={"ID":"0c3e9139-151c-435b-89ea-cbd91c8c0b95","Type":"ContainerStarted","Data":"c93aa231768c8eaff08cba29d77b1ea258af90c2860d4cbb038ce99cfaa5b50e"}
Sep 10 22:09:44.735591 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:44.735553    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2dknf"]
Sep 10 22:09:44.738274 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:44.738242    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2dknf"
Sep 10 22:09:44.741017 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:44.740988    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qdgb2\""
Sep 10 22:09:44.741165 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:44.741065    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 10 22:09:44.759300 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:44.759271    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2dknf"]
Sep 10 22:09:44.835616 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:44.835582    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk9x8\" (UniqueName: \"kubernetes.io/projected/1d948980-c7bc-4da7-9003-6987475c56f0-kube-api-access-hk9x8\") pod \"dns-operator-controller-manager-7b84cd7c9c-2dknf\" (UID: \"1d948980-c7bc-4da7-9003-6987475c56f0\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2dknf"
Sep 10 22:09:44.937347 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:44.937163    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk9x8\" (UniqueName: \"kubernetes.io/projected/1d948980-c7bc-4da7-9003-6987475c56f0-kube-api-access-hk9x8\") pod \"dns-operator-controller-manager-7b84cd7c9c-2dknf\" (UID: \"1d948980-c7bc-4da7-9003-6987475c56f0\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2dknf"
Sep 10 22:09:44.952640 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:44.952606    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk9x8\" (UniqueName: \"kubernetes.io/projected/1d948980-c7bc-4da7-9003-6987475c56f0-kube-api-access-hk9x8\") pod \"dns-operator-controller-manager-7b84cd7c9c-2dknf\" (UID: \"1d948980-c7bc-4da7-9003-6987475c56f0\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2dknf"
Sep 10 22:09:45.052357 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:45.052261    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2dknf"
Sep 10 22:09:45.097230 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:45.097188    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr" event={"ID":"f66db47e-af90-4869-9390-3fbee3f4ef8f","Type":"ContainerStarted","Data":"3f8e6909a544e89112e23f7ad2eb1a40aca4a3fb19f2f5ed410f92734b51bd3d"}
Sep 10 22:09:45.097711 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:45.097285    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"
Sep 10 22:09:45.138040 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:45.137952    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr" podStartSLOduration=1.042342852 podStartE2EDuration="5.137933803s" totalImagesPullingTime="4.095590951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:09:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:09:45.135114289 +0000 UTC m=+489.807212210" watchObservedRunningTime="2026-09-10 22:09:45.137933803 +0000 UTC m=+489.810031725"
Sep 10 22:09:45.340440 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:45.340411    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2dknf"]
Sep 10 22:09:45.493357 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:09:45.493322    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d948980_c7bc_4da7_9003_6987475c56f0.slice/crio-fd7d325a363ceebe46a5e02e5ff9bd4b76050e82241fd7c6c8b829a951fdf5b4 WatchSource:0}: Error finding container fd7d325a363ceebe46a5e02e5ff9bd4b76050e82241fd7c6c8b829a951fdf5b4: Status 404 returned error can't find the container with id fd7d325a363ceebe46a5e02e5ff9bd4b76050e82241fd7c6c8b829a951fdf5b4
Sep 10 22:09:46.105623 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:46.105581    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-hqtr4" event={"ID":"0c3e9139-151c-435b-89ea-cbd91c8c0b95","Type":"ContainerStarted","Data":"2e506d812c1c60c011e1175fb39351d072099f8d1b64a0bce9521ef942669698"}
Sep 10 22:09:46.106126 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:46.105688    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-hqtr4"
Sep 10 22:09:46.107321 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:46.107294    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2dknf" event={"ID":"1d948980-c7bc-4da7-9003-6987475c56f0","Type":"ContainerStarted","Data":"fd7d325a363ceebe46a5e02e5ff9bd4b76050e82241fd7c6c8b829a951fdf5b4"}
Sep 10 22:09:46.124694 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:46.124638    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-hqtr4" podStartSLOduration=2.152949272 podStartE2EDuration="4.124618504s" totalImagesPullingTime="1.971669232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:09:46.123071575 +0000 UTC m=+490.795169496" watchObservedRunningTime="2026-09-10 22:09:46.124618504 +0000 UTC m=+490.796716426"
Sep 10 22:09:47.044200 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:47.044166    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29"]
Sep 10 22:09:47.046636 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:47.046612    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29"
Sep 10 22:09:47.049657 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:47.049637    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-cq656\""
Sep 10 22:09:47.055730 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:47.055709    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmrmv\" (UniqueName: \"kubernetes.io/projected/0b5e7d2c-1b57-471d-b1c4-30f73de62ebe-kube-api-access-kmrmv\") pod \"limitador-operator-controller-manager-74495c69f8-xhp29\" (UID: \"0b5e7d2c-1b57-471d-b1c4-30f73de62ebe\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29"
Sep 10 22:09:47.077568 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:47.077543    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29"]
Sep 10 22:09:47.115373 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:47.115343    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2dknf" event={"ID":"1d948980-c7bc-4da7-9003-6987475c56f0","Type":"ContainerStarted","Data":"bc50b173f4c49c24a7b10a311f5133427f367c6258cd8450b20336f9442df78a"}
Sep 10 22:09:47.115737 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:47.115409    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2dknf"
Sep 10 22:09:47.145770 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:47.145727    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2dknf" podStartSLOduration=1.765808163 podStartE2EDuration="3.145708473s" totalImagesPullingTime="1.37990031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:09:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:09:47.143400182 +0000 UTC m=+491.815498093" watchObservedRunningTime="2026-09-10 22:09:47.145708473 +0000 UTC m=+491.817806394"
Sep 10 22:09:47.156303 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:47.156268    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmrmv\" (UniqueName: \"kubernetes.io/projected/0b5e7d2c-1b57-471d-b1c4-30f73de62ebe-kube-api-access-kmrmv\") pod \"limitador-operator-controller-manager-74495c69f8-xhp29\" (UID: \"0b5e7d2c-1b57-471d-b1c4-30f73de62ebe\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29"
Sep 10 22:09:47.167490 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:47.167450    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmrmv\" (UniqueName: \"kubernetes.io/projected/0b5e7d2c-1b57-471d-b1c4-30f73de62ebe-kube-api-access-kmrmv\") pod \"limitador-operator-controller-manager-74495c69f8-xhp29\" (UID: \"0b5e7d2c-1b57-471d-b1c4-30f73de62ebe\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29"
Sep 10 22:09:47.360182 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:47.360146    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29"
Sep 10 22:09:47.634755 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:47.634729    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29"]
Sep 10 22:09:47.636700 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:09:47.636668    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b5e7d2c_1b57_471d_b1c4_30f73de62ebe.slice/crio-882963b209690e0ac56b966d46e109b0382c488d1c41013ddce33920dfeb68fb WatchSource:0}: Error finding container 882963b209690e0ac56b966d46e109b0382c488d1c41013ddce33920dfeb68fb: Status 404 returned error can't find the container with id 882963b209690e0ac56b966d46e109b0382c488d1c41013ddce33920dfeb68fb
Sep 10 22:09:48.021299 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:48.021260    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-8nsf6"]
Sep 10 22:09:48.024068 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:48.024050    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8nsf6"
Sep 10 22:09:48.026359 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:48.026231    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 10 22:09:48.026359 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:48.026243    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6lckd\""
Sep 10 22:09:48.026359 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:48.026243    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 10 22:09:48.035263 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:48.035241    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-8nsf6"]
Sep 10 22:09:48.064424 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:48.064386    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/600c6543-db1d-4afe-8cb0-c41896db136c-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-8nsf6\" (UID: \"600c6543-db1d-4afe-8cb0-c41896db136c\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8nsf6"
Sep 10 22:09:48.064591 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:48.064438    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/600c6543-db1d-4afe-8cb0-c41896db136c-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-8nsf6\" (UID: \"600c6543-db1d-4afe-8cb0-c41896db136c\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8nsf6"
Sep 10 22:09:48.064591 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:48.064481    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9s94\" (UniqueName: \"kubernetes.io/projected/600c6543-db1d-4afe-8cb0-c41896db136c-kube-api-access-h9s94\") pod \"kuadrant-console-plugin-fbdd4f445-8nsf6\" (UID: \"600c6543-db1d-4afe-8cb0-c41896db136c\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8nsf6"
Sep 10 22:09:48.125104 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:48.125064    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29" event={"ID":"0b5e7d2c-1b57-471d-b1c4-30f73de62ebe","Type":"ContainerStarted","Data":"882963b209690e0ac56b966d46e109b0382c488d1c41013ddce33920dfeb68fb"}
Sep 10 22:09:48.165577 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:48.165543    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/600c6543-db1d-4afe-8cb0-c41896db136c-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-8nsf6\" (UID: \"600c6543-db1d-4afe-8cb0-c41896db136c\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8nsf6"
Sep 10 22:09:48.165728 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:48.165617    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9s94\" (UniqueName: \"kubernetes.io/projected/600c6543-db1d-4afe-8cb0-c41896db136c-kube-api-access-h9s94\") pod \"kuadrant-console-plugin-fbdd4f445-8nsf6\" (UID: \"600c6543-db1d-4afe-8cb0-c41896db136c\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8nsf6"
Sep 10 22:09:48.165728 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:48.165658    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/600c6543-db1d-4afe-8cb0-c41896db136c-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-8nsf6\" (UID: \"600c6543-db1d-4afe-8cb0-c41896db136c\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8nsf6"
Sep 10 22:09:48.166298 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:48.166266    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/600c6543-db1d-4afe-8cb0-c41896db136c-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-8nsf6\" (UID: \"600c6543-db1d-4afe-8cb0-c41896db136c\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8nsf6"
Sep 10 22:09:48.168178 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:48.168155    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/600c6543-db1d-4afe-8cb0-c41896db136c-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-8nsf6\" (UID: \"600c6543-db1d-4afe-8cb0-c41896db136c\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8nsf6"
Sep 10 22:09:48.173503 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:48.173481    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9s94\" (UniqueName: \"kubernetes.io/projected/600c6543-db1d-4afe-8cb0-c41896db136c-kube-api-access-h9s94\") pod \"kuadrant-console-plugin-fbdd4f445-8nsf6\" (UID: \"600c6543-db1d-4afe-8cb0-c41896db136c\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8nsf6"
Sep 10 22:09:48.334905 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:48.334811    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8nsf6"
Sep 10 22:09:48.608106 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:48.608023    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-8nsf6"]
Sep 10 22:09:48.612087 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:09:48.612059    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod600c6543_db1d_4afe_8cb0_c41896db136c.slice/crio-36452518f51efce22a0737ff0c35649997ffccd47afa2ec468929fd765da3852 WatchSource:0}: Error finding container 36452518f51efce22a0737ff0c35649997ffccd47afa2ec468929fd765da3852: Status 404 returned error can't find the container with id 36452518f51efce22a0737ff0c35649997ffccd47afa2ec468929fd765da3852
Sep 10 22:09:49.132177 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:49.132137    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8nsf6" event={"ID":"600c6543-db1d-4afe-8cb0-c41896db136c","Type":"ContainerStarted","Data":"36452518f51efce22a0737ff0c35649997ffccd47afa2ec468929fd765da3852"}
Sep 10 22:09:50.143441 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:50.143402    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29" event={"ID":"0b5e7d2c-1b57-471d-b1c4-30f73de62ebe","Type":"ContainerStarted","Data":"7a3b65cd4c743a201d8dfcda5b3ce171967438d83b13c7ef80e58b74c7b579ec"}
Sep 10 22:09:50.144255 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:50.144225    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29"
Sep 10 22:09:50.178886 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:50.177999    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29" podStartSLOduration=1.6737154269999999 podStartE2EDuration="3.17797731s" totalImagesPullingTime="1.504261883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:09:50.17444215 +0000 UTC m=+494.846540071" watchObservedRunningTime="2026-09-10 22:09:50.17797731 +0000 UTC m=+494.850075234"
Sep 10 22:09:54.169410 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:54.169374    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8nsf6" event={"ID":"600c6543-db1d-4afe-8cb0-c41896db136c","Type":"ContainerStarted","Data":"792fe1f9474b628dd2db2ae75513186ce14e551f86b119777a8420104241f235"}
Sep 10 22:09:54.185177 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:54.185123    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-8nsf6" podStartSLOduration=2.226739882 podStartE2EDuration="7.185106137s" totalImagesPullingTime="4.958366255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:09:54.18363897 +0000 UTC m=+498.855736890" watchObservedRunningTime="2026-09-10 22:09:54.185106137 +0000 UTC m=+498.857204102"
Sep 10 22:09:56.109757 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:56.109722    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"
Sep 10 22:09:57.117526 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:57.117495    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-hqtr4"
Sep 10 22:09:58.172937 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.172903    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"]
Sep 10 22:09:58.173327 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.173079    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr" podUID="f66db47e-af90-4869-9390-3fbee3f4ef8f" containerName="manager" containerID="cri-o://3f8e6909a544e89112e23f7ad2eb1a40aca4a3fb19f2f5ed410f92734b51bd3d" gracePeriod=2
Sep 10 22:09:58.186437 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.186406    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"]
Sep 10 22:09:58.190841 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:09:58.190800    2577 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f66db47e-af90-4869-9390-3fbee3f4ef8f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-qs4kr\": pods \"kuadrant-operator-controller-manager-76f8f686bf-qs4kr\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"
Sep 10 22:09:58.202369 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.202339    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29"]
Sep 10 22:09:58.202526 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.202504    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29" podUID="0b5e7d2c-1b57-471d-b1c4-30f73de62ebe" containerName="manager" containerID="cri-o://7a3b65cd4c743a201d8dfcda5b3ce171967438d83b13c7ef80e58b74c7b579ec" gracePeriod=2
Sep 10 22:09:58.204459 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.204431    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29"
Sep 10 22:09:58.206352 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:09:58.206322    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-qs4kr\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="f66db47e-af90-4869-9390-3fbee3f4ef8f" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"
Sep 10 22:09:58.211235 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.211207    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684"]
Sep 10 22:09:58.211904 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.211884    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f66db47e-af90-4869-9390-3fbee3f4ef8f" containerName="manager"
Sep 10 22:09:58.212114 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.212084    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f66db47e-af90-4869-9390-3fbee3f4ef8f" containerName="manager"
Sep 10 22:09:58.212368 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.212347    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f66db47e-af90-4869-9390-3fbee3f4ef8f" containerName="manager"
Sep 10 22:09:58.215580 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.215557    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29"]
Sep 10 22:09:58.215703 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.215679    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684"
Sep 10 22:09:58.221948 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:09:58.221913    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-qs4kr\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="f66db47e-af90-4869-9390-3fbee3f4ef8f" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"
Sep 10 22:09:58.228372 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.228348    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684"]
Sep 10 22:09:58.236393 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.236370    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-qrcxh"]
Sep 10 22:09:58.236847 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.236826    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b5e7d2c-1b57-471d-b1c4-30f73de62ebe" containerName="manager"
Sep 10 22:09:58.236847 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.236847    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b5e7d2c-1b57-471d-b1c4-30f73de62ebe" containerName="manager"
Sep 10 22:09:58.237119 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.237098    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b5e7d2c-1b57-471d-b1c4-30f73de62ebe" containerName="manager"
Sep 10 22:09:58.240280 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.240261    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qrcxh"
Sep 10 22:09:58.246335 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.246301    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qdz4\" (UniqueName: \"kubernetes.io/projected/97bc1ae9-cb99-4363-b003-a1282b624007-kube-api-access-5qdz4\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nr684\" (UID: \"97bc1ae9-cb99-4363-b003-a1282b624007\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684"
Sep 10 22:09:58.246445 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.246357    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97bc1ae9-cb99-4363-b003-a1282b624007-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nr684\" (UID: \"97bc1ae9-cb99-4363-b003-a1282b624007\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684"
Sep 10 22:09:58.246516 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.246454    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phkgr\" (UniqueName: \"kubernetes.io/projected/d3b39857-1f29-4db0-98e0-ad1bf97ad8c1-kube-api-access-phkgr\") pod \"limitador-operator-controller-manager-74495c69f8-qrcxh\" (UID: \"d3b39857-1f29-4db0-98e0-ad1bf97ad8c1\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qrcxh"
Sep 10 22:09:58.257513 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.257389    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-qrcxh"]
Sep 10 22:09:58.259802 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:09:58.259564    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xhp29\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="0b5e7d2c-1b57-471d-b1c4-30f73de62ebe" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29"
Sep 10 22:09:58.262766 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:09:58.261387    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-qs4kr\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="f66db47e-af90-4869-9390-3fbee3f4ef8f" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"
Sep 10 22:09:58.279158 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:09:58.279115    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xhp29\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="0b5e7d2c-1b57-471d-b1c4-30f73de62ebe" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29"
Sep 10 22:09:58.347482 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.347440    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phkgr\" (UniqueName: \"kubernetes.io/projected/d3b39857-1f29-4db0-98e0-ad1bf97ad8c1-kube-api-access-phkgr\") pod \"limitador-operator-controller-manager-74495c69f8-qrcxh\" (UID: \"d3b39857-1f29-4db0-98e0-ad1bf97ad8c1\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qrcxh"
Sep 10 22:09:58.347644 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.347504    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qdz4\" (UniqueName: \"kubernetes.io/projected/97bc1ae9-cb99-4363-b003-a1282b624007-kube-api-access-5qdz4\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nr684\" (UID: \"97bc1ae9-cb99-4363-b003-a1282b624007\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684"
Sep 10 22:09:58.347644 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.347528    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97bc1ae9-cb99-4363-b003-a1282b624007-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nr684\" (UID: \"97bc1ae9-cb99-4363-b003-a1282b624007\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684"
Sep 10 22:09:58.347880 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.347856    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97bc1ae9-cb99-4363-b003-a1282b624007-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nr684\" (UID: \"97bc1ae9-cb99-4363-b003-a1282b624007\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684"
Sep 10 22:09:58.358092 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.358053    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qdz4\" (UniqueName: \"kubernetes.io/projected/97bc1ae9-cb99-4363-b003-a1282b624007-kube-api-access-5qdz4\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nr684\" (UID: \"97bc1ae9-cb99-4363-b003-a1282b624007\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684"
Sep 10 22:09:58.358757 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.358732    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phkgr\" (UniqueName: \"kubernetes.io/projected/d3b39857-1f29-4db0-98e0-ad1bf97ad8c1-kube-api-access-phkgr\") pod \"limitador-operator-controller-manager-74495c69f8-qrcxh\" (UID: \"d3b39857-1f29-4db0-98e0-ad1bf97ad8c1\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qrcxh"
Sep 10 22:09:58.436685 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.436658    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"
Sep 10 22:09:58.438924 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:09:58.438894    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-qs4kr\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="f66db47e-af90-4869-9390-3fbee3f4ef8f" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"
Sep 10 22:09:58.440464 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:09:58.440445    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xhp29\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="0b5e7d2c-1b57-471d-b1c4-30f73de62ebe" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29"
Sep 10 22:09:58.440910 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.440896    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29"
Sep 10 22:09:58.442579 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:09:58.442551    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-qs4kr\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="f66db47e-af90-4869-9390-3fbee3f4ef8f" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"
Sep 10 22:09:58.444209 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:09:58.444188    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xhp29\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="0b5e7d2c-1b57-471d-b1c4-30f73de62ebe" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29"
Sep 10 22:09:58.448501 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.448482    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f66db47e-af90-4869-9390-3fbee3f4ef8f-extensions-socket-volume\") pod \"f66db47e-af90-4869-9390-3fbee3f4ef8f\" (UID: \"f66db47e-af90-4869-9390-3fbee3f4ef8f\") "
Sep 10 22:09:58.448581 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.448516    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmrmv\" (UniqueName: \"kubernetes.io/projected/0b5e7d2c-1b57-471d-b1c4-30f73de62ebe-kube-api-access-kmrmv\") pod \"0b5e7d2c-1b57-471d-b1c4-30f73de62ebe\" (UID: \"0b5e7d2c-1b57-471d-b1c4-30f73de62ebe\") "
Sep 10 22:09:58.448581 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.448542    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87rbj\" (UniqueName: \"kubernetes.io/projected/f66db47e-af90-4869-9390-3fbee3f4ef8f-kube-api-access-87rbj\") pod \"f66db47e-af90-4869-9390-3fbee3f4ef8f\" (UID: \"f66db47e-af90-4869-9390-3fbee3f4ef8f\") "
Sep 10 22:09:58.449001 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.448977    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f66db47e-af90-4869-9390-3fbee3f4ef8f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f66db47e-af90-4869-9390-3fbee3f4ef8f" (UID: "f66db47e-af90-4869-9390-3fbee3f4ef8f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:09:58.450980 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.450956    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f66db47e-af90-4869-9390-3fbee3f4ef8f-kube-api-access-87rbj" (OuterVolumeSpecName: "kube-api-access-87rbj") pod "f66db47e-af90-4869-9390-3fbee3f4ef8f" (UID: "f66db47e-af90-4869-9390-3fbee3f4ef8f"). InnerVolumeSpecName "kube-api-access-87rbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:09:58.451070 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.450992    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b5e7d2c-1b57-471d-b1c4-30f73de62ebe-kube-api-access-kmrmv" (OuterVolumeSpecName: "kube-api-access-kmrmv") pod "0b5e7d2c-1b57-471d-b1c4-30f73de62ebe" (UID: "0b5e7d2c-1b57-471d-b1c4-30f73de62ebe"). InnerVolumeSpecName "kube-api-access-kmrmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:09:58.549410 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.549378    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f66db47e-af90-4869-9390-3fbee3f4ef8f-extensions-socket-volume\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:09:58.549410 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.549408    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmrmv\" (UniqueName: \"kubernetes.io/projected/0b5e7d2c-1b57-471d-b1c4-30f73de62ebe-kube-api-access-kmrmv\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:09:58.549410 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.549417    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87rbj\" (UniqueName: \"kubernetes.io/projected/f66db47e-af90-4869-9390-3fbee3f4ef8f-kube-api-access-87rbj\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:09:58.607900 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.607864    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684"
Sep 10 22:09:58.613049 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.613026    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qrcxh"
Sep 10 22:09:58.892497 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.892445    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-qrcxh"]
Sep 10 22:09:58.895270 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:09:58.895245    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b39857_1f29_4db0_98e0_ad1bf97ad8c1.slice/crio-842e96cd0ffabfa36d1f2650b7beaa45e585cd14dac4b857fa7564be369d3981 WatchSource:0}: Error finding container 842e96cd0ffabfa36d1f2650b7beaa45e585cd14dac4b857fa7564be369d3981: Status 404 returned error can't find the container with id 842e96cd0ffabfa36d1f2650b7beaa45e585cd14dac4b857fa7564be369d3981
Sep 10 22:09:58.895270 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:58.895258    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684"]
Sep 10 22:09:58.897187 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:09:58.897169    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97bc1ae9_cb99_4363_b003_a1282b624007.slice/crio-00e472378c7a90640b7ae55ee55eb108c372cc7d0e4555ab020a8773251e1b6c WatchSource:0}: Error finding container 00e472378c7a90640b7ae55ee55eb108c372cc7d0e4555ab020a8773251e1b6c: Status 404 returned error can't find the container with id 00e472378c7a90640b7ae55ee55eb108c372cc7d0e4555ab020a8773251e1b6c
Sep 10 22:09:59.134899 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:59.134869    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2dknf"
Sep 10 22:09:59.162516 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:09:59.162471    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-qs4kr\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="f66db47e-af90-4869-9390-3fbee3f4ef8f" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"
Sep 10 22:09:59.164000 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:09:59.163977    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xhp29\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="0b5e7d2c-1b57-471d-b1c4-30f73de62ebe" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29"
Sep 10 22:09:59.201064 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:59.201035    2577 generic.go:356] "Generic (PLEG): container finished" podID="0b5e7d2c-1b57-471d-b1c4-30f73de62ebe" containerID="7a3b65cd4c743a201d8dfcda5b3ce171967438d83b13c7ef80e58b74c7b579ec" exitCode=0
Sep 10 22:09:59.201439 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:59.201092    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29"
Sep 10 22:09:59.201439 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:59.201140    2577 scope.go:117] "RemoveContainer" containerID="7a3b65cd4c743a201d8dfcda5b3ce171967438d83b13c7ef80e58b74c7b579ec"
Sep 10 22:09:59.204160 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:59.204130    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684" event={"ID":"97bc1ae9-cb99-4363-b003-a1282b624007","Type":"ContainerStarted","Data":"47dfc8e05ac06caa63315195fc46898fe75388dc490f64a165f5f0c58bd47a98"}
Sep 10 22:09:59.204274 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:59.204190    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684" event={"ID":"97bc1ae9-cb99-4363-b003-a1282b624007","Type":"ContainerStarted","Data":"00e472378c7a90640b7ae55ee55eb108c372cc7d0e4555ab020a8773251e1b6c"}
Sep 10 22:09:59.204274 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:59.204241    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684"
Sep 10 22:09:59.206462 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:59.206442    2577 generic.go:356] "Generic (PLEG): container finished" podID="f66db47e-af90-4869-9390-3fbee3f4ef8f" containerID="3f8e6909a544e89112e23f7ad2eb1a40aca4a3fb19f2f5ed410f92734b51bd3d" exitCode=0
Sep 10 22:09:59.206565 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:59.206548    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"
Sep 10 22:09:59.207753 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:09:59.207725    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-qs4kr\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="f66db47e-af90-4869-9390-3fbee3f4ef8f" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"
Sep 10 22:09:59.208659 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:59.208636    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qrcxh" event={"ID":"d3b39857-1f29-4db0-98e0-ad1bf97ad8c1","Type":"ContainerStarted","Data":"89b0571fd2c999ce1f96d567df11b6845bf924d5493b8c72112d1ddae1b491a7"}
Sep 10 22:09:59.208753 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:59.208683    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qrcxh" event={"ID":"d3b39857-1f29-4db0-98e0-ad1bf97ad8c1","Type":"ContainerStarted","Data":"842e96cd0ffabfa36d1f2650b7beaa45e585cd14dac4b857fa7564be369d3981"}
Sep 10 22:09:59.208901 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:59.208764    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qrcxh"
Sep 10 22:09:59.209757 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:09:59.209735    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xhp29\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="0b5e7d2c-1b57-471d-b1c4-30f73de62ebe" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29"
Sep 10 22:09:59.211987 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:09:59.211957    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-qs4kr\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="f66db47e-af90-4869-9390-3fbee3f4ef8f" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"
Sep 10 22:09:59.212175 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:59.212142    2577 scope.go:117] "RemoveContainer" containerID="7a3b65cd4c743a201d8dfcda5b3ce171967438d83b13c7ef80e58b74c7b579ec"
Sep 10 22:09:59.212416 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:09:59.212397    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a3b65cd4c743a201d8dfcda5b3ce171967438d83b13c7ef80e58b74c7b579ec\": container with ID starting with 7a3b65cd4c743a201d8dfcda5b3ce171967438d83b13c7ef80e58b74c7b579ec not found: ID does not exist" containerID="7a3b65cd4c743a201d8dfcda5b3ce171967438d83b13c7ef80e58b74c7b579ec"
Sep 10 22:09:59.212481 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:59.212438    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a3b65cd4c743a201d8dfcda5b3ce171967438d83b13c7ef80e58b74c7b579ec"} err="failed to get container status \"7a3b65cd4c743a201d8dfcda5b3ce171967438d83b13c7ef80e58b74c7b579ec\": rpc error: code = NotFound desc = could not find container \"7a3b65cd4c743a201d8dfcda5b3ce171967438d83b13c7ef80e58b74c7b579ec\": container with ID starting with 7a3b65cd4c743a201d8dfcda5b3ce171967438d83b13c7ef80e58b74c7b579ec not found: ID does not exist"
Sep 10 22:09:59.212481 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:59.212453    2577 scope.go:117] "RemoveContainer" containerID="3f8e6909a544e89112e23f7ad2eb1a40aca4a3fb19f2f5ed410f92734b51bd3d"
Sep 10 22:09:59.221512 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:59.221492    2577 scope.go:117] "RemoveContainer" containerID="3f8e6909a544e89112e23f7ad2eb1a40aca4a3fb19f2f5ed410f92734b51bd3d"
Sep 10 22:09:59.221794 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:09:59.221758    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f8e6909a544e89112e23f7ad2eb1a40aca4a3fb19f2f5ed410f92734b51bd3d\": container with ID starting with 3f8e6909a544e89112e23f7ad2eb1a40aca4a3fb19f2f5ed410f92734b51bd3d not found: ID does not exist" containerID="3f8e6909a544e89112e23f7ad2eb1a40aca4a3fb19f2f5ed410f92734b51bd3d"
Sep 10 22:09:59.221864 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:59.221801    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f8e6909a544e89112e23f7ad2eb1a40aca4a3fb19f2f5ed410f92734b51bd3d"} err="failed to get container status \"3f8e6909a544e89112e23f7ad2eb1a40aca4a3fb19f2f5ed410f92734b51bd3d\": rpc error: code = NotFound desc = could not find container \"3f8e6909a544e89112e23f7ad2eb1a40aca4a3fb19f2f5ed410f92734b51bd3d\": container with ID starting with 3f8e6909a544e89112e23f7ad2eb1a40aca4a3fb19f2f5ed410f92734b51bd3d not found: ID does not exist"
Sep 10 22:09:59.247061 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:59.247013    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684" podStartSLOduration=1.246996877 podStartE2EDuration="1.246996877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:09:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:09:59.242994092 +0000 UTC m=+503.915092015" watchObservedRunningTime="2026-09-10 22:09:59.246996877 +0000 UTC m=+503.919094797"
Sep 10 22:09:59.283233 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:09:59.283198    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xhp29\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="0b5e7d2c-1b57-471d-b1c4-30f73de62ebe" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29"
Sep 10 22:09:59.283525 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:59.283482    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qrcxh" podStartSLOduration=1.2834673589999999 podStartE2EDuration="1.283467359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:09:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:09:59.281101432 +0000 UTC m=+503.953199353" watchObservedRunningTime="2026-09-10 22:09:59.283467359 +0000 UTC m=+503.955565283"
Sep 10 22:09:59.285388 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:09:59.285357    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-qs4kr\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="f66db47e-af90-4869-9390-3fbee3f4ef8f" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs4kr"
Sep 10 22:09:59.287021 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:09:59.286997    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xhp29\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="0b5e7d2c-1b57-471d-b1c4-30f73de62ebe" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xhp29"
Sep 10 22:09:59.848366 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:59.848333    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b5e7d2c-1b57-471d-b1c4-30f73de62ebe" path="/var/lib/kubelet/pods/0b5e7d2c-1b57-471d-b1c4-30f73de62ebe/volumes"
Sep 10 22:09:59.848692 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:09:59.848674    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f66db47e-af90-4869-9390-3fbee3f4ef8f" path="/var/lib/kubelet/pods/f66db47e-af90-4869-9390-3fbee3f4ef8f/volumes"
Sep 10 22:10:10.219865 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:10.219835    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684"
Sep 10 22:10:10.220264 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:10.219902    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qrcxh"
Sep 10 22:10:14.845818 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:14.845767    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684"]
Sep 10 22:10:14.846713 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:14.846013    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684" podUID="97bc1ae9-cb99-4363-b003-a1282b624007" containerName="manager" containerID="cri-o://47dfc8e05ac06caa63315195fc46898fe75388dc490f64a165f5f0c58bd47a98" gracePeriod=10
Sep 10 22:10:15.096435 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:15.096377    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684"
Sep 10 22:10:15.161064 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:15.161030    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qdz4\" (UniqueName: \"kubernetes.io/projected/97bc1ae9-cb99-4363-b003-a1282b624007-kube-api-access-5qdz4\") pod \"97bc1ae9-cb99-4363-b003-a1282b624007\" (UID: \"97bc1ae9-cb99-4363-b003-a1282b624007\") "
Sep 10 22:10:15.161237 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:15.161122    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97bc1ae9-cb99-4363-b003-a1282b624007-extensions-socket-volume\") pod \"97bc1ae9-cb99-4363-b003-a1282b624007\" (UID: \"97bc1ae9-cb99-4363-b003-a1282b624007\") "
Sep 10 22:10:15.161467 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:15.161442    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97bc1ae9-cb99-4363-b003-a1282b624007-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "97bc1ae9-cb99-4363-b003-a1282b624007" (UID: "97bc1ae9-cb99-4363-b003-a1282b624007"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:10:15.163298 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:15.163278    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97bc1ae9-cb99-4363-b003-a1282b624007-kube-api-access-5qdz4" (OuterVolumeSpecName: "kube-api-access-5qdz4") pod "97bc1ae9-cb99-4363-b003-a1282b624007" (UID: "97bc1ae9-cb99-4363-b003-a1282b624007"). InnerVolumeSpecName "kube-api-access-5qdz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:10:15.262023 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:15.261988    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qdz4\" (UniqueName: \"kubernetes.io/projected/97bc1ae9-cb99-4363-b003-a1282b624007-kube-api-access-5qdz4\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:10:15.262023 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:15.262016    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97bc1ae9-cb99-4363-b003-a1282b624007-extensions-socket-volume\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:10:15.305727 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:15.305692    2577 generic.go:356] "Generic (PLEG): container finished" podID="97bc1ae9-cb99-4363-b003-a1282b624007" containerID="47dfc8e05ac06caa63315195fc46898fe75388dc490f64a165f5f0c58bd47a98" exitCode=0
Sep 10 22:10:15.305905 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:15.305744    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684"
Sep 10 22:10:15.305905 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:15.305805    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684" event={"ID":"97bc1ae9-cb99-4363-b003-a1282b624007","Type":"ContainerDied","Data":"47dfc8e05ac06caa63315195fc46898fe75388dc490f64a165f5f0c58bd47a98"}
Sep 10 22:10:15.305905 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:15.305866    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684" event={"ID":"97bc1ae9-cb99-4363-b003-a1282b624007","Type":"ContainerDied","Data":"00e472378c7a90640b7ae55ee55eb108c372cc7d0e4555ab020a8773251e1b6c"}
Sep 10 22:10:15.305905 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:15.305890    2577 scope.go:117] "RemoveContainer" containerID="47dfc8e05ac06caa63315195fc46898fe75388dc490f64a165f5f0c58bd47a98"
Sep 10 22:10:15.315803 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:15.315718    2577 scope.go:117] "RemoveContainer" containerID="47dfc8e05ac06caa63315195fc46898fe75388dc490f64a165f5f0c58bd47a98"
Sep 10 22:10:15.316606 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:10:15.316566    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47dfc8e05ac06caa63315195fc46898fe75388dc490f64a165f5f0c58bd47a98\": container with ID starting with 47dfc8e05ac06caa63315195fc46898fe75388dc490f64a165f5f0c58bd47a98 not found: ID does not exist" containerID="47dfc8e05ac06caa63315195fc46898fe75388dc490f64a165f5f0c58bd47a98"
Sep 10 22:10:15.316801 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:15.316746    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47dfc8e05ac06caa63315195fc46898fe75388dc490f64a165f5f0c58bd47a98"} err="failed to get container status \"47dfc8e05ac06caa63315195fc46898fe75388dc490f64a165f5f0c58bd47a98\": rpc error: code = NotFound desc = could not find container \"47dfc8e05ac06caa63315195fc46898fe75388dc490f64a165f5f0c58bd47a98\": container with ID starting with 47dfc8e05ac06caa63315195fc46898fe75388dc490f64a165f5f0c58bd47a98 not found: ID does not exist"
Sep 10 22:10:15.337550 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:15.337516    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684"]
Sep 10 22:10:15.339477 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:15.339451    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nr684"]
Sep 10 22:10:15.847453 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:15.847425    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97bc1ae9-cb99-4363-b003-a1282b624007" path="/var/lib/kubelet/pods/97bc1ae9-cb99-4363-b003-a1282b624007/volumes"
Sep 10 22:10:31.140985 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.140877    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"]
Sep 10 22:10:31.141453 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.141410    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97bc1ae9-cb99-4363-b003-a1282b624007" containerName="manager"
Sep 10 22:10:31.141453 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.141425    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="97bc1ae9-cb99-4363-b003-a1282b624007" containerName="manager"
Sep 10 22:10:31.141528 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.141508    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="97bc1ae9-cb99-4363-b003-a1282b624007" containerName="manager"
Sep 10 22:10:31.145173 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.145148    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.147373 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.147341    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 22:10:31.147511 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.147431    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-95slb\""
Sep 10 22:10:31.154722 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.154696    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"]
Sep 10 22:10:31.186399 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.186369    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f711997-b4cd-4393-8740-96bb17ec3834-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.186399 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.186399    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f711997-b4cd-4393-8740-96bb17ec3834-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.186650 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.186416    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f711997-b4cd-4393-8740-96bb17ec3834-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.186650 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.186444    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f711997-b4cd-4393-8740-96bb17ec3834-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.186650 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.186550    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f711997-b4cd-4393-8740-96bb17ec3834-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.186807 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.186668    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f711997-b4cd-4393-8740-96bb17ec3834-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.186807 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.186723    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f711997-b4cd-4393-8740-96bb17ec3834-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.186807 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.186763    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4x57\" (UniqueName: \"kubernetes.io/projected/2f711997-b4cd-4393-8740-96bb17ec3834-kube-api-access-z4x57\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.186931 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.186805    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f711997-b4cd-4393-8740-96bb17ec3834-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.288160 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.288116    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f711997-b4cd-4393-8740-96bb17ec3834-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.288368 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.288189    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f711997-b4cd-4393-8740-96bb17ec3834-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.288368 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.288231    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4x57\" (UniqueName: \"kubernetes.io/projected/2f711997-b4cd-4393-8740-96bb17ec3834-kube-api-access-z4x57\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.288368 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.288257    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f711997-b4cd-4393-8740-96bb17ec3834-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.288542 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.288422    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f711997-b4cd-4393-8740-96bb17ec3834-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.288542 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.288461    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f711997-b4cd-4393-8740-96bb17ec3834-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.288542 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.288488    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f711997-b4cd-4393-8740-96bb17ec3834-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.288542 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.288529    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f711997-b4cd-4393-8740-96bb17ec3834-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.288814 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.288543    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f711997-b4cd-4393-8740-96bb17ec3834-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.288814 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.288538    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f711997-b4cd-4393-8740-96bb17ec3834-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.288814 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.288597    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f711997-b4cd-4393-8740-96bb17ec3834-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.288814 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.288618    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f711997-b4cd-4393-8740-96bb17ec3834-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.289033 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.288966    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f711997-b4cd-4393-8740-96bb17ec3834-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.289286 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.289263    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f711997-b4cd-4393-8740-96bb17ec3834-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.290846 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.290816    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f711997-b4cd-4393-8740-96bb17ec3834-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.291118 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.291099    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f711997-b4cd-4393-8740-96bb17ec3834-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.296638 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.296614    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f711997-b4cd-4393-8740-96bb17ec3834-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.296726 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.296688    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4x57\" (UniqueName: \"kubernetes.io/projected/2f711997-b4cd-4393-8740-96bb17ec3834-kube-api-access-z4x57\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4vbvh\" (UID: \"2f711997-b4cd-4393-8740-96bb17ec3834\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.457694 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.457609    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:31.748676 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:31.745347    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"]
Sep 10 22:10:31.748939 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:10:31.748912    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f711997_b4cd_4393_8740_96bb17ec3834.slice/crio-22c4f1c17e78bb842f84c3b669eb5e3878927e5c91d15764bf74d32565bf84b8 WatchSource:0}: Error finding container 22c4f1c17e78bb842f84c3b669eb5e3878927e5c91d15764bf74d32565bf84b8: Status 404 returned error can't find the container with id 22c4f1c17e78bb842f84c3b669eb5e3878927e5c91d15764bf74d32565bf84b8
Sep 10 22:10:32.400681 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:32.400647    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh" event={"ID":"2f711997-b4cd-4393-8740-96bb17ec3834","Type":"ContainerStarted","Data":"22c4f1c17e78bb842f84c3b669eb5e3878927e5c91d15764bf74d32565bf84b8"}
Sep 10 22:10:36.409239 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:36.409204    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:10:36.409535 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:36.409275    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:10:36.409535 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:36.409305    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:10:37.431516 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:37.431482    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh" event={"ID":"2f711997-b4cd-4393-8740-96bb17ec3834","Type":"ContainerStarted","Data":"9d8c1d3b68eb8eda90bf12779ae58c44a8a2391776471e6a41e186165a2a6c9f"}
Sep 10 22:10:37.453408 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:37.453358    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh" podStartSLOduration=1.7949797159999998 podStartE2EDuration="6.453343753s" totalImagesPullingTime="4.658364037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:10:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:10:37.451124432 +0000 UTC m=+542.123222352" watchObservedRunningTime="2026-09-10 22:10:37.453343753 +0000 UTC m=+542.125441673"
Sep 10 22:10:37.457912 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:37.457885    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:37.462337 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:37.462312    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:38.437714 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.437683    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:38.438616 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.438596    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:10:38.451937 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.451903    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-66446"]
Sep 10 22:10:38.455543 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.455527    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-66446"
Sep 10 22:10:38.457573 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.457551    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 22:10:38.466140 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.466112    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-66446"]
Sep 10 22:10:38.550875 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.550833    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hqt9\" (UniqueName: \"kubernetes.io/projected/5aa61d65-fe16-48df-a754-3902830117f0-kube-api-access-2hqt9\") pod \"limitador-limitador-8588749977-66446\" (UID: \"5aa61d65-fe16-48df-a754-3902830117f0\") " pod="kuadrant-system/limitador-limitador-8588749977-66446"
Sep 10 22:10:38.551078 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.551020    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5aa61d65-fe16-48df-a754-3902830117f0-config-file\") pod \"limitador-limitador-8588749977-66446\" (UID: \"5aa61d65-fe16-48df-a754-3902830117f0\") " pod="kuadrant-system/limitador-limitador-8588749977-66446"
Sep 10 22:10:38.551438 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.551417    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-66446"]
Sep 10 22:10:38.570003 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.569979    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:10:38.573692 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.573674    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"
Sep 10 22:10:38.583178 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.583153    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:10:38.606575 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.606547    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:10:38.652096 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.652064    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m48tk\" (UniqueName: \"kubernetes.io/projected/ef7c8d31-2395-45a6-9cd8-18adcb87031a-kube-api-access-m48tk\") pod \"limitador-limitador-84994f7ffc-vxx6n\" (UID: \"ef7c8d31-2395-45a6-9cd8-18adcb87031a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"
Sep 10 22:10:38.652297 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.652124    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hqt9\" (UniqueName: \"kubernetes.io/projected/5aa61d65-fe16-48df-a754-3902830117f0-kube-api-access-2hqt9\") pod \"limitador-limitador-8588749977-66446\" (UID: \"5aa61d65-fe16-48df-a754-3902830117f0\") " pod="kuadrant-system/limitador-limitador-8588749977-66446"
Sep 10 22:10:38.652450 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.652430    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5aa61d65-fe16-48df-a754-3902830117f0-config-file\") pod \"limitador-limitador-8588749977-66446\" (UID: \"5aa61d65-fe16-48df-a754-3902830117f0\") " pod="kuadrant-system/limitador-limitador-8588749977-66446"
Sep 10 22:10:38.652678 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.652634    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ef7c8d31-2395-45a6-9cd8-18adcb87031a-config-file\") pod \"limitador-limitador-84994f7ffc-vxx6n\" (UID: \"ef7c8d31-2395-45a6-9cd8-18adcb87031a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"
Sep 10 22:10:38.653127 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.653081    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5aa61d65-fe16-48df-a754-3902830117f0-config-file\") pod \"limitador-limitador-8588749977-66446\" (UID: \"5aa61d65-fe16-48df-a754-3902830117f0\") " pod="kuadrant-system/limitador-limitador-8588749977-66446"
Sep 10 22:10:38.659953 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.659927    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hqt9\" (UniqueName: \"kubernetes.io/projected/5aa61d65-fe16-48df-a754-3902830117f0-kube-api-access-2hqt9\") pod \"limitador-limitador-8588749977-66446\" (UID: \"5aa61d65-fe16-48df-a754-3902830117f0\") " pod="kuadrant-system/limitador-limitador-8588749977-66446"
Sep 10 22:10:38.753751 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.753655    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ef7c8d31-2395-45a6-9cd8-18adcb87031a-config-file\") pod \"limitador-limitador-84994f7ffc-vxx6n\" (UID: \"ef7c8d31-2395-45a6-9cd8-18adcb87031a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"
Sep 10 22:10:38.753751 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.753698    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m48tk\" (UniqueName: \"kubernetes.io/projected/ef7c8d31-2395-45a6-9cd8-18adcb87031a-kube-api-access-m48tk\") pod \"limitador-limitador-84994f7ffc-vxx6n\" (UID: \"ef7c8d31-2395-45a6-9cd8-18adcb87031a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"
Sep 10 22:10:38.754281 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.754261    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ef7c8d31-2395-45a6-9cd8-18adcb87031a-config-file\") pod \"limitador-limitador-84994f7ffc-vxx6n\" (UID: \"ef7c8d31-2395-45a6-9cd8-18adcb87031a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"
Sep 10 22:10:38.761268 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.761235    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m48tk\" (UniqueName: \"kubernetes.io/projected/ef7c8d31-2395-45a6-9cd8-18adcb87031a-kube-api-access-m48tk\") pod \"limitador-limitador-84994f7ffc-vxx6n\" (UID: \"ef7c8d31-2395-45a6-9cd8-18adcb87031a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"
Sep 10 22:10:38.767918 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.767892    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-66446"
Sep 10 22:10:38.885669 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:38.885639    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"
Sep 10 22:10:39.042341 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:39.042316    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-66446"]
Sep 10 22:10:39.044106 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:10:39.044073    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa61d65_fe16_48df_a754_3902830117f0.slice/crio-f00f716de91d7d2c37c059edb366866847bd6d7bc5397d66b7f259c9ecad84c8 WatchSource:0}: Error finding container f00f716de91d7d2c37c059edb366866847bd6d7bc5397d66b7f259c9ecad84c8: Status 404 returned error can't find the container with id f00f716de91d7d2c37c059edb366866847bd6d7bc5397d66b7f259c9ecad84c8
Sep 10 22:10:39.163273 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:39.163252    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:10:39.165062 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:10:39.165037    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7c8d31_2395_45a6_9cd8_18adcb87031a.slice/crio-228f0a1aa5700d501997b60dd83a184603cc604ae04f530ae63da5d5c48be200 WatchSource:0}: Error finding container 228f0a1aa5700d501997b60dd83a184603cc604ae04f530ae63da5d5c48be200: Status 404 returned error can't find the container with id 228f0a1aa5700d501997b60dd83a184603cc604ae04f530ae63da5d5c48be200
Sep 10 22:10:39.445651 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:39.445607    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-66446" event={"ID":"5aa61d65-fe16-48df-a754-3902830117f0","Type":"ContainerStarted","Data":"f00f716de91d7d2c37c059edb366866847bd6d7bc5397d66b7f259c9ecad84c8"}
Sep 10 22:10:39.446990 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:39.446960    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-vxx6n" event={"ID":"ef7c8d31-2395-45a6-9cd8-18adcb87031a","Type":"ContainerStarted","Data":"228f0a1aa5700d501997b60dd83a184603cc604ae04f530ae63da5d5c48be200"}
Sep 10 22:10:41.463350 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:41.462561    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-66446" event={"ID":"5aa61d65-fe16-48df-a754-3902830117f0","Type":"ContainerStarted","Data":"21e05d4076d965e903f152715b14cdc8511ef3a6892678761828a50875772598"}
Sep 10 22:10:41.463854 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:41.463522    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-66446"
Sep 10 22:10:41.465901 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:41.465867    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-vxx6n" event={"ID":"ef7c8d31-2395-45a6-9cd8-18adcb87031a","Type":"ContainerStarted","Data":"0ce41ec174d9a104c9e17f0aaaedce017c6f851e056635710e1379c75929e8a1"}
Sep 10 22:10:41.466020 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:41.465991    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"
Sep 10 22:10:41.480722 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:41.480675    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-66446" podStartSLOduration=2.083330651 podStartE2EDuration="3.480661693s" totalImagesPullingTime="1.397331042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:10:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:10:41.47926748 +0000 UTC m=+546.151365404" watchObservedRunningTime="2026-09-10 22:10:41.480661693 +0000 UTC m=+546.152759617"
Sep 10 22:10:41.494303 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:41.494255    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-vxx6n" podStartSLOduration=2.21624143 podStartE2EDuration="3.494238063s" totalImagesPullingTime="1.277996633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:10:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:10:41.493703813 +0000 UTC m=+546.165801732" watchObservedRunningTime="2026-09-10 22:10:41.494238063 +0000 UTC m=+546.166335986"
Sep 10 22:10:52.471655 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:52.471626    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"
Sep 10 22:10:52.515858 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:52.515825    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-66446"]
Sep 10 22:10:52.516078 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:52.516044    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-66446" podUID="5aa61d65-fe16-48df-a754-3902830117f0" containerName="limitador" containerID="cri-o://21e05d4076d965e903f152715b14cdc8511ef3a6892678761828a50875772598" gracePeriod=30
Sep 10 22:10:52.517003 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:52.516766    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-66446"
Sep 10 22:10:53.066500 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:53.066476    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-66446"
Sep 10 22:10:53.180859 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:53.180831    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5aa61d65-fe16-48df-a754-3902830117f0-config-file\") pod \"5aa61d65-fe16-48df-a754-3902830117f0\" (UID: \"5aa61d65-fe16-48df-a754-3902830117f0\") "
Sep 10 22:10:53.181026 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:53.180956    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hqt9\" (UniqueName: \"kubernetes.io/projected/5aa61d65-fe16-48df-a754-3902830117f0-kube-api-access-2hqt9\") pod \"5aa61d65-fe16-48df-a754-3902830117f0\" (UID: \"5aa61d65-fe16-48df-a754-3902830117f0\") "
Sep 10 22:10:53.181184 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:53.181163    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aa61d65-fe16-48df-a754-3902830117f0-config-file" (OuterVolumeSpecName: "config-file") pod "5aa61d65-fe16-48df-a754-3902830117f0" (UID: "5aa61d65-fe16-48df-a754-3902830117f0"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:10:53.183259 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:53.183228    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aa61d65-fe16-48df-a754-3902830117f0-kube-api-access-2hqt9" (OuterVolumeSpecName: "kube-api-access-2hqt9") pod "5aa61d65-fe16-48df-a754-3902830117f0" (UID: "5aa61d65-fe16-48df-a754-3902830117f0"). InnerVolumeSpecName "kube-api-access-2hqt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:10:53.288521 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:53.288486    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hqt9\" (UniqueName: \"kubernetes.io/projected/5aa61d65-fe16-48df-a754-3902830117f0-kube-api-access-2hqt9\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:10:53.288521 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:53.288516    2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5aa61d65-fe16-48df-a754-3902830117f0-config-file\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:10:53.528137 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:53.528048    2577 generic.go:356] "Generic (PLEG): container finished" podID="5aa61d65-fe16-48df-a754-3902830117f0" containerID="21e05d4076d965e903f152715b14cdc8511ef3a6892678761828a50875772598" exitCode=0
Sep 10 22:10:53.528137 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:53.528111    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-66446"
Sep 10 22:10:53.528574 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:53.528126    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-66446" event={"ID":"5aa61d65-fe16-48df-a754-3902830117f0","Type":"ContainerDied","Data":"21e05d4076d965e903f152715b14cdc8511ef3a6892678761828a50875772598"}
Sep 10 22:10:53.528574 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:53.528224    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-66446" event={"ID":"5aa61d65-fe16-48df-a754-3902830117f0","Type":"ContainerDied","Data":"f00f716de91d7d2c37c059edb366866847bd6d7bc5397d66b7f259c9ecad84c8"}
Sep 10 22:10:53.528574 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:53.528253    2577 scope.go:117] "RemoveContainer" containerID="21e05d4076d965e903f152715b14cdc8511ef3a6892678761828a50875772598"
Sep 10 22:10:53.537354 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:53.537331    2577 scope.go:117] "RemoveContainer" containerID="21e05d4076d965e903f152715b14cdc8511ef3a6892678761828a50875772598"
Sep 10 22:10:53.537620 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:10:53.537602    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21e05d4076d965e903f152715b14cdc8511ef3a6892678761828a50875772598\": container with ID starting with 21e05d4076d965e903f152715b14cdc8511ef3a6892678761828a50875772598 not found: ID does not exist" containerID="21e05d4076d965e903f152715b14cdc8511ef3a6892678761828a50875772598"
Sep 10 22:10:53.537674 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:53.537629    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21e05d4076d965e903f152715b14cdc8511ef3a6892678761828a50875772598"} err="failed to get container status \"21e05d4076d965e903f152715b14cdc8511ef3a6892678761828a50875772598\": rpc error: code = NotFound desc = could not find container \"21e05d4076d965e903f152715b14cdc8511ef3a6892678761828a50875772598\": container with ID starting with 21e05d4076d965e903f152715b14cdc8511ef3a6892678761828a50875772598 not found: ID does not exist"
Sep 10 22:10:53.549604 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:53.549581    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-66446"]
Sep 10 22:10:53.555078 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:53.555056    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-66446"]
Sep 10 22:10:53.847042 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:53.846960    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5aa61d65-fe16-48df-a754-3902830117f0" path="/var/lib/kubelet/pods/5aa61d65-fe16-48df-a754-3902830117f0/volumes"
Sep 10 22:10:54.960680 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:54.960637    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-chr5b"]
Sep 10 22:10:54.961161 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:54.961033    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aa61d65-fe16-48df-a754-3902830117f0" containerName="limitador"
Sep 10 22:10:54.961161 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:54.961045    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aa61d65-fe16-48df-a754-3902830117f0" containerName="limitador"
Sep 10 22:10:54.961161 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:54.961126    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aa61d65-fe16-48df-a754-3902830117f0" containerName="limitador"
Sep 10 22:10:54.965613 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:54.965590    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-chr5b"
Sep 10 22:10:54.968272 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:54.968234    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-8nj47\""
Sep 10 22:10:54.968272 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:54.968257    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 10 22:10:54.968686 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:54.968664    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 22:10:54.968828 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:54.968680    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 22:10:54.975941 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:54.975914    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-chr5b"]
Sep 10 22:10:55.105678 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:55.105645    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c3572c7c-e6c1-4011-9af8-d94139b1607b-data\") pod \"postgres-69fb4594cf-chr5b\" (UID: \"c3572c7c-e6c1-4011-9af8-d94139b1607b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-chr5b"
Sep 10 22:10:55.105678 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:55.105680    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfjm8\" (UniqueName: \"kubernetes.io/projected/c3572c7c-e6c1-4011-9af8-d94139b1607b-kube-api-access-xfjm8\") pod \"postgres-69fb4594cf-chr5b\" (UID: \"c3572c7c-e6c1-4011-9af8-d94139b1607b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-chr5b"
Sep 10 22:10:55.206410 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:55.206375    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c3572c7c-e6c1-4011-9af8-d94139b1607b-data\") pod \"postgres-69fb4594cf-chr5b\" (UID: \"c3572c7c-e6c1-4011-9af8-d94139b1607b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-chr5b"
Sep 10 22:10:55.206410 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:55.206405    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfjm8\" (UniqueName: \"kubernetes.io/projected/c3572c7c-e6c1-4011-9af8-d94139b1607b-kube-api-access-xfjm8\") pod \"postgres-69fb4594cf-chr5b\" (UID: \"c3572c7c-e6c1-4011-9af8-d94139b1607b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-chr5b"
Sep 10 22:10:55.206748 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:55.206730    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c3572c7c-e6c1-4011-9af8-d94139b1607b-data\") pod \"postgres-69fb4594cf-chr5b\" (UID: \"c3572c7c-e6c1-4011-9af8-d94139b1607b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-chr5b"
Sep 10 22:10:55.214767 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:55.214703    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfjm8\" (UniqueName: \"kubernetes.io/projected/c3572c7c-e6c1-4011-9af8-d94139b1607b-kube-api-access-xfjm8\") pod \"postgres-69fb4594cf-chr5b\" (UID: \"c3572c7c-e6c1-4011-9af8-d94139b1607b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-chr5b"
Sep 10 22:10:55.279337 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:55.279311    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-chr5b"
Sep 10 22:10:55.549689 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:55.549636    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-chr5b"]
Sep 10 22:10:55.551876 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:10:55.551854    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3572c7c_e6c1_4011_9af8_d94139b1607b.slice/crio-c9aaafd51805748b6e499d76d41fdc11f8a8f6f9f3b157901676786956bd92eb WatchSource:0}: Error finding container c9aaafd51805748b6e499d76d41fdc11f8a8f6f9f3b157901676786956bd92eb: Status 404 returned error can't find the container with id c9aaafd51805748b6e499d76d41fdc11f8a8f6f9f3b157901676786956bd92eb
Sep 10 22:10:56.548469 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:56.548432    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-chr5b" event={"ID":"c3572c7c-e6c1-4011-9af8-d94139b1607b","Type":"ContainerStarted","Data":"c9aaafd51805748b6e499d76d41fdc11f8a8f6f9f3b157901676786956bd92eb"}
Sep 10 22:10:58.564378 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:58.564331    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-chr5b" event={"ID":"c3572c7c-e6c1-4011-9af8-d94139b1607b","Type":"ContainerStarted","Data":"a56301a10ceabcfdec08fb43d026e3631229a0bd80381362aca9c7188a15261d"}
Sep 10 22:10:58.564814 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:58.564518    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-chr5b"
Sep 10 22:10:58.579811 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:10:58.579656    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-chr5b" podStartSLOduration=2.3156564 podStartE2EDuration="4.579639047s" totalImagesPullingTime="2.263982647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:10:58.579466129 +0000 UTC m=+563.251564053" watchObservedRunningTime="2026-09-10 22:10:58.579639047 +0000 UTC m=+563.251736973"
Sep 10 22:11:04.600117 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:04.600087    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-chr5b"
Sep 10 22:11:49.784751 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:49.784716    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-6dszf"]
Sep 10 22:11:49.787737 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:49.787710    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-6dszf"
Sep 10 22:11:49.790399 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:49.790375    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jcth5\""
Sep 10 22:11:49.790535 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:49.790413    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 10 22:11:49.801875 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:49.801853    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-6dszf"]
Sep 10 22:11:49.868593 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:49.868558    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:11:49.875245 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:49.875224    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c832a3f5-34f9-4b44-bb0e-329861d77d1d-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-6dszf\" (UID: \"c832a3f5-34f9-4b44-bb0e-329861d77d1d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-6dszf"
Sep 10 22:11:49.875396 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:49.875280    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kcww\" (UniqueName: \"kubernetes.io/projected/c832a3f5-34f9-4b44-bb0e-329861d77d1d-kube-api-access-4kcww\") pod \"payload-processing-5b54b7fbb7-6dszf\" (UID: \"c832a3f5-34f9-4b44-bb0e-329861d77d1d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-6dszf"
Sep 10 22:11:49.975834 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:49.975768    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kcww\" (UniqueName: \"kubernetes.io/projected/c832a3f5-34f9-4b44-bb0e-329861d77d1d-kube-api-access-4kcww\") pod \"payload-processing-5b54b7fbb7-6dszf\" (UID: \"c832a3f5-34f9-4b44-bb0e-329861d77d1d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-6dszf"
Sep 10 22:11:49.976005 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:49.975882    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c832a3f5-34f9-4b44-bb0e-329861d77d1d-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-6dszf\" (UID: \"c832a3f5-34f9-4b44-bb0e-329861d77d1d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-6dszf"
Sep 10 22:11:49.976660 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:49.976641    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c832a3f5-34f9-4b44-bb0e-329861d77d1d-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-6dszf\" (UID: \"c832a3f5-34f9-4b44-bb0e-329861d77d1d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-6dszf"
Sep 10 22:11:49.984730 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:49.984702    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kcww\" (UniqueName: \"kubernetes.io/projected/c832a3f5-34f9-4b44-bb0e-329861d77d1d-kube-api-access-4kcww\") pod \"payload-processing-5b54b7fbb7-6dszf\" (UID: \"c832a3f5-34f9-4b44-bb0e-329861d77d1d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-6dszf"
Sep 10 22:11:50.098971 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:50.098887    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-6dszf"
Sep 10 22:11:50.370227 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:50.370192    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-6dszf"]
Sep 10 22:11:50.371672 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:11:50.371647    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc832a3f5_34f9_4b44_bb0e_329861d77d1d.slice/crio-210e14d8f609eeb39ba1c0d16d3dc7a66cb1b7ebeddd0cfd36272d1caf61f561 WatchSource:0}: Error finding container 210e14d8f609eeb39ba1c0d16d3dc7a66cb1b7ebeddd0cfd36272d1caf61f561: Status 404 returned error can't find the container with id 210e14d8f609eeb39ba1c0d16d3dc7a66cb1b7ebeddd0cfd36272d1caf61f561
Sep 10 22:11:50.373533 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:50.373518    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 22:11:50.859462 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:50.859422    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-6dszf" event={"ID":"c832a3f5-34f9-4b44-bb0e-329861d77d1d","Type":"ContainerStarted","Data":"210e14d8f609eeb39ba1c0d16d3dc7a66cb1b7ebeddd0cfd36272d1caf61f561"}
Sep 10 22:11:52.874658 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:52.874616    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-6dszf" event={"ID":"c832a3f5-34f9-4b44-bb0e-329861d77d1d","Type":"ContainerStarted","Data":"7e7bb42a40106338047bef13bababe9dffbda9154fe9267ece2c214df451eb22"}
Sep 10 22:11:52.875156 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:52.874746    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-6dszf"
Sep 10 22:11:52.891476 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:52.891419    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-6dszf" podStartSLOduration=1.975776571 podStartE2EDuration="3.891398263s" totalImagesPullingTime="1.915621692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:11:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:11:52.89030748 +0000 UTC m=+617.562405401" watchObservedRunningTime="2026-09-10 22:11:52.891398263 +0000 UTC m=+617.563496186"
Sep 10 22:11:58.910561 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:58.910530    2577 generic.go:356] "Generic (PLEG): container finished" podID="2f711997-b4cd-4393-8740-96bb17ec3834" containerID="9d8c1d3b68eb8eda90bf12779ae58c44a8a2391776471e6a41e186165a2a6c9f" exitCode=0
Sep 10 22:11:58.910994 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:58.910598    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh" event={"ID":"2f711997-b4cd-4393-8740-96bb17ec3834","Type":"ContainerDied","Data":"9d8c1d3b68eb8eda90bf12779ae58c44a8a2391776471e6a41e186165a2a6c9f"}
Sep 10 22:11:58.911046 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:58.911007    2577 scope.go:117] "RemoveContainer" containerID="9d8c1d3b68eb8eda90bf12779ae58c44a8a2391776471e6a41e186165a2a6c9f"
Sep 10 22:11:58.911992 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:58.911963    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:11:58.912052 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:58.912035    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:11:58.912094 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:58.912067    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:11:59.918421 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:11:59.918378    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh" event={"ID":"2f711997-b4cd-4393-8740-96bb17ec3834","Type":"ContainerStarted","Data":"9a132e8d95d5082686611ffae068d2befb55649dfaa185290898e4bebf004ae3"}
Sep 10 22:12:00.458591 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:00.458549    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:12:00.458916 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:00.458883    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4vbvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 10 22:12:00.459064 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:00.458949    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh" podUID="2f711997-b4cd-4393-8740-96bb17ec3834" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 10 22:12:01.458871 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:01.458828    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4vbvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 10 22:12:01.459384 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:01.458887    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh" podUID="2f711997-b4cd-4393-8740-96bb17ec3834" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 10 22:12:02.458944 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:02.458898    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4vbvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 10 22:12:02.459443 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:02.458974    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh" podUID="2f711997-b4cd-4393-8740-96bb17ec3834" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 10 22:12:03.458855 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:03.458813    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4vbvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 10 22:12:03.459071 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:03.458889    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh" podUID="2f711997-b4cd-4393-8740-96bb17ec3834" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 10 22:12:03.882570 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:03.882489    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-6dszf"
Sep 10 22:12:04.459111 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:04.459060    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4vbvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 10 22:12:04.459611 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:04.459145    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh" podUID="2f711997-b4cd-4393-8740-96bb17ec3834" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 10 22:12:05.462107 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:05.462078    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:12:05.462573 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:05.462368    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:12:05.463042 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:05.463026    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4vbvh"
Sep 10 22:12:11.508921 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.508877    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"]
Sep 10 22:12:11.516954 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.516928    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:11.519522 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.519495    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 22:12:11.519683 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.519510    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 10 22:12:11.520196 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.520174    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 22:12:11.520397 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.520360    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2s65g\""
Sep 10 22:12:11.523404 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.523384    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"]
Sep 10 22:12:11.581126 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.581084    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e9d6e42-715c-41bb-9388-7e07f035ec4b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl\" (UID: \"0e9d6e42-715c-41bb-9388-7e07f035ec4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:11.581303 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.581134    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e9d6e42-715c-41bb-9388-7e07f035ec4b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl\" (UID: \"0e9d6e42-715c-41bb-9388-7e07f035ec4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:11.581303 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.581183    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e9d6e42-715c-41bb-9388-7e07f035ec4b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl\" (UID: \"0e9d6e42-715c-41bb-9388-7e07f035ec4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:11.581303 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.581236    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5sw9\" (UniqueName: \"kubernetes.io/projected/0e9d6e42-715c-41bb-9388-7e07f035ec4b-kube-api-access-w5sw9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl\" (UID: \"0e9d6e42-715c-41bb-9388-7e07f035ec4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:11.581303 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.581260    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e9d6e42-715c-41bb-9388-7e07f035ec4b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl\" (UID: \"0e9d6e42-715c-41bb-9388-7e07f035ec4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:11.581443 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.581305    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e9d6e42-715c-41bb-9388-7e07f035ec4b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl\" (UID: \"0e9d6e42-715c-41bb-9388-7e07f035ec4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:11.682523 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.682491    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5sw9\" (UniqueName: \"kubernetes.io/projected/0e9d6e42-715c-41bb-9388-7e07f035ec4b-kube-api-access-w5sw9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl\" (UID: \"0e9d6e42-715c-41bb-9388-7e07f035ec4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:11.682732 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.682529    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e9d6e42-715c-41bb-9388-7e07f035ec4b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl\" (UID: \"0e9d6e42-715c-41bb-9388-7e07f035ec4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:11.682732 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.682557    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e9d6e42-715c-41bb-9388-7e07f035ec4b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl\" (UID: \"0e9d6e42-715c-41bb-9388-7e07f035ec4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:11.682732 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.682597    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e9d6e42-715c-41bb-9388-7e07f035ec4b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl\" (UID: \"0e9d6e42-715c-41bb-9388-7e07f035ec4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:11.682732 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.682625    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e9d6e42-715c-41bb-9388-7e07f035ec4b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl\" (UID: \"0e9d6e42-715c-41bb-9388-7e07f035ec4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:11.682732 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.682650    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e9d6e42-715c-41bb-9388-7e07f035ec4b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl\" (UID: \"0e9d6e42-715c-41bb-9388-7e07f035ec4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:11.683033 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.682992    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e9d6e42-715c-41bb-9388-7e07f035ec4b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl\" (UID: \"0e9d6e42-715c-41bb-9388-7e07f035ec4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:11.683033 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.683009    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e9d6e42-715c-41bb-9388-7e07f035ec4b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl\" (UID: \"0e9d6e42-715c-41bb-9388-7e07f035ec4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:11.683122 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.683105    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e9d6e42-715c-41bb-9388-7e07f035ec4b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl\" (UID: \"0e9d6e42-715c-41bb-9388-7e07f035ec4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:11.685125 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.685095    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e9d6e42-715c-41bb-9388-7e07f035ec4b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl\" (UID: \"0e9d6e42-715c-41bb-9388-7e07f035ec4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:11.685359 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.685343    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e9d6e42-715c-41bb-9388-7e07f035ec4b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl\" (UID: \"0e9d6e42-715c-41bb-9388-7e07f035ec4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:11.691641 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.691618    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5sw9\" (UniqueName: \"kubernetes.io/projected/0e9d6e42-715c-41bb-9388-7e07f035ec4b-kube-api-access-w5sw9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl\" (UID: \"0e9d6e42-715c-41bb-9388-7e07f035ec4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:11.829516 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:11.829420    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:12.116810 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:12.116770    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"]
Sep 10 22:12:12.118479 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:12:12.118444    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e9d6e42_715c_41bb_9388_7e07f035ec4b.slice/crio-b73b3198284093f991947a3e2f7c8384d912f65b08cfc6dfdbca6bd8a0e36700 WatchSource:0}: Error finding container b73b3198284093f991947a3e2f7c8384d912f65b08cfc6dfdbca6bd8a0e36700: Status 404 returned error can't find the container with id b73b3198284093f991947a3e2f7c8384d912f65b08cfc6dfdbca6bd8a0e36700
Sep 10 22:12:12.170572 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:12.170536    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:12:13.000474 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:13.000427    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl" event={"ID":"0e9d6e42-715c-41bb-9388-7e07f035ec4b","Type":"ContainerStarted","Data":"b73b3198284093f991947a3e2f7c8384d912f65b08cfc6dfdbca6bd8a0e36700"}
Sep 10 22:12:14.007409 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:14.007380    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl" event={"ID":"0e9d6e42-715c-41bb-9388-7e07f035ec4b","Type":"ContainerStarted","Data":"a475a8094075615035144734044473c5cad6154e2dd56c58cfbf4ed4c61061ea"}
Sep 10 22:12:14.024182 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:14.024121    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl" podStartSLOduration=1.824505472 podStartE2EDuration="3.024103592s" totalImagesPullingTime="1.19959812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:12:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:12:14.023657157 +0000 UTC m=+638.695755079" watchObservedRunningTime="2026-09-10 22:12:14.024103592 +0000 UTC m=+638.696201512"
Sep 10 22:12:19.451417 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:19.451373    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:12:21.830085 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:21.830047    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:21.830503 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:21.830112    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:21.852501 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:21.852474    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:22.068428 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:22.068397    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl"
Sep 10 22:12:33.268082 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:33.268028    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:12:41.557168 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:41.557130    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:12:48.690176 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:48.690131    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"]
Sep 10 22:12:48.694254 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:48.694227    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:48.696506 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:48.696482    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 10 22:12:48.705800 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:48.705751    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"]
Sep 10 22:12:48.825694 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:48.825654    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca1df9dd-7d58-40aa-bb72-1981089218f2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56\" (UID: \"ca1df9dd-7d58-40aa-bb72-1981089218f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:48.825694 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:48.825693    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca1df9dd-7d58-40aa-bb72-1981089218f2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56\" (UID: \"ca1df9dd-7d58-40aa-bb72-1981089218f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:48.825922 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:48.825723    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca1df9dd-7d58-40aa-bb72-1981089218f2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56\" (UID: \"ca1df9dd-7d58-40aa-bb72-1981089218f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:48.825922 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:48.825797    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca1df9dd-7d58-40aa-bb72-1981089218f2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56\" (UID: \"ca1df9dd-7d58-40aa-bb72-1981089218f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:48.825922 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:48.825880    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca1df9dd-7d58-40aa-bb72-1981089218f2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56\" (UID: \"ca1df9dd-7d58-40aa-bb72-1981089218f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:48.825922 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:48.825917    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m7lk\" (UniqueName: \"kubernetes.io/projected/ca1df9dd-7d58-40aa-bb72-1981089218f2-kube-api-access-6m7lk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56\" (UID: \"ca1df9dd-7d58-40aa-bb72-1981089218f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:48.926389 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:48.926349    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m7lk\" (UniqueName: \"kubernetes.io/projected/ca1df9dd-7d58-40aa-bb72-1981089218f2-kube-api-access-6m7lk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56\" (UID: \"ca1df9dd-7d58-40aa-bb72-1981089218f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:48.926593 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:48.926426    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca1df9dd-7d58-40aa-bb72-1981089218f2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56\" (UID: \"ca1df9dd-7d58-40aa-bb72-1981089218f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:48.926593 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:48.926459    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca1df9dd-7d58-40aa-bb72-1981089218f2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56\" (UID: \"ca1df9dd-7d58-40aa-bb72-1981089218f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:48.926593 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:48.926501    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca1df9dd-7d58-40aa-bb72-1981089218f2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56\" (UID: \"ca1df9dd-7d58-40aa-bb72-1981089218f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:48.926593 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:48.926553    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca1df9dd-7d58-40aa-bb72-1981089218f2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56\" (UID: \"ca1df9dd-7d58-40aa-bb72-1981089218f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:48.926844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:48.926601    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca1df9dd-7d58-40aa-bb72-1981089218f2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56\" (UID: \"ca1df9dd-7d58-40aa-bb72-1981089218f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:48.926993 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:48.926970    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca1df9dd-7d58-40aa-bb72-1981089218f2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56\" (UID: \"ca1df9dd-7d58-40aa-bb72-1981089218f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:48.927053 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:48.927029    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca1df9dd-7d58-40aa-bb72-1981089218f2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56\" (UID: \"ca1df9dd-7d58-40aa-bb72-1981089218f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:48.927053 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:48.927045    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca1df9dd-7d58-40aa-bb72-1981089218f2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56\" (UID: \"ca1df9dd-7d58-40aa-bb72-1981089218f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:48.928912 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:48.928892    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca1df9dd-7d58-40aa-bb72-1981089218f2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56\" (UID: \"ca1df9dd-7d58-40aa-bb72-1981089218f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:48.929277 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:48.929254    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca1df9dd-7d58-40aa-bb72-1981089218f2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56\" (UID: \"ca1df9dd-7d58-40aa-bb72-1981089218f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:48.935214 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:48.935185    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m7lk\" (UniqueName: \"kubernetes.io/projected/ca1df9dd-7d58-40aa-bb72-1981089218f2-kube-api-access-6m7lk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56\" (UID: \"ca1df9dd-7d58-40aa-bb72-1981089218f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:49.006028 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:49.005928    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:49.281379 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:49.281352    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"]
Sep 10 22:12:49.283473 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:12:49.283448    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca1df9dd_7d58_40aa_bb72_1981089218f2.slice/crio-fd00f3fc91dff5e53bfee4be748c5d0895426051cd93dcb7c4d961effc9c4524 WatchSource:0}: Error finding container fd00f3fc91dff5e53bfee4be748c5d0895426051cd93dcb7c4d961effc9c4524: Status 404 returned error can't find the container with id fd00f3fc91dff5e53bfee4be748c5d0895426051cd93dcb7c4d961effc9c4524
Sep 10 22:12:50.161105 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:50.161071    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:12:50.218042 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:50.218000    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56" event={"ID":"ca1df9dd-7d58-40aa-bb72-1981089218f2","Type":"ContainerStarted","Data":"e7dabf7bc51f2177e9c31993c6d4809dfa685d53357b6e4c74980325ffa0ec54"}
Sep 10 22:12:50.218201 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:50.218057    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56" event={"ID":"ca1df9dd-7d58-40aa-bb72-1981089218f2","Type":"ContainerStarted","Data":"fd00f3fc91dff5e53bfee4be748c5d0895426051cd93dcb7c4d961effc9c4524"}
Sep 10 22:12:50.238135 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:50.238075    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56" podStartSLOduration=2.006909941 podStartE2EDuration="2.238053878s" totalImagesPullingTime="231.143937ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:12:50.235167471 +0000 UTC m=+674.907265392" watchObservedRunningTime="2026-09-10 22:12:50.238053878 +0000 UTC m=+674.910151800"
Sep 10 22:12:59.006657 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:59.006619    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:59.007089 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:59.006680    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:59.019577 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:59.019548    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:59.279893 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:59.279812    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56"
Sep 10 22:12:59.568463 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:12:59.568381    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:13:05.178105 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:13:05.178067    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:14:39.083763 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.083723    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"]
Sep 10 22:14:39.087710 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.087681    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.091035 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.091006    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-e5a2d7-openshift-default-dockercfg-q9pvt\""
Sep 10 22:14:39.104633 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.104600    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"]
Sep 10 22:14:39.117314 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.117274    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pllh8\" (UniqueName: \"kubernetes.io/projected/36c89b81-ed84-445d-8fe3-acdf2077a846-kube-api-access-pllh8\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.117476 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.117326    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-token\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.117476 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.117410    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-data\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.117476 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.117455    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-envoy\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.117734 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.117490    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36c89b81-ed84-445d-8fe3-acdf2077a846-istiod-ca-cert\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.117734 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.117528    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-workload-certs\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.117734 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.117558    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-credential-socket\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.117734 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.117574    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-podinfo\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.117734 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.117659    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-workload-socket\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.218292 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.218258    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-credential-socket\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.218292 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.218295    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-podinfo\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.218555 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.218483    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-workload-socket\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.218555 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.218528    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pllh8\" (UniqueName: \"kubernetes.io/projected/36c89b81-ed84-445d-8fe3-acdf2077a846-kube-api-access-pllh8\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.218668 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.218565    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-token\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.218668 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.218630    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-data\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.218798 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.218690    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-envoy\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.218798 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.218718    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36c89b81-ed84-445d-8fe3-acdf2077a846-istiod-ca-cert\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.218798 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.218724    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-credential-socket\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.218798 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.218750    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-workload-certs\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.219053 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.218828    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-workload-socket\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.219131 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.219106    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-data\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.219172 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.219128    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-workload-certs\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.219425 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.219409    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36c89b81-ed84-445d-8fe3-acdf2077a846-istiod-ca-cert\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.221137 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.221118    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-podinfo\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.221342 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.221325    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-envoy\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.226280 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.226253    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-token\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.226808 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.226756    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pllh8\" (UniqueName: \"kubernetes.io/projected/36c89b81-ed84-445d-8fe3-acdf2077a846-kube-api-access-pllh8\") pod \"e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") " pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.400105 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.400075    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:39.690873 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.690845    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"]
Sep 10 22:14:39.691163 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:14:39.691142    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c89b81_ed84_445d_8fe3_acdf2077a846.slice/crio-3e2df4137109c51d5a302f8219716f1e0a77dcb29facad3da917790df5589f06 WatchSource:0}: Error finding container 3e2df4137109c51d5a302f8219716f1e0a77dcb29facad3da917790df5589f06: Status 404 returned error can't find the container with id 3e2df4137109c51d5a302f8219716f1e0a77dcb29facad3da917790df5589f06
Sep 10 22:14:39.693970 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.693933    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:14:39.694085 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.694014    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:14:39.694085 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.694057    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:14:39.855176 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.855135    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r" event={"ID":"36c89b81-ed84-445d-8fe3-acdf2077a846","Type":"ContainerStarted","Data":"8baef7bc6cc878b3a74b5e8cc417459826099ea458549c2cd54df2ba953ec1bb"}
Sep 10 22:14:39.855365 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.855211    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r" event={"ID":"36c89b81-ed84-445d-8fe3-acdf2077a846","Type":"ContainerStarted","Data":"3e2df4137109c51d5a302f8219716f1e0a77dcb29facad3da917790df5589f06"}
Sep 10 22:14:39.880230 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:39.880170    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r" podStartSLOduration=0.880148028 podStartE2EDuration="880.148028ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:14:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:14:39.879373613 +0000 UTC m=+784.551471535" watchObservedRunningTime="2026-09-10 22:14:39.880148028 +0000 UTC m=+784.552245950"
Sep 10 22:14:40.400463 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:40.400428    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:40.405503 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:40.405476    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:40.860863 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:40.860756    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:40.861730 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:40.861715    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:14:42.563206 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:42.563173    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:14:50.961019 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:50.960982    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5"]
Sep 10 22:14:50.964635 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:50.964613    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5"
Sep 10 22:14:50.966694 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:50.966675    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-d6a4de\""
Sep 10 22:14:50.966855 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:50.966676    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-d6a4de-dockercfg-s9cnc\""
Sep 10 22:14:50.975936 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:50.975910    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5"]
Sep 10 22:14:51.027486 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:51.027454    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/beefc640-d0b0-4e8c-b4eb-941f2daa5c71-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5\" (UID: \"beefc640-d0b0-4e8c-b4eb-941f2daa5c71\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5"
Sep 10 22:14:51.027651 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:51.027565    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q264n\" (UniqueName: \"kubernetes.io/projected/beefc640-d0b0-4e8c-b4eb-941f2daa5c71-kube-api-access-q264n\") pod \"payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5\" (UID: \"beefc640-d0b0-4e8c-b4eb-941f2daa5c71\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5"
Sep 10 22:14:51.128414 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:51.128374    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q264n\" (UniqueName: \"kubernetes.io/projected/beefc640-d0b0-4e8c-b4eb-941f2daa5c71-kube-api-access-q264n\") pod \"payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5\" (UID: \"beefc640-d0b0-4e8c-b4eb-941f2daa5c71\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5"
Sep 10 22:14:51.128610 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:51.128437    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/beefc640-d0b0-4e8c-b4eb-941f2daa5c71-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5\" (UID: \"beefc640-d0b0-4e8c-b4eb-941f2daa5c71\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5"
Sep 10 22:14:51.129197 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:51.129176    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/beefc640-d0b0-4e8c-b4eb-941f2daa5c71-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5\" (UID: \"beefc640-d0b0-4e8c-b4eb-941f2daa5c71\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5"
Sep 10 22:14:51.136864 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:51.136836    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q264n\" (UniqueName: \"kubernetes.io/projected/beefc640-d0b0-4e8c-b4eb-941f2daa5c71-kube-api-access-q264n\") pod \"payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5\" (UID: \"beefc640-d0b0-4e8c-b4eb-941f2daa5c71\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5"
Sep 10 22:14:51.279366 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:51.279258    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5"
Sep 10 22:14:51.569198 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:51.566556    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5"]
Sep 10 22:14:51.569590 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:14:51.569553    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeefc640_d0b0_4e8c_b4eb_941f2daa5c71.slice/crio-15b4dc310c3a6a5506942a7924cc02496b8162e132d04102d84b20f9bb2dabfb WatchSource:0}: Error finding container 15b4dc310c3a6a5506942a7924cc02496b8162e132d04102d84b20f9bb2dabfb: Status 404 returned error can't find the container with id 15b4dc310c3a6a5506942a7924cc02496b8162e132d04102d84b20f9bb2dabfb
Sep 10 22:14:51.928997 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:51.928960    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5" event={"ID":"beefc640-d0b0-4e8c-b4eb-941f2daa5c71","Type":"ContainerStarted","Data":"15cf9a53ac1eb5a76f82220fa84d6369428852b283917b1b4bb29d6b86dac793"}
Sep 10 22:14:51.929157 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:51.929019    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5" event={"ID":"beefc640-d0b0-4e8c-b4eb-941f2daa5c71","Type":"ContainerStarted","Data":"15b4dc310c3a6a5506942a7924cc02496b8162e132d04102d84b20f9bb2dabfb"}
Sep 10 22:14:51.929157 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:51.929154    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5"
Sep 10 22:14:51.950432 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:51.950362    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5" podStartSLOduration=1.9503366789999999 podStartE2EDuration="1.950336679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:14:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:14:51.947762608 +0000 UTC m=+796.619860529" watchObservedRunningTime="2026-09-10 22:14:51.950336679 +0000 UTC m=+796.622434603"
Sep 10 22:14:52.058023 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.057984    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"]
Sep 10 22:14:52.063319 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.063291    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"
Sep 10 22:14:52.066121 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.065927    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-2d222ead-serving-cert\""
Sep 10 22:14:52.068279 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.066355    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 22:14:52.068279 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.066573    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-spztp\""
Sep 10 22:14:52.087067 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.087036    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"]
Sep 10 22:14:52.150635 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.150286    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-openshift-service-ca\") pod \"maas-api-e2e-ait-2d222ead-7767956684-t9hqr\" (UID: \"b6f27fed-c94e-4d05-96a8-6b4e86c093c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"
Sep 10 22:14:52.150635 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.150422    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-maas-api-tls\") pod \"maas-api-e2e-ait-2d222ead-7767956684-t9hqr\" (UID: \"b6f27fed-c94e-4d05-96a8-6b4e86c093c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"
Sep 10 22:14:52.150635 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.150455    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-metrics-certs\") pod \"maas-api-e2e-ait-2d222ead-7767956684-t9hqr\" (UID: \"b6f27fed-c94e-4d05-96a8-6b4e86c093c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"
Sep 10 22:14:52.150635 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.150516    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppnfh\" (UniqueName: \"kubernetes.io/projected/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-kube-api-access-ppnfh\") pod \"maas-api-e2e-ait-2d222ead-7767956684-t9hqr\" (UID: \"b6f27fed-c94e-4d05-96a8-6b4e86c093c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"
Sep 10 22:14:52.251984 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.251867    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppnfh\" (UniqueName: \"kubernetes.io/projected/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-kube-api-access-ppnfh\") pod \"maas-api-e2e-ait-2d222ead-7767956684-t9hqr\" (UID: \"b6f27fed-c94e-4d05-96a8-6b4e86c093c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"
Sep 10 22:14:52.251984 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.251960    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-openshift-service-ca\") pod \"maas-api-e2e-ait-2d222ead-7767956684-t9hqr\" (UID: \"b6f27fed-c94e-4d05-96a8-6b4e86c093c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"
Sep 10 22:14:52.252211 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.252080    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-maas-api-tls\") pod \"maas-api-e2e-ait-2d222ead-7767956684-t9hqr\" (UID: \"b6f27fed-c94e-4d05-96a8-6b4e86c093c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"
Sep 10 22:14:52.252211 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.252110    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-metrics-certs\") pod \"maas-api-e2e-ait-2d222ead-7767956684-t9hqr\" (UID: \"b6f27fed-c94e-4d05-96a8-6b4e86c093c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"
Sep 10 22:14:52.253002 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:14:52.252721    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-serving-cert: secret "maas-api-e2e-ait-2d222ead-serving-cert" not found
Sep 10 22:14:52.253002 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:14:52.252816    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-maas-api-tls podName:b6f27fed-c94e-4d05-96a8-6b4e86c093c3 nodeName:}" failed. No retries permitted until 2026-09-10 22:14:52.752771677 +0000 UTC m=+797.424869593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-maas-api-tls") pod "maas-api-e2e-ait-2d222ead-7767956684-t9hqr" (UID: "b6f27fed-c94e-4d05-96a8-6b4e86c093c3") : secret "maas-api-e2e-ait-2d222ead-serving-cert" not found
Sep 10 22:14:52.253969 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.253947    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-openshift-service-ca\") pod \"maas-api-e2e-ait-2d222ead-7767956684-t9hqr\" (UID: \"b6f27fed-c94e-4d05-96a8-6b4e86c093c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"
Sep 10 22:14:52.263353 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.263286    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppnfh\" (UniqueName: \"kubernetes.io/projected/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-kube-api-access-ppnfh\") pod \"maas-api-e2e-ait-2d222ead-7767956684-t9hqr\" (UID: \"b6f27fed-c94e-4d05-96a8-6b4e86c093c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"
Sep 10 22:14:52.266546 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.266510    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-metrics-certs\") pod \"maas-api-e2e-ait-2d222ead-7767956684-t9hqr\" (UID: \"b6f27fed-c94e-4d05-96a8-6b4e86c093c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"
Sep 10 22:14:52.759806 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.759392    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-maas-api-tls\") pod \"maas-api-e2e-ait-2d222ead-7767956684-t9hqr\" (UID: \"b6f27fed-c94e-4d05-96a8-6b4e86c093c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"
Sep 10 22:14:52.763806 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.763713    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-maas-api-tls\") pod \"maas-api-e2e-ait-2d222ead-7767956684-t9hqr\" (UID: \"b6f27fed-c94e-4d05-96a8-6b4e86c093c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"
Sep 10 22:14:52.775377 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.775347    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt"]
Sep 10 22:14:52.779012 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.778996    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt"
Sep 10 22:14:52.780826 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.780804    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-2d222ead-dockercfg-8vqng\""
Sep 10 22:14:52.780942 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.780809    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-2d222ead\""
Sep 10 22:14:52.790023 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.789999    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt"]
Sep 10 22:14:52.862445 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.862397    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d759399-1381-4439-b951-2c14fad80ade-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt\" (UID: \"4d759399-1381-4439-b951-2c14fad80ade\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt"
Sep 10 22:14:52.862640 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.862496    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm5mk\" (UniqueName: \"kubernetes.io/projected/4d759399-1381-4439-b951-2c14fad80ade-kube-api-access-fm5mk\") pod \"payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt\" (UID: \"4d759399-1381-4439-b951-2c14fad80ade\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt"
Sep 10 22:14:52.963882 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.963847    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d759399-1381-4439-b951-2c14fad80ade-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt\" (UID: \"4d759399-1381-4439-b951-2c14fad80ade\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt"
Sep 10 22:14:52.964089 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.963905    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm5mk\" (UniqueName: \"kubernetes.io/projected/4d759399-1381-4439-b951-2c14fad80ade-kube-api-access-fm5mk\") pod \"payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt\" (UID: \"4d759399-1381-4439-b951-2c14fad80ade\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt"
Sep 10 22:14:52.964619 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.964591    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d759399-1381-4439-b951-2c14fad80ade-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt\" (UID: \"4d759399-1381-4439-b951-2c14fad80ade\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt"
Sep 10 22:14:52.976207 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.976173    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm5mk\" (UniqueName: \"kubernetes.io/projected/4d759399-1381-4439-b951-2c14fad80ade-kube-api-access-fm5mk\") pod \"payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt\" (UID: \"4d759399-1381-4439-b951-2c14fad80ade\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt"
Sep 10 22:14:52.986534 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:52.986491    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"
Sep 10 22:14:53.090516 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:53.090480    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt"
Sep 10 22:14:53.296073 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:53.296044    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"]
Sep 10 22:14:53.297530 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:14:53.297500    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6f27fed_c94e_4d05_96a8_6b4e86c093c3.slice/crio-d952fa7ecb520b247e0fe9cfdb72a6e808cab7bc0cbb59a0b5573aefaa83b14e WatchSource:0}: Error finding container d952fa7ecb520b247e0fe9cfdb72a6e808cab7bc0cbb59a0b5573aefaa83b14e: Status 404 returned error can't find the container with id d952fa7ecb520b247e0fe9cfdb72a6e808cab7bc0cbb59a0b5573aefaa83b14e
Sep 10 22:14:53.389658 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:53.389631    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt"]
Sep 10 22:14:53.391396 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:14:53.391372    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d759399_1381_4439_b951_2c14fad80ade.slice/crio-ac579ce5219d97668cc2d776dba8c2dacfc6c82f86c734fbf14bb4f2af23005a WatchSource:0}: Error finding container ac579ce5219d97668cc2d776dba8c2dacfc6c82f86c734fbf14bb4f2af23005a: Status 404 returned error can't find the container with id ac579ce5219d97668cc2d776dba8c2dacfc6c82f86c734fbf14bb4f2af23005a
Sep 10 22:14:53.968695 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:53.968604    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr" event={"ID":"b6f27fed-c94e-4d05-96a8-6b4e86c093c3","Type":"ContainerStarted","Data":"d952fa7ecb520b247e0fe9cfdb72a6e808cab7bc0cbb59a0b5573aefaa83b14e"}
Sep 10 22:14:53.971428 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:53.971234    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt" event={"ID":"4d759399-1381-4439-b951-2c14fad80ade","Type":"ContainerStarted","Data":"96c7d6709679dde5209213af952458c54db52f05fd9e169b033ff7e03d242647"}
Sep 10 22:14:53.971428 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:53.971289    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt" event={"ID":"4d759399-1381-4439-b951-2c14fad80ade","Type":"ContainerStarted","Data":"ac579ce5219d97668cc2d776dba8c2dacfc6c82f86c734fbf14bb4f2af23005a"}
Sep 10 22:14:53.971794 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:53.971757    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt"
Sep 10 22:14:53.989076 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:53.988093    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt" podStartSLOduration=1.9880699179999999 podStartE2EDuration="1.988069918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:14:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:14:53.986720644 +0000 UTC m=+798.658818579" watchObservedRunningTime="2026-09-10 22:14:53.988069918 +0000 UTC m=+798.660167840"
Sep 10 22:14:56.680330 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:56.680295    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:14:56.992978 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:56.992876    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr" event={"ID":"b6f27fed-c94e-4d05-96a8-6b4e86c093c3","Type":"ContainerStarted","Data":"8f8491f0429db4d351f4c323d3fdcbf28ae7c9d0f0ea6c6b54ad9f4374b06204"}
Sep 10 22:14:56.993150 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:56.993054    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"
Sep 10 22:14:57.014249 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:14:57.014189    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr" podStartSLOduration=2.033798625 podStartE2EDuration="5.014172913s" totalImagesPullingTime="2.980374288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:14:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:14:57.011532975 +0000 UTC m=+801.683630897" watchObservedRunningTime="2026-09-10 22:14:57.014172913 +0000 UTC m=+801.686270897"
Sep 10 22:15:00.140848 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:00.140807    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817975-tfpfh"]
Sep 10 22:15:00.144429 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:00.144412    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-d6a4de-29817975-ltg8z"]
Sep 10 22:15:00.144549 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:00.144529    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817975-tfpfh"
Sep 10 22:15:00.146650 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:00.146624    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8hjrv\""
Sep 10 22:15:00.147717 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:00.147695    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-d6a4de-29817975-ltg8z"
Sep 10 22:15:00.158095 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:00.157263    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-d6a4de-29817975-ltg8z"]
Sep 10 22:15:00.158840 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:00.158810    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817975-tfpfh"]
Sep 10 22:15:00.162839 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:00.162812    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817975-tfpfh"
Sep 10 22:15:00.170702 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:00.170677    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-d6a4de-29817975-ltg8z"
Sep 10 22:15:00.446830 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:00.446804    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817975-tfpfh"]
Sep 10 22:15:00.448200 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:15:00.448170    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde38d686_856c_4809_b288_5bf47b6fb3b4.slice/crio-b500bd5ef4b4f4ac177b66f8757588bdbec35afa3388ce671b0fbc0e69b75b0e WatchSource:0}: Error finding container b500bd5ef4b4f4ac177b66f8757588bdbec35afa3388ce671b0fbc0e69b75b0e: Status 404 returned error can't find the container with id b500bd5ef4b4f4ac177b66f8757588bdbec35afa3388ce671b0fbc0e69b75b0e
Sep 10 22:15:00.454203 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:00.454175    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-d6a4de-29817975-ltg8z"]
Sep 10 22:15:00.454749 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:15:00.454728    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3b9190_2e93_45bb_a1ce_925e0207e661.slice/crio-522ec06363a3bfe698f911651170923d2167d5c5d68ebb6cc3c318b4b4bf0e9e WatchSource:0}: Error finding container 522ec06363a3bfe698f911651170923d2167d5c5d68ebb6cc3c318b4b4bf0e9e: Status 404 returned error can't find the container with id 522ec06363a3bfe698f911651170923d2167d5c5d68ebb6cc3c318b4b4bf0e9e
Sep 10 22:15:01.019360 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:01.019325    2577 generic.go:356] "Generic (PLEG): container finished" podID="36c89b81-ed84-445d-8fe3-acdf2077a846" containerID="8baef7bc6cc878b3a74b5e8cc417459826099ea458549c2cd54df2ba953ec1bb" exitCode=0
Sep 10 22:15:01.019557 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:01.019405    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r" event={"ID":"36c89b81-ed84-445d-8fe3-acdf2077a846","Type":"ContainerDied","Data":"8baef7bc6cc878b3a74b5e8cc417459826099ea458549c2cd54df2ba953ec1bb"}
Sep 10 22:15:01.019891 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:01.019871    2577 scope.go:117] "RemoveContainer" containerID="8baef7bc6cc878b3a74b5e8cc417459826099ea458549c2cd54df2ba953ec1bb"
Sep 10 22:15:01.020969 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:01.020940    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817975-tfpfh" event={"ID":"de38d686-856c-4809-b288-5bf47b6fb3b4","Type":"ContainerStarted","Data":"b500bd5ef4b4f4ac177b66f8757588bdbec35afa3388ce671b0fbc0e69b75b0e"}
Sep 10 22:15:01.021099 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:01.021016    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:15:01.021099 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:01.021087    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:15:01.021209 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:01.021132    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:15:01.022349 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:01.022328    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-d6a4de-29817975-ltg8z" event={"ID":"4b3b9190-2e93-45bb-a1ce-925e0207e661","Type":"ContainerStarted","Data":"522ec06363a3bfe698f911651170923d2167d5c5d68ebb6cc3c318b4b4bf0e9e"}
Sep 10 22:15:02.048164 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:02.047140    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r" event={"ID":"36c89b81-ed84-445d-8fe3-acdf2077a846","Type":"ContainerStarted","Data":"9a9539559ae3bd7a0535eb85015fcc89fe47c564b0298fb6a83ea6c0c40c2586"}
Sep 10 22:15:02.400796 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:02.400748    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:15:02.401333 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:02.401305    2577 patch_prober.go:28] interesting pod/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 10 22:15:02.401476 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:02.401357    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r" podUID="36c89b81-ed84-445d-8fe3-acdf2077a846" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 10 22:15:02.956345 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:02.956303    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5"
Sep 10 22:15:03.011314 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:03.011282    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"
Sep 10 22:15:03.400680 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:03.400645    2577 patch_prober.go:28] interesting pod/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 10 22:15:03.401186 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:03.400725    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r" podUID="36c89b81-ed84-445d-8fe3-acdf2077a846" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 10 22:15:04.076551 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:04.076442    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817975-tfpfh" event={"ID":"de38d686-856c-4809-b288-5bf47b6fb3b4","Type":"ContainerStarted","Data":"0f557687b41a2c06ea7d751dedd0797461d88a0658c0124c2c30a383456b82e5"}
Sep 10 22:15:04.078097 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:04.078072    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-d6a4de-29817975-ltg8z" event={"ID":"4b3b9190-2e93-45bb-a1ce-925e0207e661","Type":"ContainerStarted","Data":"edb9f3274bb0c0eea57d44d269aff423591a5c092ef0d4ac259ff4209de1c599"}
Sep 10 22:15:04.096368 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:04.096304    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817975-tfpfh" podStartSLOduration=1.051708427 podStartE2EDuration="4.096287082s" totalImagesPullingTime="3.044578655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:15:04.094027552 +0000 UTC m=+808.766125475" watchObservedRunningTime="2026-09-10 22:15:04.096287082 +0000 UTC m=+808.768385003"
Sep 10 22:15:04.112059 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:04.112004    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-d6a4de-29817975-ltg8z" podStartSLOduration=1.078219478 podStartE2EDuration="4.111984567s" totalImagesPullingTime="3.033765089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:15:04.110630818 +0000 UTC m=+808.782728740" watchObservedRunningTime="2026-09-10 22:15:04.111984567 +0000 UTC m=+808.784082539"
Sep 10 22:15:04.400528 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:04.400487    2577 patch_prober.go:28] interesting pod/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 10 22:15:04.400738 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:04.400558    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r" podUID="36c89b81-ed84-445d-8fe3-acdf2077a846" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 10 22:15:04.981124 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:04.980930    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt"
Sep 10 22:15:05.087192 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:05.087043    2577 generic.go:356] "Generic (PLEG): container finished" podID="de38d686-856c-4809-b288-5bf47b6fb3b4" containerID="0f557687b41a2c06ea7d751dedd0797461d88a0658c0124c2c30a383456b82e5" exitCode=0
Sep 10 22:15:05.087192 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:05.087153    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817975-tfpfh" event={"ID":"de38d686-856c-4809-b288-5bf47b6fb3b4","Type":"ContainerDied","Data":"0f557687b41a2c06ea7d751dedd0797461d88a0658c0124c2c30a383456b82e5"}
Sep 10 22:15:05.089061 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:05.089032    2577 generic.go:356] "Generic (PLEG): container finished" podID="4b3b9190-2e93-45bb-a1ce-925e0207e661" containerID="edb9f3274bb0c0eea57d44d269aff423591a5c092ef0d4ac259ff4209de1c599" exitCode=0
Sep 10 22:15:05.089216 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:05.089139    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-d6a4de-29817975-ltg8z" event={"ID":"4b3b9190-2e93-45bb-a1ce-925e0207e661","Type":"ContainerDied","Data":"edb9f3274bb0c0eea57d44d269aff423591a5c092ef0d4ac259ff4209de1c599"}
Sep 10 22:15:05.401317 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:05.401281    2577 patch_prober.go:28] interesting pod/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 10 22:15:05.401716 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:05.401338    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r" podUID="36c89b81-ed84-445d-8fe3-acdf2077a846" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 10 22:15:06.295480 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:06.295455    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817975-tfpfh"
Sep 10 22:15:06.298037 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:06.298019    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-d6a4de-29817975-ltg8z"
Sep 10 22:15:06.401039 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:06.401002    2577 patch_prober.go:28] interesting pod/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 10 22:15:06.401214 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:06.401066    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r" podUID="36c89b81-ed84-445d-8fe3-acdf2077a846" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 10 22:15:07.102024 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.101985    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817975-tfpfh"
Sep 10 22:15:07.102521 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.101984    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817975-tfpfh" event={"ID":"de38d686-856c-4809-b288-5bf47b6fb3b4","Type":"ContainerDied","Data":"b500bd5ef4b4f4ac177b66f8757588bdbec35afa3388ce671b0fbc0e69b75b0e"}
Sep 10 22:15:07.102521 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.102130    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b500bd5ef4b4f4ac177b66f8757588bdbec35afa3388ce671b0fbc0e69b75b0e"
Sep 10 22:15:07.103516 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.103492    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-d6a4de-29817975-ltg8z"
Sep 10 22:15:07.103653 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.103517    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-d6a4de-29817975-ltg8z" event={"ID":"4b3b9190-2e93-45bb-a1ce-925e0207e661","Type":"ContainerDied","Data":"522ec06363a3bfe698f911651170923d2167d5c5d68ebb6cc3c318b4b4bf0e9e"}
Sep 10 22:15:07.103653 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.103555    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="522ec06363a3bfe698f911651170923d2167d5c5d68ebb6cc3c318b4b4bf0e9e"
Sep 10 22:15:07.404904 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.404871    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:15:07.405267 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.405249    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:15:07.406276 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.406253    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:15:07.461863 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.461833    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"]
Sep 10 22:15:07.462268 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.462255    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b3b9190-2e93-45bb-a1ce-925e0207e661" containerName="cleanup"
Sep 10 22:15:07.462316 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.462270    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b3b9190-2e93-45bb-a1ce-925e0207e661" containerName="cleanup"
Sep 10 22:15:07.462316 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.462280    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de38d686-856c-4809-b288-5bf47b6fb3b4" containerName="cleanup"
Sep 10 22:15:07.462316 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.462287    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="de38d686-856c-4809-b288-5bf47b6fb3b4" containerName="cleanup"
Sep 10 22:15:07.462415 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.462378    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b3b9190-2e93-45bb-a1ce-925e0207e661" containerName="cleanup"
Sep 10 22:15:07.462415 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.462387    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="de38d686-856c-4809-b288-5bf47b6fb3b4" containerName="cleanup"
Sep 10 22:15:07.465843 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.465820    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.470625 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.470603    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-1c252b-openshift-default-dockercfg-nbbkh\""
Sep 10 22:15:07.486093 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.486062    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"]
Sep 10 22:15:07.516275 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.516235    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-workload-certs\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.516455 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.516291    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-credential-socket\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.516455 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.516378    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-workload-socket\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.516455 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.516424    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-podinfo\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.516455 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.516448    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-token\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.516662 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.516487    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istiod-ca-cert\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.516662 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.516562    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-envoy\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.516662 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.516608    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-data\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.516662 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.516640    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twcz7\" (UniqueName: \"kubernetes.io/projected/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-kube-api-access-twcz7\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.617672 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.617626    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-credential-socket\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.617901 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.617708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-workload-socket\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.617901 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.617736    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-podinfo\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.617901 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.617755    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-token\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.617901 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.617807    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istiod-ca-cert\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.617901 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.617869    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-envoy\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.617901 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.617895    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-data\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.618269 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.617926    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twcz7\" (UniqueName: \"kubernetes.io/projected/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-kube-api-access-twcz7\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.618269 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.617979    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-workload-certs\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.618269 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.618134    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-credential-socket\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.618269 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.618177    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-workload-socket\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.618483 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.618445    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-workload-certs\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.618622 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.618599    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-data\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.619354 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.619274    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istiod-ca-cert\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.620762 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.620733    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-envoy\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.621016 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.620993    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-podinfo\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.643645 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.643615    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twcz7\" (UniqueName: \"kubernetes.io/projected/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-kube-api-access-twcz7\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.644142 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.644123    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-token\") pod \"e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") " pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:07.776436 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:07.776351    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:08.085640 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:08.085612    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"]
Sep 10 22:15:08.088217 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:15:08.088186    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb15d88c9_4847_45b0_a0d0_7a21cd2d1545.slice/crio-e21ef7272dfc9ddda0639c344807f6d6f784ee54054d9bfcbdef5acb77fb066f WatchSource:0}: Error finding container e21ef7272dfc9ddda0639c344807f6d6f784ee54054d9bfcbdef5acb77fb066f: Status 404 returned error can't find the container with id e21ef7272dfc9ddda0639c344807f6d6f784ee54054d9bfcbdef5acb77fb066f
Sep 10 22:15:08.090672 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:08.090637    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:15:08.090762 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:08.090723    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:15:08.090832 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:08.090762    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:15:08.118562 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:08.118522    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf" event={"ID":"b15d88c9-4847-45b0-a0d0-7a21cd2d1545","Type":"ContainerStarted","Data":"e21ef7272dfc9ddda0639c344807f6d6f784ee54054d9bfcbdef5acb77fb066f"}
Sep 10 22:15:09.126338 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:09.126297    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf" event={"ID":"b15d88c9-4847-45b0-a0d0-7a21cd2d1545","Type":"ContainerStarted","Data":"14eaaf417a154b3924c0f28ff3c50fe352d647d90abb6945db2a5688fe8e5744"}
Sep 10 22:15:09.160730 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:09.160673    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf" podStartSLOduration=2.160658609 podStartE2EDuration="2.160658609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:15:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:15:09.158477576 +0000 UTC m=+813.830575496" watchObservedRunningTime="2026-09-10 22:15:09.160658609 +0000 UTC m=+813.832756598"
Sep 10 22:15:09.777215 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:09.777166    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:09.782622 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:09.782594    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:10.133199 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:10.133112    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:10.134118 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:10.134097    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:12.059472 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:12.059441    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:15:20.791391 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:20.791355    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2d222ead-5gw9b"]
Sep 10 22:15:20.796171 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:20.796154    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2d222ead-5gw9b"
Sep 10 22:15:20.798277 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:20.798256    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8hjrv\""
Sep 10 22:15:20.802999 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:20.802976    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2d222ead-5gw9b"]
Sep 10 22:15:20.947958 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:20.947919    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93079e98-1bc2-4cbe-8630-6d43066d6f60-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2d222ead-5gw9b\" (UID: \"93079e98-1bc2-4cbe-8630-6d43066d6f60\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2d222ead-5gw9b"
Sep 10 22:15:21.048967 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:21.048878    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93079e98-1bc2-4cbe-8630-6d43066d6f60-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2d222ead-5gw9b\" (UID: \"93079e98-1bc2-4cbe-8630-6d43066d6f60\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2d222ead-5gw9b"
Sep 10 22:15:21.049495 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:21.049477    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93079e98-1bc2-4cbe-8630-6d43066d6f60-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2d222ead-5gw9b\" (UID: \"93079e98-1bc2-4cbe-8630-6d43066d6f60\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2d222ead-5gw9b"
Sep 10 22:15:21.111228 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:21.111199    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2d222ead-5gw9b"
Sep 10 22:15:21.384454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:21.384423    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2d222ead-5gw9b"]
Sep 10 22:15:21.387255 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:15:21.387220    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93079e98_1bc2_4cbe_8630_6d43066d6f60.slice/crio-57246f085e5f867dc41782155519ab74c5b3b0337f687be78ae12789ad2c5d2a WatchSource:0}: Error finding container 57246f085e5f867dc41782155519ab74c5b3b0337f687be78ae12789ad2c5d2a: Status 404 returned error can't find the container with id 57246f085e5f867dc41782155519ab74c5b3b0337f687be78ae12789ad2c5d2a
Sep 10 22:15:22.210538 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:22.210505    2577 generic.go:356] "Generic (PLEG): container finished" podID="93079e98-1bc2-4cbe-8630-6d43066d6f60" containerID="39769c93b9a45b98c25bc787d7d74559d57712709261355e632b5dbcc78a80f3" exitCode=0
Sep 10 22:15:22.210898 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:22.210591    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2d222ead-5gw9b" event={"ID":"93079e98-1bc2-4cbe-8630-6d43066d6f60","Type":"ContainerDied","Data":"39769c93b9a45b98c25bc787d7d74559d57712709261355e632b5dbcc78a80f3"}
Sep 10 22:15:22.210898 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:22.210646    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2d222ead-5gw9b" event={"ID":"93079e98-1bc2-4cbe-8630-6d43066d6f60","Type":"ContainerStarted","Data":"57246f085e5f867dc41782155519ab74c5b3b0337f687be78ae12789ad2c5d2a"}
Sep 10 22:15:23.393377 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:23.393354    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2d222ead-5gw9b"
Sep 10 22:15:23.573501 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:23.573404    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93079e98-1bc2-4cbe-8630-6d43066d6f60-maas-api-service-ca\") pod \"93079e98-1bc2-4cbe-8630-6d43066d6f60\" (UID: \"93079e98-1bc2-4cbe-8630-6d43066d6f60\") "
Sep 10 22:15:23.573727 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:23.573709    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93079e98-1bc2-4cbe-8630-6d43066d6f60-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "93079e98-1bc2-4cbe-8630-6d43066d6f60" (UID: "93079e98-1bc2-4cbe-8630-6d43066d6f60"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:15:23.675174 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:23.675136    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93079e98-1bc2-4cbe-8630-6d43066d6f60-maas-api-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:15:24.225006 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:24.224973    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2d222ead-5gw9b" event={"ID":"93079e98-1bc2-4cbe-8630-6d43066d6f60","Type":"ContainerDied","Data":"57246f085e5f867dc41782155519ab74c5b3b0337f687be78ae12789ad2c5d2a"}
Sep 10 22:15:24.225006 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:24.225005    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2d222ead-5gw9b"
Sep 10 22:15:24.225212 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:24.225023    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57246f085e5f867dc41782155519ab74c5b3b0337f687be78ae12789ad2c5d2a"
Sep 10 22:15:29.158834 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:29.158798    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:15:31.272469 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:31.272439    2577 generic.go:356] "Generic (PLEG): container finished" podID="b15d88c9-4847-45b0-a0d0-7a21cd2d1545" containerID="14eaaf417a154b3924c0f28ff3c50fe352d647d90abb6945db2a5688fe8e5744" exitCode=0
Sep 10 22:15:31.272903 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:31.272527    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf" event={"ID":"b15d88c9-4847-45b0-a0d0-7a21cd2d1545","Type":"ContainerDied","Data":"14eaaf417a154b3924c0f28ff3c50fe352d647d90abb6945db2a5688fe8e5744"}
Sep 10 22:15:31.272957 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:31.272942    2577 scope.go:117] "RemoveContainer" containerID="14eaaf417a154b3924c0f28ff3c50fe352d647d90abb6945db2a5688fe8e5744"
Sep 10 22:15:31.274199 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:31.274172    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:15:31.274265 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:31.274243    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:15:31.274302 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:31.274275    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:15:32.174363 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.174327    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"]
Sep 10 22:15:32.174574 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.174527    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr" podUID="b6f27fed-c94e-4d05-96a8-6b4e86c093c3" containerName="maas-api" containerID="cri-o://8f8491f0429db4d351f4c323d3fdcbf28ae7c9d0f0ea6c6b54ad9f4374b06204" gracePeriod=30
Sep 10 22:15:32.271806 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.267436    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt"]
Sep 10 22:15:32.271806 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.267692    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt" podUID="4d759399-1381-4439-b951-2c14fad80ade" containerName="payload-pre-processing" containerID="cri-o://96c7d6709679dde5209213af952458c54db52f05fd9e169b033ff7e03d242647" gracePeriod=30
Sep 10 22:15:32.300205 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.300166    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf" event={"ID":"b15d88c9-4847-45b0-a0d0-7a21cd2d1545","Type":"ContainerStarted","Data":"929d680140cfda7b331d37163a7ef60bd41950b8d520827183707810503421f3"}
Sep 10 22:15:32.486584 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.486496    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2d222ead-5gw9b"]
Sep 10 22:15:32.493676 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.491975    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2d222ead-5gw9b"]
Sep 10 22:15:32.514609 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.514576    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"
Sep 10 22:15:32.569843 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.567192    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-maas-api-tls\") pod \"b6f27fed-c94e-4d05-96a8-6b4e86c093c3\" (UID: \"b6f27fed-c94e-4d05-96a8-6b4e86c093c3\") "
Sep 10 22:15:32.569843 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.567269    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppnfh\" (UniqueName: \"kubernetes.io/projected/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-kube-api-access-ppnfh\") pod \"b6f27fed-c94e-4d05-96a8-6b4e86c093c3\" (UID: \"b6f27fed-c94e-4d05-96a8-6b4e86c093c3\") "
Sep 10 22:15:32.569843 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.567326    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-metrics-certs\") pod \"b6f27fed-c94e-4d05-96a8-6b4e86c093c3\" (UID: \"b6f27fed-c94e-4d05-96a8-6b4e86c093c3\") "
Sep 10 22:15:32.569843 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.567364    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-openshift-service-ca\") pod \"b6f27fed-c94e-4d05-96a8-6b4e86c093c3\" (UID: \"b6f27fed-c94e-4d05-96a8-6b4e86c093c3\") "
Sep 10 22:15:32.572828 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.572446    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b6f27fed-c94e-4d05-96a8-6b4e86c093c3" (UID: "b6f27fed-c94e-4d05-96a8-6b4e86c093c3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:15:32.575129 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.575095    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b6f27fed-c94e-4d05-96a8-6b4e86c093c3" (UID: "b6f27fed-c94e-4d05-96a8-6b4e86c093c3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:15:32.575273 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.575248    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b6f27fed-c94e-4d05-96a8-6b4e86c093c3" (UID: "b6f27fed-c94e-4d05-96a8-6b4e86c093c3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:15:32.576433 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.576396    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-kube-api-access-ppnfh" (OuterVolumeSpecName: "kube-api-access-ppnfh") pod "b6f27fed-c94e-4d05-96a8-6b4e86c093c3" (UID: "b6f27fed-c94e-4d05-96a8-6b4e86c093c3"). InnerVolumeSpecName "kube-api-access-ppnfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:15:32.597833 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.597804    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt"
Sep 10 22:15:32.668989 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.668961    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fm5mk\" (UniqueName: \"kubernetes.io/projected/4d759399-1381-4439-b951-2c14fad80ade-kube-api-access-fm5mk\") pod \"4d759399-1381-4439-b951-2c14fad80ade\" (UID: \"4d759399-1381-4439-b951-2c14fad80ade\") "
Sep 10 22:15:32.669171 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.669051    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d759399-1381-4439-b951-2c14fad80ade-plugins-config-volume\") pod \"4d759399-1381-4439-b951-2c14fad80ade\" (UID: \"4d759399-1381-4439-b951-2c14fad80ade\") "
Sep 10 22:15:32.669265 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.669252    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-maas-api-tls\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:15:32.669311 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.669268    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppnfh\" (UniqueName: \"kubernetes.io/projected/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-kube-api-access-ppnfh\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:15:32.669311 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.669278    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-metrics-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:15:32.669311 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.669285    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6f27fed-c94e-4d05-96a8-6b4e86c093c3-openshift-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:15:32.669475 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.669445    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d759399-1381-4439-b951-2c14fad80ade-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4d759399-1381-4439-b951-2c14fad80ade" (UID: "4d759399-1381-4439-b951-2c14fad80ade"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:15:32.671645 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.671614    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d759399-1381-4439-b951-2c14fad80ade-kube-api-access-fm5mk" (OuterVolumeSpecName: "kube-api-access-fm5mk") pod "4d759399-1381-4439-b951-2c14fad80ade" (UID: "4d759399-1381-4439-b951-2c14fad80ade"). InnerVolumeSpecName "kube-api-access-fm5mk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:15:32.770623 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.770520    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fm5mk\" (UniqueName: \"kubernetes.io/projected/4d759399-1381-4439-b951-2c14fad80ade-kube-api-access-fm5mk\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:15:32.770623 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.770562    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d759399-1381-4439-b951-2c14fad80ade-plugins-config-volume\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:15:32.777392 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.777357    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:32.777563 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.777542    2577 patch_prober.go:28] interesting pod/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 22:15:32.777615 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:32.777590    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf" podUID="b15d88c9-4847-45b0-a0d0-7a21cd2d1545" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 22:15:33.307668 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.307632    2577 generic.go:356] "Generic (PLEG): container finished" podID="4d759399-1381-4439-b951-2c14fad80ade" containerID="96c7d6709679dde5209213af952458c54db52f05fd9e169b033ff7e03d242647" exitCode=0
Sep 10 22:15:33.308164 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.307679    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt"
Sep 10 22:15:33.308164 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.307710    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt" event={"ID":"4d759399-1381-4439-b951-2c14fad80ade","Type":"ContainerDied","Data":"96c7d6709679dde5209213af952458c54db52f05fd9e169b033ff7e03d242647"}
Sep 10 22:15:33.308164 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.307750    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt" event={"ID":"4d759399-1381-4439-b951-2c14fad80ade","Type":"ContainerDied","Data":"ac579ce5219d97668cc2d776dba8c2dacfc6c82f86c734fbf14bb4f2af23005a"}
Sep 10 22:15:33.308164 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.307796    2577 scope.go:117] "RemoveContainer" containerID="96c7d6709679dde5209213af952458c54db52f05fd9e169b033ff7e03d242647"
Sep 10 22:15:33.309387 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.309360    2577 generic.go:356] "Generic (PLEG): container finished" podID="b6f27fed-c94e-4d05-96a8-6b4e86c093c3" containerID="8f8491f0429db4d351f4c323d3fdcbf28ae7c9d0f0ea6c6b54ad9f4374b06204" exitCode=0
Sep 10 22:15:33.309487 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.309412    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"
Sep 10 22:15:33.309575 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.309549    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr" event={"ID":"b6f27fed-c94e-4d05-96a8-6b4e86c093c3","Type":"ContainerDied","Data":"8f8491f0429db4d351f4c323d3fdcbf28ae7c9d0f0ea6c6b54ad9f4374b06204"}
Sep 10 22:15:33.309625 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.309610    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr" event={"ID":"b6f27fed-c94e-4d05-96a8-6b4e86c093c3","Type":"ContainerDied","Data":"d952fa7ecb520b247e0fe9cfdb72a6e808cab7bc0cbb59a0b5573aefaa83b14e"}
Sep 10 22:15:33.317794 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.317744    2577 scope.go:117] "RemoveContainer" containerID="96c7d6709679dde5209213af952458c54db52f05fd9e169b033ff7e03d242647"
Sep 10 22:15:33.318198 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:15:33.318139    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96c7d6709679dde5209213af952458c54db52f05fd9e169b033ff7e03d242647\": container with ID starting with 96c7d6709679dde5209213af952458c54db52f05fd9e169b033ff7e03d242647 not found: ID does not exist" containerID="96c7d6709679dde5209213af952458c54db52f05fd9e169b033ff7e03d242647"
Sep 10 22:15:33.318257 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.318185    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96c7d6709679dde5209213af952458c54db52f05fd9e169b033ff7e03d242647"} err="failed to get container status \"96c7d6709679dde5209213af952458c54db52f05fd9e169b033ff7e03d242647\": rpc error: code = NotFound desc = could not find container \"96c7d6709679dde5209213af952458c54db52f05fd9e169b033ff7e03d242647\": container with ID starting with 96c7d6709679dde5209213af952458c54db52f05fd9e169b033ff7e03d242647 not found: ID does not exist"
Sep 10 22:15:33.318257 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.318213    2577 scope.go:117] "RemoveContainer" containerID="8f8491f0429db4d351f4c323d3fdcbf28ae7c9d0f0ea6c6b54ad9f4374b06204"
Sep 10 22:15:33.327869 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.327772    2577 scope.go:117] "RemoveContainer" containerID="8f8491f0429db4d351f4c323d3fdcbf28ae7c9d0f0ea6c6b54ad9f4374b06204"
Sep 10 22:15:33.328214 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:15:33.328195    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f8491f0429db4d351f4c323d3fdcbf28ae7c9d0f0ea6c6b54ad9f4374b06204\": container with ID starting with 8f8491f0429db4d351f4c323d3fdcbf28ae7c9d0f0ea6c6b54ad9f4374b06204 not found: ID does not exist" containerID="8f8491f0429db4d351f4c323d3fdcbf28ae7c9d0f0ea6c6b54ad9f4374b06204"
Sep 10 22:15:33.328303 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.328223    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f8491f0429db4d351f4c323d3fdcbf28ae7c9d0f0ea6c6b54ad9f4374b06204"} err="failed to get container status \"8f8491f0429db4d351f4c323d3fdcbf28ae7c9d0f0ea6c6b54ad9f4374b06204\": rpc error: code = NotFound desc = could not find container \"8f8491f0429db4d351f4c323d3fdcbf28ae7c9d0f0ea6c6b54ad9f4374b06204\": container with ID starting with 8f8491f0429db4d351f4c323d3fdcbf28ae7c9d0f0ea6c6b54ad9f4374b06204 not found: ID does not exist"
Sep 10 22:15:33.364372 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.364336    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"]
Sep 10 22:15:33.374660 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.374628    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2d222ead-7767956684-t9hqr"]
Sep 10 22:15:33.396079 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.396038    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt"]
Sep 10 22:15:33.398573 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.398551    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2d222ead-fc58494f8-r4rtt"]
Sep 10 22:15:33.766915 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.766880    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"]
Sep 10 22:15:33.767308 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.767295    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d759399-1381-4439-b951-2c14fad80ade" containerName="payload-pre-processing"
Sep 10 22:15:33.767308 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.767309    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d759399-1381-4439-b951-2c14fad80ade" containerName="payload-pre-processing"
Sep 10 22:15:33.767513 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.767321    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6f27fed-c94e-4d05-96a8-6b4e86c093c3" containerName="maas-api"
Sep 10 22:15:33.767513 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.767327    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6f27fed-c94e-4d05-96a8-6b4e86c093c3" containerName="maas-api"
Sep 10 22:15:33.767513 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.767340    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93079e98-1bc2-4cbe-8630-6d43066d6f60" containerName="revoke-keys"
Sep 10 22:15:33.767513 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.767346    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="93079e98-1bc2-4cbe-8630-6d43066d6f60" containerName="revoke-keys"
Sep 10 22:15:33.767513 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.767431    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d759399-1381-4439-b951-2c14fad80ade" containerName="payload-pre-processing"
Sep 10 22:15:33.767513 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.767441    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6f27fed-c94e-4d05-96a8-6b4e86c093c3" containerName="maas-api"
Sep 10 22:15:33.767513 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.767447    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="93079e98-1bc2-4cbe-8630-6d43066d6f60" containerName="revoke-keys"
Sep 10 22:15:33.770584 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.770563    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.773589 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.773567    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-cd1c6d7b-gw-openshift-default-dockercfg-vqqtm\""
Sep 10 22:15:33.776761 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.776720    2577 patch_prober.go:28] interesting pod/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 22:15:33.776908 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.776812    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf" podUID="b15d88c9-4847-45b0-a0d0-7a21cd2d1545" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 22:15:33.780077 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.780005    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-istio-data\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.780266 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.780235    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-credential-socket\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.780379 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.780285    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-workload-certs\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.780379 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.780327    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68640b8e-429b-4527-99f0-314fcd664f86-istiod-ca-cert\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.780499 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.780407    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68640b8e-429b-4527-99f0-314fcd664f86-istio-token\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.780499 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.780434    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zfsq\" (UniqueName: \"kubernetes.io/projected/68640b8e-429b-4527-99f0-314fcd664f86-kube-api-access-6zfsq\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.780610 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.780537    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-istio-envoy\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.780610 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.780599    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68640b8e-429b-4527-99f0-314fcd664f86-istio-podinfo\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.780723 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.780670    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-workload-socket\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.782989 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.782966    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"]
Sep 10 22:15:33.861234 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.861199    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d759399-1381-4439-b951-2c14fad80ade" path="/var/lib/kubelet/pods/4d759399-1381-4439-b951-2c14fad80ade/volumes"
Sep 10 22:15:33.862092 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.862067    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93079e98-1bc2-4cbe-8630-6d43066d6f60" path="/var/lib/kubelet/pods/93079e98-1bc2-4cbe-8630-6d43066d6f60/volumes"
Sep 10 22:15:33.862801 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.862759    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6f27fed-c94e-4d05-96a8-6b4e86c093c3" path="/var/lib/kubelet/pods/b6f27fed-c94e-4d05-96a8-6b4e86c093c3/volumes"
Sep 10 22:15:33.882026 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.881991    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-workload-certs\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.882239 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.882071    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68640b8e-429b-4527-99f0-314fcd664f86-istiod-ca-cert\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.882239 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.882157    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68640b8e-429b-4527-99f0-314fcd664f86-istio-token\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.882239 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.882183    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zfsq\" (UniqueName: \"kubernetes.io/projected/68640b8e-429b-4527-99f0-314fcd664f86-kube-api-access-6zfsq\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.882239 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.882229    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-istio-envoy\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.882462 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.882260    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68640b8e-429b-4527-99f0-314fcd664f86-istio-podinfo\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.882462 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.882293    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-workload-socket\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.882462 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.882352    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-istio-data\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.882462 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.882436    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-credential-socket\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.882616 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.882488    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-workload-certs\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.882806 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.882764    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-credential-socket\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.883072 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.883040    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-workload-socket\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.883179 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.883116    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-istio-data\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.883254 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.883205    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68640b8e-429b-4527-99f0-314fcd664f86-istiod-ca-cert\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.885973 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.885947    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-istio-envoy\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.886715 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.886692    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68640b8e-429b-4527-99f0-314fcd664f86-istio-podinfo\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.893357 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.893329    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zfsq\" (UniqueName: \"kubernetes.io/projected/68640b8e-429b-4527-99f0-314fcd664f86-kube-api-access-6zfsq\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:33.894041 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:33.894015    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68640b8e-429b-4527-99f0-314fcd664f86-istio-token\") pod \"e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") " pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:34.083005 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:34.082899    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:34.408710 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:15:34.408675    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68640b8e_429b_4527_99f0_314fcd664f86.slice/crio-6f5ecd281033d4e83bd6a9178ac6841fdc03d87530576f2b242a44cdaf98b49e WatchSource:0}: Error finding container 6f5ecd281033d4e83bd6a9178ac6841fdc03d87530576f2b242a44cdaf98b49e: Status 404 returned error can't find the container with id 6f5ecd281033d4e83bd6a9178ac6841fdc03d87530576f2b242a44cdaf98b49e
Sep 10 22:15:34.409182 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:34.409159    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"]
Sep 10 22:15:34.411229 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:34.411191    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:15:34.411316 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:34.411276    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:15:34.411355 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:34.411322    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:15:34.777134 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:34.777032    2577 patch_prober.go:28] interesting pod/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 22:15:34.777134 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:34.777095    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf" podUID="b15d88c9-4847-45b0-a0d0-7a21cd2d1545" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 22:15:35.325628 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:35.325591    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv" event={"ID":"68640b8e-429b-4527-99f0-314fcd664f86","Type":"ContainerStarted","Data":"a0d03da6d9e85ac2763d6479fed07ac826b8fcb848542e38d243795eaff78120"}
Sep 10 22:15:35.325828 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:35.325670    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv" event={"ID":"68640b8e-429b-4527-99f0-314fcd664f86","Type":"ContainerStarted","Data":"6f5ecd281033d4e83bd6a9178ac6841fdc03d87530576f2b242a44cdaf98b49e"}
Sep 10 22:15:35.347279 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:35.347205    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv" podStartSLOduration=2.34718208 podStartE2EDuration="2.34718208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:15:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:15:35.344541479 +0000 UTC m=+840.016639400" watchObservedRunningTime="2026-09-10 22:15:35.34718208 +0000 UTC m=+840.019280004"
Sep 10 22:15:35.776759 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:35.776723    2577 patch_prober.go:28] interesting pod/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 22:15:35.777162 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:35.776806    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf" podUID="b15d88c9-4847-45b0-a0d0-7a21cd2d1545" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 22:15:36.083406 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:36.083311    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:36.089357 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:36.089332    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:36.331623 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:36.331593    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:36.332574 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:36.332554    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:36.777082 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:36.777044    2577 patch_prober.go:28] interesting pod/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 22:15:36.777519 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:36.777294    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf" podUID="b15d88c9-4847-45b0-a0d0-7a21cd2d1545" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 22:15:36.997801 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:36.996735    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"]
Sep 10 22:15:37.000813 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:37.000509    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"
Sep 10 22:15:37.003856 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:37.003812    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-spztp\""
Sep 10 22:15:37.003992 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:37.003958    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 22:15:37.004057 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:37.004042    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-cd1c6d7b-serving-cert\""
Sep 10 22:15:37.021336 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:37.021089    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"]
Sep 10 22:15:37.113682 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:37.113581    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rhft\" (UniqueName: \"kubernetes.io/projected/67c31a32-0da4-4f49-aba8-0a9bf119edfe-kube-api-access-5rhft\") pod \"maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9\" (UID: \"67c31a32-0da4-4f49-aba8-0a9bf119edfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"
Sep 10 22:15:37.113682 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:37.113636    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67c31a32-0da4-4f49-aba8-0a9bf119edfe-metrics-certs\") pod \"maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9\" (UID: \"67c31a32-0da4-4f49-aba8-0a9bf119edfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"
Sep 10 22:15:37.113910 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:37.113718    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67c31a32-0da4-4f49-aba8-0a9bf119edfe-maas-api-tls\") pod \"maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9\" (UID: \"67c31a32-0da4-4f49-aba8-0a9bf119edfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"
Sep 10 22:15:37.113910 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:37.113841    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67c31a32-0da4-4f49-aba8-0a9bf119edfe-openshift-service-ca\") pod \"maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9\" (UID: \"67c31a32-0da4-4f49-aba8-0a9bf119edfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"
Sep 10 22:15:37.215011 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:37.214978    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67c31a32-0da4-4f49-aba8-0a9bf119edfe-openshift-service-ca\") pod \"maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9\" (UID: \"67c31a32-0da4-4f49-aba8-0a9bf119edfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"
Sep 10 22:15:37.215244 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:37.215042    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rhft\" (UniqueName: \"kubernetes.io/projected/67c31a32-0da4-4f49-aba8-0a9bf119edfe-kube-api-access-5rhft\") pod \"maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9\" (UID: \"67c31a32-0da4-4f49-aba8-0a9bf119edfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"
Sep 10 22:15:37.215244 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:37.215072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67c31a32-0da4-4f49-aba8-0a9bf119edfe-metrics-certs\") pod \"maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9\" (UID: \"67c31a32-0da4-4f49-aba8-0a9bf119edfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"
Sep 10 22:15:37.215391 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:37.215336    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67c31a32-0da4-4f49-aba8-0a9bf119edfe-maas-api-tls\") pod \"maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9\" (UID: \"67c31a32-0da4-4f49-aba8-0a9bf119edfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"
Sep 10 22:15:37.215497 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:15:37.215476    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-serving-cert: secret "maas-api-e2e-migrate-cd1c6d7b-serving-cert" not found
Sep 10 22:15:37.215572 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:15:37.215556    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67c31a32-0da4-4f49-aba8-0a9bf119edfe-maas-api-tls podName:67c31a32-0da4-4f49-aba8-0a9bf119edfe nodeName:}" failed. No retries permitted until 2026-09-10 22:15:37.715534388 +0000 UTC m=+842.387632301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/67c31a32-0da4-4f49-aba8-0a9bf119edfe-maas-api-tls") pod "maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9" (UID: "67c31a32-0da4-4f49-aba8-0a9bf119edfe") : secret "maas-api-e2e-migrate-cd1c6d7b-serving-cert" not found
Sep 10 22:15:37.215884 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:37.215808    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67c31a32-0da4-4f49-aba8-0a9bf119edfe-openshift-service-ca\") pod \"maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9\" (UID: \"67c31a32-0da4-4f49-aba8-0a9bf119edfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"
Sep 10 22:15:37.217972 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:37.217839    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67c31a32-0da4-4f49-aba8-0a9bf119edfe-metrics-certs\") pod \"maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9\" (UID: \"67c31a32-0da4-4f49-aba8-0a9bf119edfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"
Sep 10 22:15:37.226604 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:37.226578    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rhft\" (UniqueName: \"kubernetes.io/projected/67c31a32-0da4-4f49-aba8-0a9bf119edfe-kube-api-access-5rhft\") pod \"maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9\" (UID: \"67c31a32-0da4-4f49-aba8-0a9bf119edfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"
Sep 10 22:15:37.721816 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:37.721744    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67c31a32-0da4-4f49-aba8-0a9bf119edfe-maas-api-tls\") pod \"maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9\" (UID: \"67c31a32-0da4-4f49-aba8-0a9bf119edfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"
Sep 10 22:15:37.724426 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:37.724395    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67c31a32-0da4-4f49-aba8-0a9bf119edfe-maas-api-tls\") pod \"maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9\" (UID: \"67c31a32-0da4-4f49-aba8-0a9bf119edfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"
Sep 10 22:15:37.810547 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:37.810511    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:37.811348 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:37.811319    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:37.812235 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:37.812205    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:15:37.913052 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:37.913018    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"
Sep 10 22:15:38.218429 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:38.218386    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"]
Sep 10 22:15:38.348534 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:38.348443    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9" event={"ID":"67c31a32-0da4-4f49-aba8-0a9bf119edfe","Type":"ContainerStarted","Data":"4471de05484b7f51813a45e0ad21cc0b2c5212125cf624647b5ac964eb1b506c"}
Sep 10 22:15:39.356160 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:39.356126    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9" event={"ID":"67c31a32-0da4-4f49-aba8-0a9bf119edfe","Type":"ContainerStarted","Data":"dbd0fc9580309580a0c19d5051081a98a7da7f74fa84a4f95ab432be59245009"}
Sep 10 22:15:39.356556 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:39.356224    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"
Sep 10 22:15:39.377903 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:39.377848    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9" podStartSLOduration=2.996514897 podStartE2EDuration="3.377824114s" totalImagesPullingTime="381.309217ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:15:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:15:39.377490396 +0000 UTC m=+844.049588327" watchObservedRunningTime="2026-09-10 22:15:39.377824114 +0000 UTC m=+844.049922035"
Sep 10 22:15:42.565001 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:42.564955    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:15:45.367919 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:45.367883    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"
Sep 10 22:15:52.373985 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:52.373937    2577 patch_prober.go:28] interesting pod/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 22:15:52.374407 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:52.374012    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv" podUID="68640b8e-429b-4527-99f0-314fcd664f86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 22:15:53.450431 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:53.450402    2577 generic.go:356] "Generic (PLEG): container finished" podID="68640b8e-429b-4527-99f0-314fcd664f86" containerID="a0d03da6d9e85ac2763d6479fed07ac826b8fcb848542e38d243795eaff78120" exitCode=0
Sep 10 22:15:53.450868 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:53.450478    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv" event={"ID":"68640b8e-429b-4527-99f0-314fcd664f86","Type":"ContainerDied","Data":"a0d03da6d9e85ac2763d6479fed07ac826b8fcb848542e38d243795eaff78120"}
Sep 10 22:15:53.450966 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:53.450951    2577 scope.go:117] "RemoveContainer" containerID="a0d03da6d9e85ac2763d6479fed07ac826b8fcb848542e38d243795eaff78120"
Sep 10 22:15:53.452015 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:53.451990    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:15:53.452064 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:53.452057    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:15:53.452100 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:53.452089    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:15:54.470600 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:54.470566    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv" event={"ID":"68640b8e-429b-4527-99f0-314fcd664f86","Type":"ContainerStarted","Data":"8a8854bea7fcf86b2aaef9cf9e3d1aa884acc7f9db07296c1d9c66e47b448fcd"}
Sep 10 22:15:55.083280 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:55.083238    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:15:55.083469 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:55.083426    2577 patch_prober.go:28] interesting pod/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 10 22:15:55.083515 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:55.083474    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv" podUID="68640b8e-429b-4527-99f0-314fcd664f86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 10 22:15:56.083946 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:56.083913    2577 patch_prober.go:28] interesting pod/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 10 22:15:56.084425 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:56.083974    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv" podUID="68640b8e-429b-4527-99f0-314fcd664f86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 10 22:15:57.084072 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:57.084039    2577 patch_prober.go:28] interesting pod/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 10 22:15:57.084462 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:57.084104    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv" podUID="68640b8e-429b-4527-99f0-314fcd664f86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 10 22:15:58.083944 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:58.083908    2577 patch_prober.go:28] interesting pod/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 10 22:15:58.084112 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:58.083965    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv" podUID="68640b8e-429b-4527-99f0-314fcd664f86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 10 22:15:59.083653 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:59.083610    2577 patch_prober.go:28] interesting pod/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 10 22:15:59.083992 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:15:59.083684    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv" podUID="68640b8e-429b-4527-99f0-314fcd664f86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 10 22:16:00.087073 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:00.087035    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:16:00.087470 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:00.087348    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:16:00.088196 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:00.088180    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:16:03.031181 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:03.031147    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:16:08.969568 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:08.969534    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"]
Sep 10 22:16:08.970072 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:08.969763    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9" podUID="67c31a32-0da4-4f49-aba8-0a9bf119edfe" containerName="maas-api" containerID="cri-o://dbd0fc9580309580a0c19d5051081a98a7da7f74fa84a4f95ab432be59245009" gracePeriod=30
Sep 10 22:16:09.239120 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.239088    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"
Sep 10 22:16:09.338908 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.338877    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67c31a32-0da4-4f49-aba8-0a9bf119edfe-maas-api-tls\") pod \"67c31a32-0da4-4f49-aba8-0a9bf119edfe\" (UID: \"67c31a32-0da4-4f49-aba8-0a9bf119edfe\") "
Sep 10 22:16:09.338908 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.338923    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rhft\" (UniqueName: \"kubernetes.io/projected/67c31a32-0da4-4f49-aba8-0a9bf119edfe-kube-api-access-5rhft\") pod \"67c31a32-0da4-4f49-aba8-0a9bf119edfe\" (UID: \"67c31a32-0da4-4f49-aba8-0a9bf119edfe\") "
Sep 10 22:16:09.339137 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.338971    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67c31a32-0da4-4f49-aba8-0a9bf119edfe-openshift-service-ca\") pod \"67c31a32-0da4-4f49-aba8-0a9bf119edfe\" (UID: \"67c31a32-0da4-4f49-aba8-0a9bf119edfe\") "
Sep 10 22:16:09.339137 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.339077    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67c31a32-0da4-4f49-aba8-0a9bf119edfe-metrics-certs\") pod \"67c31a32-0da4-4f49-aba8-0a9bf119edfe\" (UID: \"67c31a32-0da4-4f49-aba8-0a9bf119edfe\") "
Sep 10 22:16:09.339316 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.339291    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67c31a32-0da4-4f49-aba8-0a9bf119edfe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "67c31a32-0da4-4f49-aba8-0a9bf119edfe" (UID: "67c31a32-0da4-4f49-aba8-0a9bf119edfe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:16:09.339489 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.339473    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67c31a32-0da4-4f49-aba8-0a9bf119edfe-openshift-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:16:09.341246 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.341213    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67c31a32-0da4-4f49-aba8-0a9bf119edfe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "67c31a32-0da4-4f49-aba8-0a9bf119edfe" (UID: "67c31a32-0da4-4f49-aba8-0a9bf119edfe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:16:09.341370 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.341332    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67c31a32-0da4-4f49-aba8-0a9bf119edfe-kube-api-access-5rhft" (OuterVolumeSpecName: "kube-api-access-5rhft") pod "67c31a32-0da4-4f49-aba8-0a9bf119edfe" (UID: "67c31a32-0da4-4f49-aba8-0a9bf119edfe"). InnerVolumeSpecName "kube-api-access-5rhft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:16:09.341446 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.341428    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67c31a32-0da4-4f49-aba8-0a9bf119edfe-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "67c31a32-0da4-4f49-aba8-0a9bf119edfe" (UID: "67c31a32-0da4-4f49-aba8-0a9bf119edfe"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:16:09.440586 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.440545    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67c31a32-0da4-4f49-aba8-0a9bf119edfe-metrics-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:16:09.440586 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.440586    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67c31a32-0da4-4f49-aba8-0a9bf119edfe-maas-api-tls\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:16:09.440586 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.440601    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rhft\" (UniqueName: \"kubernetes.io/projected/67c31a32-0da4-4f49-aba8-0a9bf119edfe-kube-api-access-5rhft\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:16:09.563170 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.563081    2577 generic.go:356] "Generic (PLEG): container finished" podID="67c31a32-0da4-4f49-aba8-0a9bf119edfe" containerID="dbd0fc9580309580a0c19d5051081a98a7da7f74fa84a4f95ab432be59245009" exitCode=0
Sep 10 22:16:09.563170 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.563127    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"
Sep 10 22:16:09.563382 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.563165    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9" event={"ID":"67c31a32-0da4-4f49-aba8-0a9bf119edfe","Type":"ContainerDied","Data":"dbd0fc9580309580a0c19d5051081a98a7da7f74fa84a4f95ab432be59245009"}
Sep 10 22:16:09.563382 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.563223    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9" event={"ID":"67c31a32-0da4-4f49-aba8-0a9bf119edfe","Type":"ContainerDied","Data":"4471de05484b7f51813a45e0ad21cc0b2c5212125cf624647b5ac964eb1b506c"}
Sep 10 22:16:09.563382 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.563252    2577 scope.go:117] "RemoveContainer" containerID="dbd0fc9580309580a0c19d5051081a98a7da7f74fa84a4f95ab432be59245009"
Sep 10 22:16:09.573947 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.573735    2577 scope.go:117] "RemoveContainer" containerID="dbd0fc9580309580a0c19d5051081a98a7da7f74fa84a4f95ab432be59245009"
Sep 10 22:16:09.574086 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:16:09.574064    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbd0fc9580309580a0c19d5051081a98a7da7f74fa84a4f95ab432be59245009\": container with ID starting with dbd0fc9580309580a0c19d5051081a98a7da7f74fa84a4f95ab432be59245009 not found: ID does not exist" containerID="dbd0fc9580309580a0c19d5051081a98a7da7f74fa84a4f95ab432be59245009"
Sep 10 22:16:09.574167 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.574093    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbd0fc9580309580a0c19d5051081a98a7da7f74fa84a4f95ab432be59245009"} err="failed to get container status \"dbd0fc9580309580a0c19d5051081a98a7da7f74fa84a4f95ab432be59245009\": rpc error: code = NotFound desc = could not find container \"dbd0fc9580309580a0c19d5051081a98a7da7f74fa84a4f95ab432be59245009\": container with ID starting with dbd0fc9580309580a0c19d5051081a98a7da7f74fa84a4f95ab432be59245009 not found: ID does not exist"
Sep 10 22:16:09.607111 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.607079    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"]
Sep 10 22:16:09.623492 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.623465    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-cd1c6d7b-574845c699-9m7d9"]
Sep 10 22:16:09.840397 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.840298    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"]
Sep 10 22:16:09.840565 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.840540    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv" podUID="68640b8e-429b-4527-99f0-314fcd664f86" containerName="istio-proxy" containerID="cri-o://8a8854bea7fcf86b2aaef9cf9e3d1aa884acc7f9db07296c1d9c66e47b448fcd" gracePeriod=30
Sep 10 22:16:09.854387 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:09.854354    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67c31a32-0da4-4f49-aba8-0a9bf119edfe" path="/var/lib/kubelet/pods/67c31a32-0da4-4f49-aba8-0a9bf119edfe/volumes"
Sep 10 22:16:15.089330 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.089296    2577 patch_prober.go:28] interesting pod/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 10 22:16:15.089733 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.089357    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv" podUID="68640b8e-429b-4527-99f0-314fcd664f86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 10 22:16:15.521001 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.520968    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:16:15.603310 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.603276    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-workload-certs\") pod \"68640b8e-429b-4527-99f0-314fcd664f86\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") "
Sep 10 22:16:15.603507 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.603319    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-workload-socket\") pod \"68640b8e-429b-4527-99f0-314fcd664f86\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") "
Sep 10 22:16:15.603507 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.603366    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-credential-socket\") pod \"68640b8e-429b-4527-99f0-314fcd664f86\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") "
Sep 10 22:16:15.603507 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.603389    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-istio-data\") pod \"68640b8e-429b-4527-99f0-314fcd664f86\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") "
Sep 10 22:16:15.603507 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.603427    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68640b8e-429b-4527-99f0-314fcd664f86-istiod-ca-cert\") pod \"68640b8e-429b-4527-99f0-314fcd664f86\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") "
Sep 10 22:16:15.603507 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.603456    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68640b8e-429b-4527-99f0-314fcd664f86-istio-podinfo\") pod \"68640b8e-429b-4527-99f0-314fcd664f86\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") "
Sep 10 22:16:15.603507 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.603477    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zfsq\" (UniqueName: \"kubernetes.io/projected/68640b8e-429b-4527-99f0-314fcd664f86-kube-api-access-6zfsq\") pod \"68640b8e-429b-4527-99f0-314fcd664f86\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") "
Sep 10 22:16:15.604376 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.603525    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-istio-envoy\") pod \"68640b8e-429b-4527-99f0-314fcd664f86\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") "
Sep 10 22:16:15.604376 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.603624    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "68640b8e-429b-4527-99f0-314fcd664f86" (UID: "68640b8e-429b-4527-99f0-314fcd664f86"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:16:15.604376 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.603635    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68640b8e-429b-4527-99f0-314fcd664f86-istio-token\") pod \"68640b8e-429b-4527-99f0-314fcd664f86\" (UID: \"68640b8e-429b-4527-99f0-314fcd664f86\") "
Sep 10 22:16:15.604376 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.603730    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "68640b8e-429b-4527-99f0-314fcd664f86" (UID: "68640b8e-429b-4527-99f0-314fcd664f86"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:16:15.604376 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.603999    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-istio-data" (OuterVolumeSpecName: "istio-data") pod "68640b8e-429b-4527-99f0-314fcd664f86" (UID: "68640b8e-429b-4527-99f0-314fcd664f86"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:16:15.604376 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.604097    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-workload-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:16:15.604376 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.604118    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-credential-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:16:15.604376 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.604132    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-istio-data\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:16:15.604376 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.604300    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68640b8e-429b-4527-99f0-314fcd664f86-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "68640b8e-429b-4527-99f0-314fcd664f86" (UID: "68640b8e-429b-4527-99f0-314fcd664f86"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:16:15.604826 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.604808    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "68640b8e-429b-4527-99f0-314fcd664f86" (UID: "68640b8e-429b-4527-99f0-314fcd664f86"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:16:15.606041 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.605762    2577 generic.go:356] "Generic (PLEG): container finished" podID="68640b8e-429b-4527-99f0-314fcd664f86" containerID="8a8854bea7fcf86b2aaef9cf9e3d1aa884acc7f9db07296c1d9c66e47b448fcd" exitCode=0
Sep 10 22:16:15.606041 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.605846    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv" event={"ID":"68640b8e-429b-4527-99f0-314fcd664f86","Type":"ContainerDied","Data":"8a8854bea7fcf86b2aaef9cf9e3d1aa884acc7f9db07296c1d9c66e47b448fcd"}
Sep 10 22:16:15.606041 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.605902    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv" event={"ID":"68640b8e-429b-4527-99f0-314fcd664f86","Type":"ContainerDied","Data":"6f5ecd281033d4e83bd6a9178ac6841fdc03d87530576f2b242a44cdaf98b49e"}
Sep 10 22:16:15.606041 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.605935    2577 scope.go:117] "RemoveContainer" containerID="8a8854bea7fcf86b2aaef9cf9e3d1aa884acc7f9db07296c1d9c66e47b448fcd"
Sep 10 22:16:15.606041 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.606011    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"
Sep 10 22:16:15.607055 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.607030    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "68640b8e-429b-4527-99f0-314fcd664f86" (UID: "68640b8e-429b-4527-99f0-314fcd664f86"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:16:15.607164 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.607126    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68640b8e-429b-4527-99f0-314fcd664f86-kube-api-access-6zfsq" (OuterVolumeSpecName: "kube-api-access-6zfsq") pod "68640b8e-429b-4527-99f0-314fcd664f86" (UID: "68640b8e-429b-4527-99f0-314fcd664f86"). InnerVolumeSpecName "kube-api-access-6zfsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:16:15.607508 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.607475    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68640b8e-429b-4527-99f0-314fcd664f86-istio-token" (OuterVolumeSpecName: "istio-token") pod "68640b8e-429b-4527-99f0-314fcd664f86" (UID: "68640b8e-429b-4527-99f0-314fcd664f86"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:16:15.607665 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.607645    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/68640b8e-429b-4527-99f0-314fcd664f86-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "68640b8e-429b-4527-99f0-314fcd664f86" (UID: "68640b8e-429b-4527-99f0-314fcd664f86"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:16:15.636890 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.636858    2577 scope.go:117] "RemoveContainer" containerID="a0d03da6d9e85ac2763d6479fed07ac826b8fcb848542e38d243795eaff78120"
Sep 10 22:16:15.646971 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.646948    2577 scope.go:117] "RemoveContainer" containerID="8a8854bea7fcf86b2aaef9cf9e3d1aa884acc7f9db07296c1d9c66e47b448fcd"
Sep 10 22:16:15.647347 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:16:15.647325    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a8854bea7fcf86b2aaef9cf9e3d1aa884acc7f9db07296c1d9c66e47b448fcd\": container with ID starting with 8a8854bea7fcf86b2aaef9cf9e3d1aa884acc7f9db07296c1d9c66e47b448fcd not found: ID does not exist" containerID="8a8854bea7fcf86b2aaef9cf9e3d1aa884acc7f9db07296c1d9c66e47b448fcd"
Sep 10 22:16:15.647411 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.647358    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a8854bea7fcf86b2aaef9cf9e3d1aa884acc7f9db07296c1d9c66e47b448fcd"} err="failed to get container status \"8a8854bea7fcf86b2aaef9cf9e3d1aa884acc7f9db07296c1d9c66e47b448fcd\": rpc error: code = NotFound desc = could not find container \"8a8854bea7fcf86b2aaef9cf9e3d1aa884acc7f9db07296c1d9c66e47b448fcd\": container with ID starting with 8a8854bea7fcf86b2aaef9cf9e3d1aa884acc7f9db07296c1d9c66e47b448fcd not found: ID does not exist"
Sep 10 22:16:15.647411 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.647375    2577 scope.go:117] "RemoveContainer" containerID="a0d03da6d9e85ac2763d6479fed07ac826b8fcb848542e38d243795eaff78120"
Sep 10 22:16:15.647693 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:16:15.647668    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0d03da6d9e85ac2763d6479fed07ac826b8fcb848542e38d243795eaff78120\": container with ID starting with a0d03da6d9e85ac2763d6479fed07ac826b8fcb848542e38d243795eaff78120 not found: ID does not exist" containerID="a0d03da6d9e85ac2763d6479fed07ac826b8fcb848542e38d243795eaff78120"
Sep 10 22:16:15.647845 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.647697    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0d03da6d9e85ac2763d6479fed07ac826b8fcb848542e38d243795eaff78120"} err="failed to get container status \"a0d03da6d9e85ac2763d6479fed07ac826b8fcb848542e38d243795eaff78120\": rpc error: code = NotFound desc = could not find container \"a0d03da6d9e85ac2763d6479fed07ac826b8fcb848542e38d243795eaff78120\": container with ID starting with a0d03da6d9e85ac2763d6479fed07ac826b8fcb848542e38d243795eaff78120 not found: ID does not exist"
Sep 10 22:16:15.705283 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.705244    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68640b8e-429b-4527-99f0-314fcd664f86-istiod-ca-cert\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:16:15.705283 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.705274    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68640b8e-429b-4527-99f0-314fcd664f86-istio-podinfo\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:16:15.705283 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.705283    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zfsq\" (UniqueName: \"kubernetes.io/projected/68640b8e-429b-4527-99f0-314fcd664f86-kube-api-access-6zfsq\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:16:15.705283 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.705292    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-istio-envoy\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:16:15.705634 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.705302    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68640b8e-429b-4527-99f0-314fcd664f86-istio-token\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:16:15.705634 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.705318    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68640b8e-429b-4527-99f0-314fcd664f86-workload-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:16:15.937668 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.937630    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"]
Sep 10 22:16:15.943793 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:15.943750    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-cd1c6d7b-gw-openshift-default-78cf7c4f4d-bcdwv"]
Sep 10 22:16:17.689405 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.689367    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"]
Sep 10 22:16:17.689859 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.689845    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68640b8e-429b-4527-99f0-314fcd664f86" containerName="istio-proxy"
Sep 10 22:16:17.689917 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.689861    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="68640b8e-429b-4527-99f0-314fcd664f86" containerName="istio-proxy"
Sep 10 22:16:17.689917 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.689869    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67c31a32-0da4-4f49-aba8-0a9bf119edfe" containerName="maas-api"
Sep 10 22:16:17.689917 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.689874    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="67c31a32-0da4-4f49-aba8-0a9bf119edfe" containerName="maas-api"
Sep 10 22:16:17.689917 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.689883    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68640b8e-429b-4527-99f0-314fcd664f86" containerName="istio-proxy"
Sep 10 22:16:17.689917 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.689888    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="68640b8e-429b-4527-99f0-314fcd664f86" containerName="istio-proxy"
Sep 10 22:16:17.690070 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.689965    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="67c31a32-0da4-4f49-aba8-0a9bf119edfe" containerName="maas-api"
Sep 10 22:16:17.690070 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.689973    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="68640b8e-429b-4527-99f0-314fcd664f86" containerName="istio-proxy"
Sep 10 22:16:17.690070 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.689980    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="68640b8e-429b-4527-99f0-314fcd664f86" containerName="istio-proxy"
Sep 10 22:16:17.694475 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.694458    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:17.703552 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.703530    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-d6a4de\"/\"openshift-service-ca.crt\""
Sep 10 22:16:17.704137 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.704119    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-d6a4de\"/\"autores-model-d6a4de-kserve-self-signed-certs\""
Sep 10 22:16:17.705444 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.705429    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-d6a4de\"/\"kube-root-ca.crt\""
Sep 10 22:16:17.714966 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.714942    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-d6a4de\"/\"default-dockercfg-8rppp\""
Sep 10 22:16:17.725464 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.725434    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxq67\" (UniqueName: \"kubernetes.io/projected/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-kube-api-access-qxq67\") pod \"autores-model-d6a4de-kserve-78f5ddf675-4k4rp\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") " pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:17.725612 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.725476    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-dshm\") pod \"autores-model-d6a4de-kserve-78f5ddf675-4k4rp\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") " pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:17.725612 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.725542    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-model-cache\") pod \"autores-model-d6a4de-kserve-78f5ddf675-4k4rp\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") " pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:17.725612 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.725569    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-tls-certs\") pod \"autores-model-d6a4de-kserve-78f5ddf675-4k4rp\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") " pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:17.725612 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.725583    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-tmp-dir\") pod \"autores-model-d6a4de-kserve-78f5ddf675-4k4rp\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") " pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:17.725809 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.725659    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-home\") pod \"autores-model-d6a4de-kserve-78f5ddf675-4k4rp\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") " pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:17.801954 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.801918    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"]
Sep 10 22:16:17.827180 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.827147    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-home\") pod \"autores-model-d6a4de-kserve-78f5ddf675-4k4rp\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") " pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:17.827180 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.827194    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxq67\" (UniqueName: \"kubernetes.io/projected/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-kube-api-access-qxq67\") pod \"autores-model-d6a4de-kserve-78f5ddf675-4k4rp\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") " pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:17.827446 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.827228    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-dshm\") pod \"autores-model-d6a4de-kserve-78f5ddf675-4k4rp\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") " pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:17.827446 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.827304    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-model-cache\") pod \"autores-model-d6a4de-kserve-78f5ddf675-4k4rp\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") " pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:17.827446 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.827343    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-tls-certs\") pod \"autores-model-d6a4de-kserve-78f5ddf675-4k4rp\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") " pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:17.827446 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.827364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-tmp-dir\") pod \"autores-model-d6a4de-kserve-78f5ddf675-4k4rp\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") " pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:17.827625 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.827594    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-home\") pod \"autores-model-d6a4de-kserve-78f5ddf675-4k4rp\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") " pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:17.827846 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.827817    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-tmp-dir\") pod \"autores-model-d6a4de-kserve-78f5ddf675-4k4rp\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") " pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:17.827846 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.827815    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-model-cache\") pod \"autores-model-d6a4de-kserve-78f5ddf675-4k4rp\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") " pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:17.829770 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.829731    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-dshm\") pod \"autores-model-d6a4de-kserve-78f5ddf675-4k4rp\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") " pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:17.830202 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.830170    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-tls-certs\") pod \"autores-model-d6a4de-kserve-78f5ddf675-4k4rp\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") " pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:17.841305 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.841276    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxq67\" (UniqueName: \"kubernetes.io/projected/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-kube-api-access-qxq67\") pod \"autores-model-d6a4de-kserve-78f5ddf675-4k4rp\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") " pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:17.849485 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:17.849457    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68640b8e-429b-4527-99f0-314fcd664f86" path="/var/lib/kubelet/pods/68640b8e-429b-4527-99f0-314fcd664f86/volumes"
Sep 10 22:16:18.004483 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:18.004387    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:18.289380 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:18.289349    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"]
Sep 10 22:16:18.291443 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:16:18.291420    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0bfd7b2_ec3c_4365_b8fe_0722b45a338d.slice/crio-374a0ddb72cac4b4fc620f0a5b6f0a16a3b5f4ebf2eab03d4167da5a81d09ec9 WatchSource:0}: Error finding container 374a0ddb72cac4b4fc620f0a5b6f0a16a3b5f4ebf2eab03d4167da5a81d09ec9: Status 404 returned error can't find the container with id 374a0ddb72cac4b4fc620f0a5b6f0a16a3b5f4ebf2eab03d4167da5a81d09ec9
Sep 10 22:16:18.628693 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:18.628597    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp" event={"ID":"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d","Type":"ContainerStarted","Data":"b153600e7a5b153248788b50c8f5b63cf7572428a3af2e6cb345c032a8013656"}
Sep 10 22:16:18.628693 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:18.628658    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp" event={"ID":"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d","Type":"ContainerStarted","Data":"374a0ddb72cac4b4fc620f0a5b6f0a16a3b5f4ebf2eab03d4167da5a81d09ec9"}
Sep 10 22:16:18.658017 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:18.657964    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp" podStartSLOduration=1.6579480640000002 podStartE2EDuration="1.657948064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:16:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:16:18.65713723 +0000 UTC m=+883.329235168" watchObservedRunningTime="2026-09-10 22:16:18.657948064 +0000 UTC m=+883.330045986"
Sep 10 22:16:22.402522 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:22.402477    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:16:28.005258 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:28.005170    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:28.005827 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:28.005490    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:28.018451 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:28.018422    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:28.706431 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:28.706400    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:16:38.391166 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:38.391129    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:16:44.651499 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:44.651463    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-53efb5ef-nm7zn"]
Sep 10 22:16:44.656585 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:44.656565    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-53efb5ef-nm7zn"
Sep 10 22:16:44.660199 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:44.660177    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8hjrv\""
Sep 10 22:16:44.675770 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:44.675739    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-53efb5ef-nm7zn"]
Sep 10 22:16:44.686188 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:44.686135    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9587946-78e7-4d74-9152-1ed47eaac635-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-53efb5ef-nm7zn\" (UID: \"f9587946-78e7-4d74-9152-1ed47eaac635\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-53efb5ef-nm7zn"
Sep 10 22:16:44.786985 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:44.786954    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9587946-78e7-4d74-9152-1ed47eaac635-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-53efb5ef-nm7zn\" (UID: \"f9587946-78e7-4d74-9152-1ed47eaac635\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-53efb5ef-nm7zn"
Sep 10 22:16:44.787530 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:44.787510    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9587946-78e7-4d74-9152-1ed47eaac635-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-53efb5ef-nm7zn\" (UID: \"f9587946-78e7-4d74-9152-1ed47eaac635\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-53efb5ef-nm7zn"
Sep 10 22:16:44.967134 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:44.967044    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-53efb5ef-nm7zn"
Sep 10 22:16:45.337312 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:45.337230    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-53efb5ef-nm7zn"]
Sep 10 22:16:45.344091 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:16:45.344067    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9587946_78e7_4d74_9152_1ed47eaac635.slice/crio-84694745ccec66991b5c1fd4b6ccbb0d52d5bc64749d6292238b09eacb9658e6 WatchSource:0}: Error finding container 84694745ccec66991b5c1fd4b6ccbb0d52d5bc64749d6292238b09eacb9658e6: Status 404 returned error can't find the container with id 84694745ccec66991b5c1fd4b6ccbb0d52d5bc64749d6292238b09eacb9658e6
Sep 10 22:16:45.800241 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:45.800199    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-53efb5ef-nm7zn" event={"ID":"f9587946-78e7-4d74-9152-1ed47eaac635","Type":"ContainerStarted","Data":"d3ffde2e4afe539b24f87e95e80d0f7c5da08c2d0966a2c16edb8a0f4c2271d4"}
Sep 10 22:16:45.800241 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:45.800248    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-53efb5ef-nm7zn" event={"ID":"f9587946-78e7-4d74-9152-1ed47eaac635","Type":"ContainerStarted","Data":"84694745ccec66991b5c1fd4b6ccbb0d52d5bc64749d6292238b09eacb9658e6"}
Sep 10 22:16:45.847117 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:45.847062    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-53efb5ef-nm7zn" podStartSLOduration=1.847042782 podStartE2EDuration="1.847042782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:16:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:16:45.845962801 +0000 UTC m=+910.518060722" watchObservedRunningTime="2026-09-10 22:16:45.847042782 +0000 UTC m=+910.519140703"
Sep 10 22:16:46.807703 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:46.807661    2577 generic.go:356] "Generic (PLEG): container finished" podID="f9587946-78e7-4d74-9152-1ed47eaac635" containerID="d3ffde2e4afe539b24f87e95e80d0f7c5da08c2d0966a2c16edb8a0f4c2271d4" exitCode=0
Sep 10 22:16:46.808100 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:46.807710    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-53efb5ef-nm7zn" event={"ID":"f9587946-78e7-4d74-9152-1ed47eaac635","Type":"ContainerDied","Data":"d3ffde2e4afe539b24f87e95e80d0f7c5da08c2d0966a2c16edb8a0f4c2271d4"}
Sep 10 22:16:47.956212 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:47.956153    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-53efb5ef-nm7zn"
Sep 10 22:16:48.017417 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:48.017388    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9587946-78e7-4d74-9152-1ed47eaac635-maas-api-service-ca\") pod \"f9587946-78e7-4d74-9152-1ed47eaac635\" (UID: \"f9587946-78e7-4d74-9152-1ed47eaac635\") "
Sep 10 22:16:48.017727 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:48.017707    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9587946-78e7-4d74-9152-1ed47eaac635-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f9587946-78e7-4d74-9152-1ed47eaac635" (UID: "f9587946-78e7-4d74-9152-1ed47eaac635"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:16:48.118421 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:48.118336    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9587946-78e7-4d74-9152-1ed47eaac635-maas-api-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:16:48.821540 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:48.821511    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-53efb5ef-nm7zn"
Sep 10 22:16:48.821729 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:48.821551    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-53efb5ef-nm7zn" event={"ID":"f9587946-78e7-4d74-9152-1ed47eaac635","Type":"ContainerDied","Data":"84694745ccec66991b5c1fd4b6ccbb0d52d5bc64749d6292238b09eacb9658e6"}
Sep 10 22:16:48.821729 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:48.821639    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84694745ccec66991b5c1fd4b6ccbb0d52d5bc64749d6292238b09eacb9658e6"
Sep 10 22:16:51.950604 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:51.950571    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d6a4de-ms2q8"]
Sep 10 22:16:51.951071 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:51.951057    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9587946-78e7-4d74-9152-1ed47eaac635" containerName="revoke-keys"
Sep 10 22:16:51.951071 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:51.951072    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9587946-78e7-4d74-9152-1ed47eaac635" containerName="revoke-keys"
Sep 10 22:16:51.951144 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:51.951139    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9587946-78e7-4d74-9152-1ed47eaac635" containerName="revoke-keys"
Sep 10 22:16:51.954499 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:51.954479    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d6a4de-ms2q8"
Sep 10 22:16:51.959088 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:51.959067    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8hjrv\""
Sep 10 22:16:51.969800 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:51.969751    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d6a4de-ms2q8"]
Sep 10 22:16:52.055432 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:52.055395    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e03f653-21f9-4e9b-8075-ff1143f5b4c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-d6a4de-ms2q8\" (UID: \"9e03f653-21f9-4e9b-8075-ff1143f5b4c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d6a4de-ms2q8"
Sep 10 22:16:52.156563 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:52.156519    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e03f653-21f9-4e9b-8075-ff1143f5b4c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-d6a4de-ms2q8\" (UID: \"9e03f653-21f9-4e9b-8075-ff1143f5b4c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d6a4de-ms2q8"
Sep 10 22:16:52.157281 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:52.157258    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e03f653-21f9-4e9b-8075-ff1143f5b4c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-d6a4de-ms2q8\" (UID: \"9e03f653-21f9-4e9b-8075-ff1143f5b4c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d6a4de-ms2q8"
Sep 10 22:16:52.265585 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:52.265501    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d6a4de-ms2q8"
Sep 10 22:16:52.543460 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:52.543431    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d6a4de-ms2q8"]
Sep 10 22:16:52.544577 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:16:52.544547    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e03f653_21f9_4e9b_8075_ff1143f5b4c8.slice/crio-d2813884f9393ec18c3debc925de07414531f64f5efab7bd1757d2d40f12eb46 WatchSource:0}: Error finding container d2813884f9393ec18c3debc925de07414531f64f5efab7bd1757d2d40f12eb46: Status 404 returned error can't find the container with id d2813884f9393ec18c3debc925de07414531f64f5efab7bd1757d2d40f12eb46
Sep 10 22:16:52.848975 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:52.848944    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d6a4de-ms2q8" event={"ID":"9e03f653-21f9-4e9b-8075-ff1143f5b4c8","Type":"ContainerStarted","Data":"d2813884f9393ec18c3debc925de07414531f64f5efab7bd1757d2d40f12eb46"}
Sep 10 22:16:53.855586 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:53.855555    2577 generic.go:356] "Generic (PLEG): container finished" podID="9e03f653-21f9-4e9b-8075-ff1143f5b4c8" containerID="428be79da8bdd53019902bca1e2c92d7557a8f8605f49d7b25a22d10c76f0636" exitCode=0
Sep 10 22:16:53.856072 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:53.855632    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d6a4de-ms2q8" event={"ID":"9e03f653-21f9-4e9b-8075-ff1143f5b4c8","Type":"ContainerDied","Data":"428be79da8bdd53019902bca1e2c92d7557a8f8605f49d7b25a22d10c76f0636"}
Sep 10 22:16:55.004799 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:55.004756    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d6a4de-ms2q8"
Sep 10 22:16:55.085137 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:55.085103    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e03f653-21f9-4e9b-8075-ff1143f5b4c8-maas-api-service-ca\") pod \"9e03f653-21f9-4e9b-8075-ff1143f5b4c8\" (UID: \"9e03f653-21f9-4e9b-8075-ff1143f5b4c8\") "
Sep 10 22:16:55.085480 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:55.085459    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e03f653-21f9-4e9b-8075-ff1143f5b4c8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9e03f653-21f9-4e9b-8075-ff1143f5b4c8" (UID: "9e03f653-21f9-4e9b-8075-ff1143f5b4c8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:16:55.186762 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:55.186718    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e03f653-21f9-4e9b-8075-ff1143f5b4c8-maas-api-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:16:55.869198 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:55.869170    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d6a4de-ms2q8"
Sep 10 22:16:55.869387 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:55.869207    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d6a4de-ms2q8" event={"ID":"9e03f653-21f9-4e9b-8075-ff1143f5b4c8","Type":"ContainerDied","Data":"d2813884f9393ec18c3debc925de07414531f64f5efab7bd1757d2d40f12eb46"}
Sep 10 22:16:55.869387 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:55.869265    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2813884f9393ec18c3debc925de07414531f64f5efab7bd1757d2d40f12eb46"
Sep 10 22:16:56.540887 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:56.540854    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-53efb5ef-nm7zn"]
Sep 10 22:16:56.543895 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:56.543867    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-53efb5ef-nm7zn"]
Sep 10 22:16:57.855004 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:57.854967    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9587946-78e7-4d74-9152-1ed47eaac635" path="/var/lib/kubelet/pods/f9587946-78e7-4d74-9152-1ed47eaac635/volumes"
Sep 10 22:16:58.326971 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.326915    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"]
Sep 10 22:16:58.327399 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.327380    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e03f653-21f9-4e9b-8075-ff1143f5b4c8" containerName="revoke-keys"
Sep 10 22:16:58.327507 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.327402    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e03f653-21f9-4e9b-8075-ff1143f5b4c8" containerName="revoke-keys"
Sep 10 22:16:58.327560 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.327512    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e03f653-21f9-4e9b-8075-ff1143f5b4c8" containerName="revoke-keys"
Sep 10 22:16:58.331092 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.331069    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.333338 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.333315    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-4149405d-openshift-default-dockercfg-k9f78\""
Sep 10 22:16:58.346438 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.346405    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"]
Sep 10 22:16:58.417343 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.417305    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-data\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.417577 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.417429    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2020fe7-5032-4d5e-aca4-8835db467b02-istiod-ca-cert\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.417577 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.417466    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-credential-socket\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.417577 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.417503    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-workload-socket\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.417747 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.417583    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-workload-certs\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.417747 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.417624    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-envoy\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.417747 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.417649    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-token\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.417747 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.417681    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-podinfo\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.417747 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.417729    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdbcb\" (UniqueName: \"kubernetes.io/projected/e2020fe7-5032-4d5e-aca4-8835db467b02-kube-api-access-fdbcb\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.518444 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.518406    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-workload-certs\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.518654 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.518453    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-envoy\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.518654 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.518474    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-token\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.518654 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.518493    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-podinfo\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.518654 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.518510    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdbcb\" (UniqueName: \"kubernetes.io/projected/e2020fe7-5032-4d5e-aca4-8835db467b02-kube-api-access-fdbcb\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.518654 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.518562    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-data\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.518970 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.518697    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2020fe7-5032-4d5e-aca4-8835db467b02-istiod-ca-cert\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.518970 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.518727    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-credential-socket\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.518970 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.518790    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-workload-socket\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.518970 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.518923    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-workload-certs\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.519173 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.519018    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-data\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.519173 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.519106    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-workload-socket\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.519278 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.519169    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-credential-socket\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.519481 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.519415    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2020fe7-5032-4d5e-aca4-8835db467b02-istiod-ca-cert\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.521196 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.521173    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-envoy\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.521302 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.521228    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-podinfo\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.526048 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.526024    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-token\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.526432 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.526416    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdbcb\" (UniqueName: \"kubernetes.io/projected/e2020fe7-5032-4d5e-aca4-8835db467b02-kube-api-access-fdbcb\") pod \"e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") " pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.645202 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.645164    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:16:58.928826 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.928799    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"]
Sep 10 22:16:58.930387 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:16:58.930362    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2020fe7_5032_4d5e_aca4_8835db467b02.slice/crio-2c3c2a29c18341958ce738f55526a45472f2026b7eb8977462d6aee32565067a WatchSource:0}: Error finding container 2c3c2a29c18341958ce738f55526a45472f2026b7eb8977462d6aee32565067a: Status 404 returned error can't find the container with id 2c3c2a29c18341958ce738f55526a45472f2026b7eb8977462d6aee32565067a
Sep 10 22:16:58.932928 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.932845    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:16:58.933029 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.932927    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:16:58.933029 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:58.932996    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:16:59.895393 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:59.895356    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8" event={"ID":"e2020fe7-5032-4d5e-aca4-8835db467b02","Type":"ContainerStarted","Data":"d858f01fd016ef12adce8b9aad42b8bbd938437421e6685b7360bc50b942a2aa"}
Sep 10 22:16:59.895597 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:59.895418    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8" event={"ID":"e2020fe7-5032-4d5e-aca4-8835db467b02","Type":"ContainerStarted","Data":"2c3c2a29c18341958ce738f55526a45472f2026b7eb8977462d6aee32565067a"}
Sep 10 22:16:59.917754 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:16:59.917696    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8" podStartSLOduration=1.9176786209999999 podStartE2EDuration="1.917678621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:16:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:16:59.916017384 +0000 UTC m=+924.588115306" watchObservedRunningTime="2026-09-10 22:16:59.917678621 +0000 UTC m=+924.589776543"
Sep 10 22:17:00.646017 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:00.645980    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:17:00.651573 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:00.651548    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:17:00.903678 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:00.903592    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:17:00.904829 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:00.904808    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:17:01.875974 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:01.875935    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:17:04.116991 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:04.116957    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-d6a4de-29817975-ltg8z"]
Sep 10 22:17:04.121580 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:04.121549    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-d6a4de-29817975-ltg8z"]
Sep 10 22:17:04.152856 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:04.152818    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5"]
Sep 10 22:17:04.153120 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:04.153076    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5" podUID="beefc640-d0b0-4e8c-b4eb-941f2daa5c71" containerName="payload-pre-processing" containerID="cri-o://15cf9a53ac1eb5a76f82220fa84d6369428852b283917b1b4bb29d6b86dac793" gracePeriod=30
Sep 10 22:17:04.349132 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:04.349100    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d6a4de-ms2q8"]
Sep 10 22:17:04.351758 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:04.351731    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d6a4de-ms2q8"]
Sep 10 22:17:04.405095 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:04.405071    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5"
Sep 10 22:17:04.476689 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:04.476652    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q264n\" (UniqueName: \"kubernetes.io/projected/beefc640-d0b0-4e8c-b4eb-941f2daa5c71-kube-api-access-q264n\") pod \"beefc640-d0b0-4e8c-b4eb-941f2daa5c71\" (UID: \"beefc640-d0b0-4e8c-b4eb-941f2daa5c71\") "
Sep 10 22:17:04.476925 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:04.476730    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/beefc640-d0b0-4e8c-b4eb-941f2daa5c71-plugins-config-volume\") pod \"beefc640-d0b0-4e8c-b4eb-941f2daa5c71\" (UID: \"beefc640-d0b0-4e8c-b4eb-941f2daa5c71\") "
Sep 10 22:17:04.477133 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:04.477110    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/beefc640-d0b0-4e8c-b4eb-941f2daa5c71-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "beefc640-d0b0-4e8c-b4eb-941f2daa5c71" (UID: "beefc640-d0b0-4e8c-b4eb-941f2daa5c71"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:17:04.477258 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:04.477243    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/beefc640-d0b0-4e8c-b4eb-941f2daa5c71-plugins-config-volume\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:17:04.479032 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:04.479013    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beefc640-d0b0-4e8c-b4eb-941f2daa5c71-kube-api-access-q264n" (OuterVolumeSpecName: "kube-api-access-q264n") pod "beefc640-d0b0-4e8c-b4eb-941f2daa5c71" (UID: "beefc640-d0b0-4e8c-b4eb-941f2daa5c71"). InnerVolumeSpecName "kube-api-access-q264n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:17:04.578287 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:04.578254    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q264n\" (UniqueName: \"kubernetes.io/projected/beefc640-d0b0-4e8c-b4eb-941f2daa5c71-kube-api-access-q264n\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:17:04.929539 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:04.929506    2577 generic.go:356] "Generic (PLEG): container finished" podID="beefc640-d0b0-4e8c-b4eb-941f2daa5c71" containerID="15cf9a53ac1eb5a76f82220fa84d6369428852b283917b1b4bb29d6b86dac793" exitCode=0
Sep 10 22:17:04.929738 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:04.929555    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5"
Sep 10 22:17:04.929738 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:04.929582    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5" event={"ID":"beefc640-d0b0-4e8c-b4eb-941f2daa5c71","Type":"ContainerDied","Data":"15cf9a53ac1eb5a76f82220fa84d6369428852b283917b1b4bb29d6b86dac793"}
Sep 10 22:17:04.929738 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:04.929626    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5" event={"ID":"beefc640-d0b0-4e8c-b4eb-941f2daa5c71","Type":"ContainerDied","Data":"15b4dc310c3a6a5506942a7924cc02496b8162e132d04102d84b20f9bb2dabfb"}
Sep 10 22:17:04.929738 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:04.929647    2577 scope.go:117] "RemoveContainer" containerID="15cf9a53ac1eb5a76f82220fa84d6369428852b283917b1b4bb29d6b86dac793"
Sep 10 22:17:04.939439 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:04.939418    2577 scope.go:117] "RemoveContainer" containerID="15cf9a53ac1eb5a76f82220fa84d6369428852b283917b1b4bb29d6b86dac793"
Sep 10 22:17:04.939804 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:17:04.939756    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15cf9a53ac1eb5a76f82220fa84d6369428852b283917b1b4bb29d6b86dac793\": container with ID starting with 15cf9a53ac1eb5a76f82220fa84d6369428852b283917b1b4bb29d6b86dac793 not found: ID does not exist" containerID="15cf9a53ac1eb5a76f82220fa84d6369428852b283917b1b4bb29d6b86dac793"
Sep 10 22:17:04.939903 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:04.939813    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15cf9a53ac1eb5a76f82220fa84d6369428852b283917b1b4bb29d6b86dac793"} err="failed to get container status \"15cf9a53ac1eb5a76f82220fa84d6369428852b283917b1b4bb29d6b86dac793\": rpc error: code = NotFound desc = could not find container \"15cf9a53ac1eb5a76f82220fa84d6369428852b283917b1b4bb29d6b86dac793\": container with ID starting with 15cf9a53ac1eb5a76f82220fa84d6369428852b283917b1b4bb29d6b86dac793 not found: ID does not exist"
Sep 10 22:17:04.953595 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:04.953564    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5"]
Sep 10 22:17:04.956031 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:04.956009    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-d6a4de-5d779cb86-9sml5"]
Sep 10 22:17:05.851868 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:05.851838    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b3b9190-2e93-45bb-a1ce-925e0207e661" path="/var/lib/kubelet/pods/4b3b9190-2e93-45bb-a1ce-925e0207e661/volumes"
Sep 10 22:17:05.852247 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:05.852167    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e03f653-21f9-4e9b-8075-ff1143f5b4c8" path="/var/lib/kubelet/pods/9e03f653-21f9-4e9b-8075-ff1143f5b4c8/volumes"
Sep 10 22:17:05.852478 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:05.852465    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="beefc640-d0b0-4e8c-b4eb-941f2daa5c71" path="/var/lib/kubelet/pods/beefc640-d0b0-4e8c-b4eb-941f2daa5c71/volumes"
Sep 10 22:17:09.676756 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:09.676722    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"]
Sep 10 22:17:18.866026 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:18.865986    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:17:21.035508 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:21.035415    2577 generic.go:356] "Generic (PLEG): container finished" podID="e2020fe7-5032-4d5e-aca4-8835db467b02" containerID="d858f01fd016ef12adce8b9aad42b8bbd938437421e6685b7360bc50b942a2aa" exitCode=0
Sep 10 22:17:21.036046 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:21.035645    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8" event={"ID":"e2020fe7-5032-4d5e-aca4-8835db467b02","Type":"ContainerDied","Data":"d858f01fd016ef12adce8b9aad42b8bbd938437421e6685b7360bc50b942a2aa"}
Sep 10 22:17:21.036225 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:21.036204    2577 scope.go:117] "RemoveContainer" containerID="d858f01fd016ef12adce8b9aad42b8bbd938437421e6685b7360bc50b942a2aa"
Sep 10 22:17:21.037797 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:21.037744    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:17:21.037906 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:21.037856    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:17:21.037976 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:21.037910    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:17:22.044238 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:22.044199    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8" event={"ID":"e2020fe7-5032-4d5e-aca4-8835db467b02","Type":"ContainerStarted","Data":"e05a19e7353548fe7f14d34d2ccf28524dfacad30dc2cb2f1d34a74af8454d5d"}
Sep 10 22:17:22.645709 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:22.645667    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:17:22.645995 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:22.645725    2577 patch_prober.go:28] interesting pod/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 10 22:17:22.645995 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:22.645818    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8" podUID="e2020fe7-5032-4d5e-aca4-8835db467b02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 10 22:17:23.645869 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:23.645827    2577 patch_prober.go:28] interesting pod/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 10 22:17:23.646386 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:23.645920    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8" podUID="e2020fe7-5032-4d5e-aca4-8835db467b02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 10 22:17:24.646493 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:24.646456    2577 patch_prober.go:28] interesting pod/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 10 22:17:24.647162 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:24.647126    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8" podUID="e2020fe7-5032-4d5e-aca4-8835db467b02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 10 22:17:24.696874 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:24.696827    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp" podUID="a0bfd7b2-ec3c-4365-b8fe-0722b45a338d" containerName="main" containerID="cri-o://b153600e7a5b153248788b50c8f5b63cf7572428a3af2e6cb345c032a8013656" gracePeriod=45
Sep 10 22:17:24.988977 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:24.988953    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:17:25.070149 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.070113    2577 generic.go:356] "Generic (PLEG): container finished" podID="a0bfd7b2-ec3c-4365-b8fe-0722b45a338d" containerID="b153600e7a5b153248788b50c8f5b63cf7572428a3af2e6cb345c032a8013656" exitCode=0
Sep 10 22:17:25.070337 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.070157    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"
Sep 10 22:17:25.070337 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.070197    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp" event={"ID":"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d","Type":"ContainerDied","Data":"b153600e7a5b153248788b50c8f5b63cf7572428a3af2e6cb345c032a8013656"}
Sep 10 22:17:25.070337 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.070238    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp" event={"ID":"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d","Type":"ContainerDied","Data":"374a0ddb72cac4b4fc620f0a5b6f0a16a3b5f4ebf2eab03d4167da5a81d09ec9"}
Sep 10 22:17:25.070337 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.070262    2577 scope.go:117] "RemoveContainer" containerID="b153600e7a5b153248788b50c8f5b63cf7572428a3af2e6cb345c032a8013656"
Sep 10 22:17:25.083021 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.080586    2577 scope.go:117] "RemoveContainer" containerID="b153600e7a5b153248788b50c8f5b63cf7572428a3af2e6cb345c032a8013656"
Sep 10 22:17:25.083622 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:17:25.083552    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b153600e7a5b153248788b50c8f5b63cf7572428a3af2e6cb345c032a8013656\": container with ID starting with b153600e7a5b153248788b50c8f5b63cf7572428a3af2e6cb345c032a8013656 not found: ID does not exist" containerID="b153600e7a5b153248788b50c8f5b63cf7572428a3af2e6cb345c032a8013656"
Sep 10 22:17:25.083622 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.083601    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b153600e7a5b153248788b50c8f5b63cf7572428a3af2e6cb345c032a8013656"} err="failed to get container status \"b153600e7a5b153248788b50c8f5b63cf7572428a3af2e6cb345c032a8013656\": rpc error: code = NotFound desc = could not find container \"b153600e7a5b153248788b50c8f5b63cf7572428a3af2e6cb345c032a8013656\": container with ID starting with b153600e7a5b153248788b50c8f5b63cf7572428a3af2e6cb345c032a8013656 not found: ID does not exist"
Sep 10 22:17:25.084886 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.084824    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-tls-certs\") pod \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") "
Sep 10 22:17:25.085007 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.084889    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-model-cache\") pod \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") "
Sep 10 22:17:25.085007 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.084975    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxq67\" (UniqueName: \"kubernetes.io/projected/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-kube-api-access-qxq67\") pod \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") "
Sep 10 22:17:25.085142 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.085032    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-home\") pod \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") "
Sep 10 22:17:25.085142 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.085063    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-tmp-dir\") pod \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") "
Sep 10 22:17:25.085254 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.085143    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-model-cache" (OuterVolumeSpecName: "model-cache") pod "a0bfd7b2-ec3c-4365-b8fe-0722b45a338d" (UID: "a0bfd7b2-ec3c-4365-b8fe-0722b45a338d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:17:25.085254 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.085158    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-dshm\") pod \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\" (UID: \"a0bfd7b2-ec3c-4365-b8fe-0722b45a338d\") "
Sep 10 22:17:25.085368 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.085336    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-home" (OuterVolumeSpecName: "home") pod "a0bfd7b2-ec3c-4365-b8fe-0722b45a338d" (UID: "a0bfd7b2-ec3c-4365-b8fe-0722b45a338d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:17:25.085431 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.085414    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a0bfd7b2-ec3c-4365-b8fe-0722b45a338d" (UID: "a0bfd7b2-ec3c-4365-b8fe-0722b45a338d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:17:25.085563 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.085546    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-model-cache\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:17:25.085563 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.085568    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-home\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:17:25.085707 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.085580    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-tmp-dir\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:17:25.087687 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.087661    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-dshm" (OuterVolumeSpecName: "dshm") pod "a0bfd7b2-ec3c-4365-b8fe-0722b45a338d" (UID: "a0bfd7b2-ec3c-4365-b8fe-0722b45a338d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:17:25.087835 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.087815    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a0bfd7b2-ec3c-4365-b8fe-0722b45a338d" (UID: "a0bfd7b2-ec3c-4365-b8fe-0722b45a338d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:17:25.087899 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.087849    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-kube-api-access-qxq67" (OuterVolumeSpecName: "kube-api-access-qxq67") pod "a0bfd7b2-ec3c-4365-b8fe-0722b45a338d" (UID: "a0bfd7b2-ec3c-4365-b8fe-0722b45a338d"). InnerVolumeSpecName "kube-api-access-qxq67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:17:25.186237 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.186204    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-dshm\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:17:25.186237 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.186233    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-tls-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:17:25.186237 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.186243    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxq67\" (UniqueName: \"kubernetes.io/projected/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d-kube-api-access-qxq67\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:17:25.391938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.391907    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"]
Sep 10 22:17:25.395763 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.395736    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-d6a4de/autores-model-d6a4de-kserve-78f5ddf675-4k4rp"]
Sep 10 22:17:25.646410 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.646370    2577 patch_prober.go:28] interesting pod/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 10 22:17:25.646623 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.646461    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8" podUID="e2020fe7-5032-4d5e-aca4-8835db467b02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 10 22:17:25.858481 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:25.858442    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0bfd7b2-ec3c-4365-b8fe-0722b45a338d" path="/var/lib/kubelet/pods/a0bfd7b2-ec3c-4365-b8fe-0722b45a338d/volumes"
Sep 10 22:17:26.066067 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:26.065980    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4149405d-5m7bn"]
Sep 10 22:17:26.066416 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:26.066403    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beefc640-d0b0-4e8c-b4eb-941f2daa5c71" containerName="payload-pre-processing"
Sep 10 22:17:26.066468 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:26.066418    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="beefc640-d0b0-4e8c-b4eb-941f2daa5c71" containerName="payload-pre-processing"
Sep 10 22:17:26.066468 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:26.066431    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0bfd7b2-ec3c-4365-b8fe-0722b45a338d" containerName="main"
Sep 10 22:17:26.066468 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:26.066436    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0bfd7b2-ec3c-4365-b8fe-0722b45a338d" containerName="main"
Sep 10 22:17:26.066569 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:26.066499    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0bfd7b2-ec3c-4365-b8fe-0722b45a338d" containerName="main"
Sep 10 22:17:26.066569 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:26.066510    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="beefc640-d0b0-4e8c-b4eb-941f2daa5c71" containerName="payload-pre-processing"
Sep 10 22:17:26.070843 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:26.070823    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4149405d-5m7bn"
Sep 10 22:17:26.073124 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:26.073100    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8hjrv\""
Sep 10 22:17:26.077856 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:26.077556    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4149405d-5m7bn"]
Sep 10 22:17:26.194698 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:26.194657    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c42a7183-cfab-4be4-9128-5373d1a8523c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-4149405d-5m7bn\" (UID: \"c42a7183-cfab-4be4-9128-5373d1a8523c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4149405d-5m7bn"
Sep 10 22:17:26.295612 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:26.295578    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c42a7183-cfab-4be4-9128-5373d1a8523c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-4149405d-5m7bn\" (UID: \"c42a7183-cfab-4be4-9128-5373d1a8523c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4149405d-5m7bn"
Sep 10 22:17:26.296207 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:26.296188    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c42a7183-cfab-4be4-9128-5373d1a8523c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-4149405d-5m7bn\" (UID: \"c42a7183-cfab-4be4-9128-5373d1a8523c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4149405d-5m7bn"
Sep 10 22:17:26.384592 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:26.384565    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4149405d-5m7bn"
Sep 10 22:17:26.646493 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:26.646401    2577 patch_prober.go:28] interesting pod/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 10 22:17:26.646651 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:26.646483    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8" podUID="e2020fe7-5032-4d5e-aca4-8835db467b02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 10 22:17:26.677593 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:26.677564    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4149405d-5m7bn"]
Sep 10 22:17:26.679191 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:17:26.679165    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc42a7183_cfab_4be4_9128_5373d1a8523c.slice/crio-d309c3bf7af59421d4ff6b90676d5dc8d7c635b644e79c4280e4d7ea399efb07 WatchSource:0}: Error finding container d309c3bf7af59421d4ff6b90676d5dc8d7c635b644e79c4280e4d7ea399efb07: Status 404 returned error can't find the container with id d309c3bf7af59421d4ff6b90676d5dc8d7c635b644e79c4280e4d7ea399efb07
Sep 10 22:17:27.088284 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:27.088241    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4149405d-5m7bn" event={"ID":"c42a7183-cfab-4be4-9128-5373d1a8523c","Type":"ContainerStarted","Data":"ccb7c87070ab40e9468615a4552d9d0820c4cd314d131b826e85c0cccde33021"}
Sep 10 22:17:27.088468 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:27.088303    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4149405d-5m7bn" event={"ID":"c42a7183-cfab-4be4-9128-5373d1a8523c","Type":"ContainerStarted","Data":"d309c3bf7af59421d4ff6b90676d5dc8d7c635b644e79c4280e4d7ea399efb07"}
Sep 10 22:17:27.103629 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:27.103586    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4149405d-5m7bn" podStartSLOduration=1.103570817 podStartE2EDuration="1.103570817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:17:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:17:27.102301226 +0000 UTC m=+951.774399146" watchObservedRunningTime="2026-09-10 22:17:27.103570817 +0000 UTC m=+951.775668741"
Sep 10 22:17:27.645903 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:27.645861    2577 patch_prober.go:28] interesting pod/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 10 22:17:27.646182 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:27.646150    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8" podUID="e2020fe7-5032-4d5e-aca4-8835db467b02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 10 22:17:28.096233 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:28.096140    2577 generic.go:356] "Generic (PLEG): container finished" podID="c42a7183-cfab-4be4-9128-5373d1a8523c" containerID="ccb7c87070ab40e9468615a4552d9d0820c4cd314d131b826e85c0cccde33021" exitCode=0
Sep 10 22:17:28.096233 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:28.096221    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4149405d-5m7bn" event={"ID":"c42a7183-cfab-4be4-9128-5373d1a8523c","Type":"ContainerDied","Data":"ccb7c87070ab40e9468615a4552d9d0820c4cd314d131b826e85c0cccde33021"}
Sep 10 22:17:28.649699 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:28.649670    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:17:28.650006 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:28.649987    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:17:28.650770 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:28.650749    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:17:29.238964 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:29.238932    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4149405d-5m7bn"
Sep 10 22:17:29.428029 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:29.427997    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c42a7183-cfab-4be4-9128-5373d1a8523c-maas-api-service-ca\") pod \"c42a7183-cfab-4be4-9128-5373d1a8523c\" (UID: \"c42a7183-cfab-4be4-9128-5373d1a8523c\") "
Sep 10 22:17:29.428347 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:29.428325    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c42a7183-cfab-4be4-9128-5373d1a8523c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c42a7183-cfab-4be4-9128-5373d1a8523c" (UID: "c42a7183-cfab-4be4-9128-5373d1a8523c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:17:29.529070 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:29.529019    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c42a7183-cfab-4be4-9128-5373d1a8523c-maas-api-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:17:30.109187 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:30.109106    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4149405d-5m7bn"
Sep 10 22:17:30.109187 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:30.109140    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4149405d-5m7bn" event={"ID":"c42a7183-cfab-4be4-9128-5373d1a8523c","Type":"ContainerDied","Data":"d309c3bf7af59421d4ff6b90676d5dc8d7c635b644e79c4280e4d7ea399efb07"}
Sep 10 22:17:30.109422 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:30.109191    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d309c3bf7af59421d4ff6b90676d5dc8d7c635b644e79c4280e4d7ea399efb07"
Sep 10 22:17:33.279536 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:33.279499    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4149405d-5m7bn"]
Sep 10 22:17:33.283428 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:33.283403    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4149405d-5m7bn"]
Sep 10 22:17:33.419884 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:33.419848    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"]
Sep 10 22:17:33.420149 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:33.420121    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8" podUID="e2020fe7-5032-4d5e-aca4-8835db467b02" containerName="istio-proxy" containerID="cri-o://e05a19e7353548fe7f14d34d2ccf28524dfacad30dc2cb2f1d34a74af8454d5d" gracePeriod=30
Sep 10 22:17:33.847917 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:33.847890    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c42a7183-cfab-4be4-9128-5373d1a8523c" path="/var/lib/kubelet/pods/c42a7183-cfab-4be4-9128-5373d1a8523c/volumes"
Sep 10 22:17:38.669394 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.669369    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:17:38.701194 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.701112    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-data\") pod \"e2020fe7-5032-4d5e-aca4-8835db467b02\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") "
Sep 10 22:17:38.701194 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.701174    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-credential-socket\") pod \"e2020fe7-5032-4d5e-aca4-8835db467b02\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") "
Sep 10 22:17:38.701415 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.701207    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-token\") pod \"e2020fe7-5032-4d5e-aca4-8835db467b02\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") "
Sep 10 22:17:38.701415 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.701237    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-podinfo\") pod \"e2020fe7-5032-4d5e-aca4-8835db467b02\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") "
Sep 10 22:17:38.701415 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.701300    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-workload-certs\") pod \"e2020fe7-5032-4d5e-aca4-8835db467b02\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") "
Sep 10 22:17:38.701415 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.701326    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-envoy\") pod \"e2020fe7-5032-4d5e-aca4-8835db467b02\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") "
Sep 10 22:17:38.701415 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.701351    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdbcb\" (UniqueName: \"kubernetes.io/projected/e2020fe7-5032-4d5e-aca4-8835db467b02-kube-api-access-fdbcb\") pod \"e2020fe7-5032-4d5e-aca4-8835db467b02\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") "
Sep 10 22:17:38.701415 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.701376    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2020fe7-5032-4d5e-aca4-8835db467b02-istiod-ca-cert\") pod \"e2020fe7-5032-4d5e-aca4-8835db467b02\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") "
Sep 10 22:17:38.701729 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.701414    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-data" (OuterVolumeSpecName: "istio-data") pod "e2020fe7-5032-4d5e-aca4-8835db467b02" (UID: "e2020fe7-5032-4d5e-aca4-8835db467b02"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:17:38.701729 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.701435    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e2020fe7-5032-4d5e-aca4-8835db467b02" (UID: "e2020fe7-5032-4d5e-aca4-8835db467b02"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:17:38.701729 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.701482    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-workload-socket\") pod \"e2020fe7-5032-4d5e-aca4-8835db467b02\" (UID: \"e2020fe7-5032-4d5e-aca4-8835db467b02\") "
Sep 10 22:17:38.701937 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.701837    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e2020fe7-5032-4d5e-aca4-8835db467b02" (UID: "e2020fe7-5032-4d5e-aca4-8835db467b02"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:17:38.701937 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.701891    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-data\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:17:38.701937 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.701911    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-credential-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:17:38.702098 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.702008    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2020fe7-5032-4d5e-aca4-8835db467b02-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e2020fe7-5032-4d5e-aca4-8835db467b02" (UID: "e2020fe7-5032-4d5e-aca4-8835db467b02"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:17:38.702305 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.702181    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e2020fe7-5032-4d5e-aca4-8835db467b02" (UID: "e2020fe7-5032-4d5e-aca4-8835db467b02"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:17:38.703888 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.703851    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2020fe7-5032-4d5e-aca4-8835db467b02-kube-api-access-fdbcb" (OuterVolumeSpecName: "kube-api-access-fdbcb") pod "e2020fe7-5032-4d5e-aca4-8835db467b02" (UID: "e2020fe7-5032-4d5e-aca4-8835db467b02"). InnerVolumeSpecName "kube-api-access-fdbcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:17:38.704469 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.704439    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e2020fe7-5032-4d5e-aca4-8835db467b02" (UID: "e2020fe7-5032-4d5e-aca4-8835db467b02"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:17:38.704553 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.704462    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e2020fe7-5032-4d5e-aca4-8835db467b02" (UID: "e2020fe7-5032-4d5e-aca4-8835db467b02"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:17:38.704553 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.704447    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-token" (OuterVolumeSpecName: "istio-token") pod "e2020fe7-5032-4d5e-aca4-8835db467b02" (UID: "e2020fe7-5032-4d5e-aca4-8835db467b02"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:17:38.803031 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.803000    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-workload-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:17:38.803031 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.803025    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-envoy\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:17:38.803031 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.803033    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdbcb\" (UniqueName: \"kubernetes.io/projected/e2020fe7-5032-4d5e-aca4-8835db467b02-kube-api-access-fdbcb\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:17:38.803249 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.803042    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2020fe7-5032-4d5e-aca4-8835db467b02-istiod-ca-cert\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:17:38.803249 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.803052    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2020fe7-5032-4d5e-aca4-8835db467b02-workload-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:17:38.803249 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.803059    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-token\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:17:38.803249 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:38.803066    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2020fe7-5032-4d5e-aca4-8835db467b02-istio-podinfo\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:17:39.167132 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:39.167093    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:17:39.170087 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:39.170061    2577 generic.go:356] "Generic (PLEG): container finished" podID="e2020fe7-5032-4d5e-aca4-8835db467b02" containerID="e05a19e7353548fe7f14d34d2ccf28524dfacad30dc2cb2f1d34a74af8454d5d" exitCode=0
Sep 10 22:17:39.170213 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:39.170113    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"
Sep 10 22:17:39.170213 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:39.170142    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8" event={"ID":"e2020fe7-5032-4d5e-aca4-8835db467b02","Type":"ContainerDied","Data":"e05a19e7353548fe7f14d34d2ccf28524dfacad30dc2cb2f1d34a74af8454d5d"}
Sep 10 22:17:39.170213 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:39.170196    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8" event={"ID":"e2020fe7-5032-4d5e-aca4-8835db467b02","Type":"ContainerDied","Data":"2c3c2a29c18341958ce738f55526a45472f2026b7eb8977462d6aee32565067a"}
Sep 10 22:17:39.170338 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:39.170222    2577 scope.go:117] "RemoveContainer" containerID="e05a19e7353548fe7f14d34d2ccf28524dfacad30dc2cb2f1d34a74af8454d5d"
Sep 10 22:17:39.182172 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:39.182062    2577 scope.go:117] "RemoveContainer" containerID="d858f01fd016ef12adce8b9aad42b8bbd938437421e6685b7360bc50b942a2aa"
Sep 10 22:17:39.191806 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:39.191758    2577 scope.go:117] "RemoveContainer" containerID="e05a19e7353548fe7f14d34d2ccf28524dfacad30dc2cb2f1d34a74af8454d5d"
Sep 10 22:17:39.192088 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:17:39.192070    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e05a19e7353548fe7f14d34d2ccf28524dfacad30dc2cb2f1d34a74af8454d5d\": container with ID starting with e05a19e7353548fe7f14d34d2ccf28524dfacad30dc2cb2f1d34a74af8454d5d not found: ID does not exist" containerID="e05a19e7353548fe7f14d34d2ccf28524dfacad30dc2cb2f1d34a74af8454d5d"
Sep 10 22:17:39.192135 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:39.192099    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e05a19e7353548fe7f14d34d2ccf28524dfacad30dc2cb2f1d34a74af8454d5d"} err="failed to get container status \"e05a19e7353548fe7f14d34d2ccf28524dfacad30dc2cb2f1d34a74af8454d5d\": rpc error: code = NotFound desc = could not find container \"e05a19e7353548fe7f14d34d2ccf28524dfacad30dc2cb2f1d34a74af8454d5d\": container with ID starting with e05a19e7353548fe7f14d34d2ccf28524dfacad30dc2cb2f1d34a74af8454d5d not found: ID does not exist"
Sep 10 22:17:39.192135 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:39.192118    2577 scope.go:117] "RemoveContainer" containerID="d858f01fd016ef12adce8b9aad42b8bbd938437421e6685b7360bc50b942a2aa"
Sep 10 22:17:39.192380 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:17:39.192365    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d858f01fd016ef12adce8b9aad42b8bbd938437421e6685b7360bc50b942a2aa\": container with ID starting with d858f01fd016ef12adce8b9aad42b8bbd938437421e6685b7360bc50b942a2aa not found: ID does not exist" containerID="d858f01fd016ef12adce8b9aad42b8bbd938437421e6685b7360bc50b942a2aa"
Sep 10 22:17:39.192440 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:39.192383    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d858f01fd016ef12adce8b9aad42b8bbd938437421e6685b7360bc50b942a2aa"} err="failed to get container status \"d858f01fd016ef12adce8b9aad42b8bbd938437421e6685b7360bc50b942a2aa\": rpc error: code = NotFound desc = could not find container \"d858f01fd016ef12adce8b9aad42b8bbd938437421e6685b7360bc50b942a2aa\": container with ID starting with d858f01fd016ef12adce8b9aad42b8bbd938437421e6685b7360bc50b942a2aa not found: ID does not exist"
Sep 10 22:17:39.197319 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:39.197292    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"]
Sep 10 22:17:39.200370 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:39.200339    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-4149405d-openshift-default-595f878d7b-fcfv8"]
Sep 10 22:17:39.849163 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:39.849125    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2020fe7-5032-4d5e-aca4-8835db467b02" path="/var/lib/kubelet/pods/e2020fe7-5032-4d5e-aca4-8835db467b02/volumes"
Sep 10 22:17:47.837853 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.837814    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"]
Sep 10 22:17:47.838459 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.838442    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2020fe7-5032-4d5e-aca4-8835db467b02" containerName="istio-proxy"
Sep 10 22:17:47.838522 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.838462    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2020fe7-5032-4d5e-aca4-8835db467b02" containerName="istio-proxy"
Sep 10 22:17:47.838522 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.838475    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c42a7183-cfab-4be4-9128-5373d1a8523c" containerName="revoke-keys"
Sep 10 22:17:47.838522 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.838484    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c42a7183-cfab-4be4-9128-5373d1a8523c" containerName="revoke-keys"
Sep 10 22:17:47.838634 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.838599    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c42a7183-cfab-4be4-9128-5373d1a8523c" containerName="revoke-keys"
Sep 10 22:17:47.838634 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.838614    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2020fe7-5032-4d5e-aca4-8835db467b02" containerName="istio-proxy"
Sep 10 22:17:47.838634 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.838624    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2020fe7-5032-4d5e-aca4-8835db467b02" containerName="istio-proxy"
Sep 10 22:17:47.844457 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.844439    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.846901 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.846874    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-8f9fc7-openshift-default-dockercfg-tfcjs\""
Sep 10 22:17:47.861771 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.861743    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"]
Sep 10 22:17:47.887929 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.887901    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-data\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.888082 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.887943    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-workload-certs\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.888082 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.888048    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gt9w\" (UniqueName: \"kubernetes.io/projected/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-kube-api-access-5gt9w\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.888179 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.888113    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istiod-ca-cert\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.888179 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.888146    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-workload-socket\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.888253 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.888212    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-envoy\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.888294 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.888271    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-token\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.888329 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.888309    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-podinfo\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.888360 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.888337    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-credential-socket\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.989407 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.989369    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gt9w\" (UniqueName: \"kubernetes.io/projected/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-kube-api-access-5gt9w\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.989595 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.989424    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istiod-ca-cert\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.989595 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.989452    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-workload-socket\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.989595 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.989503    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-envoy\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.989595 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.989552    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-token\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.989822 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.989596    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-podinfo\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.989822 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.989625    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-credential-socket\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.989822 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.989663    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-data\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.989822 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.989702    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-workload-certs\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.990168 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.990137    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-data\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.990258 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.990208    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-credential-socket\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.990304 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.990257    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-workload-certs\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.990368 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.990353    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-workload-socket\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.990423 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.990402    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istiod-ca-cert\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.992283 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.992260    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-envoy\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.992414 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.992395    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-podinfo\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.997182 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.997153    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gt9w\" (UniqueName: \"kubernetes.io/projected/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-kube-api-access-5gt9w\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:47.997527 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:47.997507    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-token\") pod \"e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") " pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:48.156833 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:48.156760    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:48.438078 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:17:48.438045    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba6cbf0_4ca2_483b_b743_2f2d776651bb.slice/crio-2972505a73f6e92d8fad1ea705eea52d58dd72290a8b6bafbcbf81bc9afd67ef WatchSource:0}: Error finding container 2972505a73f6e92d8fad1ea705eea52d58dd72290a8b6bafbcbf81bc9afd67ef: Status 404 returned error can't find the container with id 2972505a73f6e92d8fad1ea705eea52d58dd72290a8b6bafbcbf81bc9afd67ef
Sep 10 22:17:48.438362 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:48.438340    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"]
Sep 10 22:17:48.440560 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:48.440526    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:17:48.440659 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:48.440602    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:17:48.440659 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:48.440644    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:17:49.242202 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:49.242164    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc" event={"ID":"8ba6cbf0-4ca2-483b-b743-2f2d776651bb","Type":"ContainerStarted","Data":"0485a463fd757e206e348e062be568884fbf852d1db5c44124b9887fbcfd5fca"}
Sep 10 22:17:49.242691 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:49.242251    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc" event={"ID":"8ba6cbf0-4ca2-483b-b743-2f2d776651bb","Type":"ContainerStarted","Data":"2972505a73f6e92d8fad1ea705eea52d58dd72290a8b6bafbcbf81bc9afd67ef"}
Sep 10 22:17:49.262020 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:49.261973    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc" podStartSLOduration=2.261956139 podStartE2EDuration="2.261956139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:17:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:17:49.260609756 +0000 UTC m=+973.932707678" watchObservedRunningTime="2026-09-10 22:17:49.261956139 +0000 UTC m=+973.934054060"
Sep 10 22:17:50.157585 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:50.157548    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:50.162653 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:50.162623    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:50.248354 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:50.248323    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:50.249288 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:50.249266    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:17:52.325263 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:52.325226    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"]
Sep 10 22:17:52.326545 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:52.326514    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2020fe7-5032-4d5e-aca4-8835db467b02" containerName="istio-proxy"
Sep 10 22:17:52.326545 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:52.326546    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2020fe7-5032-4d5e-aca4-8835db467b02" containerName="istio-proxy"
Sep 10 22:17:52.330347 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:52.330314    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"
Sep 10 22:17:52.332986 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:52.332962    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 22:17:52.333175 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:52.333005    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-spztp\""
Sep 10 22:17:52.333329 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:52.333061    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-8f9fc7-serving-cert\""
Sep 10 22:17:52.340917 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:52.340295    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"]
Sep 10 22:17:52.431709 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:52.431668    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2726b582-54e3-4f92-96c3-3d76ab4e1247-maas-api-tls\") pod \"maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt\" (UID: \"2726b582-54e3-4f92-96c3-3d76ab4e1247\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"
Sep 10 22:17:52.431709 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:52.431714    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2726b582-54e3-4f92-96c3-3d76ab4e1247-openshift-service-ca\") pod \"maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt\" (UID: \"2726b582-54e3-4f92-96c3-3d76ab4e1247\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"
Sep 10 22:17:52.432032 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:52.431747    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkqxk\" (UniqueName: \"kubernetes.io/projected/2726b582-54e3-4f92-96c3-3d76ab4e1247-kube-api-access-mkqxk\") pod \"maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt\" (UID: \"2726b582-54e3-4f92-96c3-3d76ab4e1247\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"
Sep 10 22:17:52.432032 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:52.431813    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2726b582-54e3-4f92-96c3-3d76ab4e1247-metrics-certs\") pod \"maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt\" (UID: \"2726b582-54e3-4f92-96c3-3d76ab4e1247\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"
Sep 10 22:17:52.532589 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:52.532548    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2726b582-54e3-4f92-96c3-3d76ab4e1247-maas-api-tls\") pod \"maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt\" (UID: \"2726b582-54e3-4f92-96c3-3d76ab4e1247\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"
Sep 10 22:17:52.532589 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:52.532595    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2726b582-54e3-4f92-96c3-3d76ab4e1247-openshift-service-ca\") pod \"maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt\" (UID: \"2726b582-54e3-4f92-96c3-3d76ab4e1247\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"
Sep 10 22:17:52.532884 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:52.532622    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkqxk\" (UniqueName: \"kubernetes.io/projected/2726b582-54e3-4f92-96c3-3d76ab4e1247-kube-api-access-mkqxk\") pod \"maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt\" (UID: \"2726b582-54e3-4f92-96c3-3d76ab4e1247\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"
Sep 10 22:17:52.532884 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:52.532657    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2726b582-54e3-4f92-96c3-3d76ab4e1247-metrics-certs\") pod \"maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt\" (UID: \"2726b582-54e3-4f92-96c3-3d76ab4e1247\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"
Sep 10 22:17:52.532884 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:17:52.532687    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-serving-cert: secret "maas-api-e2e-explicit-8f9fc7-serving-cert" not found
Sep 10 22:17:52.532884 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:17:52.532764    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2726b582-54e3-4f92-96c3-3d76ab4e1247-maas-api-tls podName:2726b582-54e3-4f92-96c3-3d76ab4e1247 nodeName:}" failed. No retries permitted until 2026-09-10 22:17:53.032742189 +0000 UTC m=+977.704840087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2726b582-54e3-4f92-96c3-3d76ab4e1247-maas-api-tls") pod "maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt" (UID: "2726b582-54e3-4f92-96c3-3d76ab4e1247") : secret "maas-api-e2e-explicit-8f9fc7-serving-cert" not found
Sep 10 22:17:52.533462 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:52.533412    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2726b582-54e3-4f92-96c3-3d76ab4e1247-openshift-service-ca\") pod \"maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt\" (UID: \"2726b582-54e3-4f92-96c3-3d76ab4e1247\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"
Sep 10 22:17:52.535534 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:52.535508    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2726b582-54e3-4f92-96c3-3d76ab4e1247-metrics-certs\") pod \"maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt\" (UID: \"2726b582-54e3-4f92-96c3-3d76ab4e1247\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"
Sep 10 22:17:52.541083 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:52.541061    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkqxk\" (UniqueName: \"kubernetes.io/projected/2726b582-54e3-4f92-96c3-3d76ab4e1247-kube-api-access-mkqxk\") pod \"maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt\" (UID: \"2726b582-54e3-4f92-96c3-3d76ab4e1247\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"
Sep 10 22:17:53.041056 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:53.041025    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2726b582-54e3-4f92-96c3-3d76ab4e1247-maas-api-tls\") pod \"maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt\" (UID: \"2726b582-54e3-4f92-96c3-3d76ab4e1247\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"
Sep 10 22:17:53.043875 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:53.043844    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2726b582-54e3-4f92-96c3-3d76ab4e1247-maas-api-tls\") pod \"maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt\" (UID: \"2726b582-54e3-4f92-96c3-3d76ab4e1247\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"
Sep 10 22:17:53.248730 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:53.248668    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"
Sep 10 22:17:53.532065 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:53.532041    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"]
Sep 10 22:17:53.534190 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:17:53.534164    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2726b582_54e3_4f92_96c3_3d76ab4e1247.slice/crio-c54289cd8ea2b16841cc91a13c36a4d87faf84dd08cbc86d3271da1d00cdd8ae WatchSource:0}: Error finding container c54289cd8ea2b16841cc91a13c36a4d87faf84dd08cbc86d3271da1d00cdd8ae: Status 404 returned error can't find the container with id c54289cd8ea2b16841cc91a13c36a4d87faf84dd08cbc86d3271da1d00cdd8ae
Sep 10 22:17:53.535748 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:53.535725    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 22:17:54.275895 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:54.275803    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt" event={"ID":"2726b582-54e3-4f92-96c3-3d76ab4e1247","Type":"ContainerStarted","Data":"eb5bd12268389735f25e69fea27610840cb47a11655570b6c8edadd8151af1a9"}
Sep 10 22:17:54.275895 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:54.275852    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt" event={"ID":"2726b582-54e3-4f92-96c3-3d76ab4e1247","Type":"ContainerStarted","Data":"c54289cd8ea2b16841cc91a13c36a4d87faf84dd08cbc86d3271da1d00cdd8ae"}
Sep 10 22:17:54.276092 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:54.275896    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"
Sep 10 22:17:54.313746 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:54.313698    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt" podStartSLOduration=1.863719683 podStartE2EDuration="2.313680574s" totalImagesPullingTime="449.960891ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:17:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:17:54.309988548 +0000 UTC m=+978.982086468" watchObservedRunningTime="2026-09-10 22:17:54.313680574 +0000 UTC m=+978.985778495"
Sep 10 22:17:55.065851 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:17:55.065815    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:18:00.286948 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:00.286873    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"
Sep 10 22:18:06.177997 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:06.177954    2577 patch_prober.go:28] interesting pod/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": read tcp 10.134.0.2:38988->10.134.0.69:15021: read: connection reset by peer" start-of-body=
Sep 10 22:18:06.178479 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:06.178029    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc" podUID="8ba6cbf0-4ca2-483b-b743-2f2d776651bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": read tcp 10.134.0.2:38988->10.134.0.69:15021: read: connection reset by peer"
Sep 10 22:18:06.365488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:06.365399    2577 generic.go:356] "Generic (PLEG): container finished" podID="8ba6cbf0-4ca2-483b-b743-2f2d776651bb" containerID="0485a463fd757e206e348e062be568884fbf852d1db5c44124b9887fbcfd5fca" exitCode=0
Sep 10 22:18:06.365488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:06.365468    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc" event={"ID":"8ba6cbf0-4ca2-483b-b743-2f2d776651bb","Type":"ContainerDied","Data":"0485a463fd757e206e348e062be568884fbf852d1db5c44124b9887fbcfd5fca"}
Sep 10 22:18:06.365919 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:06.365905    2577 scope.go:117] "RemoveContainer" containerID="0485a463fd757e206e348e062be568884fbf852d1db5c44124b9887fbcfd5fca"
Sep 10 22:18:06.367044 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:06.367014    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:18:06.367159 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:06.367099    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:18:06.367159 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:06.367148    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:18:07.374146 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:07.374115    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc" event={"ID":"8ba6cbf0-4ca2-483b-b743-2f2d776651bb","Type":"ContainerStarted","Data":"ccc16bb3e21e85743f91f53dcba2a0662c8e4ad6dcf3fe4b86fcfcda035f702c"}
Sep 10 22:18:08.157638 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:08.157604    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:18:08.158027 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:08.157988    2577 patch_prober.go:28] interesting pod/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 10 22:18:08.158224 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:08.158187    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc" podUID="8ba6cbf0-4ca2-483b-b743-2f2d776651bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 10 22:18:09.157228 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:09.157187    2577 patch_prober.go:28] interesting pod/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 10 22:18:09.157940 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:09.157889    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc" podUID="8ba6cbf0-4ca2-483b-b743-2f2d776651bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 10 22:18:09.571984 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:09.571902    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:18:10.157714 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:10.157670    2577 patch_prober.go:28] interesting pod/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 10 22:18:10.158256 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:10.157743    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc" podUID="8ba6cbf0-4ca2-483b-b743-2f2d776651bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 10 22:18:11.158023 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:11.157984    2577 patch_prober.go:28] interesting pod/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 10 22:18:11.158421 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:11.158057    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc" podUID="8ba6cbf0-4ca2-483b-b743-2f2d776651bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 10 22:18:12.157953 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:12.157907    2577 patch_prober.go:28] interesting pod/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 10 22:18:12.158144 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:12.157981    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc" podUID="8ba6cbf0-4ca2-483b-b743-2f2d776651bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 10 22:18:13.161548 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:13.161516    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:18:13.162026 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:13.162003    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:18:13.162647 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:13.162628    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:18:23.160755 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:23.160715    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:18:36.567100 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:36.567066    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:18:49.757342 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:49.757302    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:18:56.534793 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:56.534737    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"]
Sep 10 22:18:56.535651 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:56.535593    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt" podUID="2726b582-54e3-4f92-96c3-3d76ab4e1247" containerName="maas-api" containerID="cri-o://eb5bd12268389735f25e69fea27610840cb47a11655570b6c8edadd8151af1a9" gracePeriod=30
Sep 10 22:18:56.677267 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:56.677230    2577 generic.go:356] "Generic (PLEG): container finished" podID="2726b582-54e3-4f92-96c3-3d76ab4e1247" containerID="eb5bd12268389735f25e69fea27610840cb47a11655570b6c8edadd8151af1a9" exitCode=0
Sep 10 22:18:56.677438 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:56.677308    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt" event={"ID":"2726b582-54e3-4f92-96c3-3d76ab4e1247","Type":"ContainerDied","Data":"eb5bd12268389735f25e69fea27610840cb47a11655570b6c8edadd8151af1a9"}
Sep 10 22:18:56.792154 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:56.792096    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"
Sep 10 22:18:56.879482 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:56.879450    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2726b582-54e3-4f92-96c3-3d76ab4e1247-openshift-service-ca\") pod \"2726b582-54e3-4f92-96c3-3d76ab4e1247\" (UID: \"2726b582-54e3-4f92-96c3-3d76ab4e1247\") "
Sep 10 22:18:56.879674 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:56.879503    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2726b582-54e3-4f92-96c3-3d76ab4e1247-maas-api-tls\") pod \"2726b582-54e3-4f92-96c3-3d76ab4e1247\" (UID: \"2726b582-54e3-4f92-96c3-3d76ab4e1247\") "
Sep 10 22:18:56.879674 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:56.879543    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkqxk\" (UniqueName: \"kubernetes.io/projected/2726b582-54e3-4f92-96c3-3d76ab4e1247-kube-api-access-mkqxk\") pod \"2726b582-54e3-4f92-96c3-3d76ab4e1247\" (UID: \"2726b582-54e3-4f92-96c3-3d76ab4e1247\") "
Sep 10 22:18:56.879674 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:56.879594    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2726b582-54e3-4f92-96c3-3d76ab4e1247-metrics-certs\") pod \"2726b582-54e3-4f92-96c3-3d76ab4e1247\" (UID: \"2726b582-54e3-4f92-96c3-3d76ab4e1247\") "
Sep 10 22:18:56.879903 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:56.879874    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2726b582-54e3-4f92-96c3-3d76ab4e1247-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2726b582-54e3-4f92-96c3-3d76ab4e1247" (UID: "2726b582-54e3-4f92-96c3-3d76ab4e1247"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:18:56.880026 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:56.880003    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2726b582-54e3-4f92-96c3-3d76ab4e1247-openshift-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:18:56.881914 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:56.881878    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2726b582-54e3-4f92-96c3-3d76ab4e1247-kube-api-access-mkqxk" (OuterVolumeSpecName: "kube-api-access-mkqxk") pod "2726b582-54e3-4f92-96c3-3d76ab4e1247" (UID: "2726b582-54e3-4f92-96c3-3d76ab4e1247"). InnerVolumeSpecName "kube-api-access-mkqxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:18:56.882045 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:56.881936    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2726b582-54e3-4f92-96c3-3d76ab4e1247-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2726b582-54e3-4f92-96c3-3d76ab4e1247" (UID: "2726b582-54e3-4f92-96c3-3d76ab4e1247"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:18:56.882045 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:56.881975    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2726b582-54e3-4f92-96c3-3d76ab4e1247-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2726b582-54e3-4f92-96c3-3d76ab4e1247" (UID: "2726b582-54e3-4f92-96c3-3d76ab4e1247"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:18:56.981401 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:56.981373    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2726b582-54e3-4f92-96c3-3d76ab4e1247-metrics-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:18:56.981401 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:56.981396    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2726b582-54e3-4f92-96c3-3d76ab4e1247-maas-api-tls\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:18:56.981401 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:56.981405    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkqxk\" (UniqueName: \"kubernetes.io/projected/2726b582-54e3-4f92-96c3-3d76ab4e1247-kube-api-access-mkqxk\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:18:57.685906 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:57.685872    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt" event={"ID":"2726b582-54e3-4f92-96c3-3d76ab4e1247","Type":"ContainerDied","Data":"c54289cd8ea2b16841cc91a13c36a4d87faf84dd08cbc86d3271da1d00cdd8ae"}
Sep 10 22:18:57.685906 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:57.685890    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"
Sep 10 22:18:57.686379 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:57.685935    2577 scope.go:117] "RemoveContainer" containerID="eb5bd12268389735f25e69fea27610840cb47a11655570b6c8edadd8151af1a9"
Sep 10 22:18:57.708947 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:57.708918    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"]
Sep 10 22:18:57.713373 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:57.713346    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-8f9fc7-5488d6d9f5-7x9rt"]
Sep 10 22:18:57.848491 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:18:57.848461    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2726b582-54e3-4f92-96c3-3d76ab4e1247" path="/var/lib/kubelet/pods/2726b582-54e3-4f92-96c3-3d76ab4e1247/volumes"
Sep 10 22:19:03.968392 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:03.968359    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"]
Sep 10 22:19:03.968771 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:03.968584    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc" podUID="8ba6cbf0-4ca2-483b-b743-2f2d776651bb" containerName="istio-proxy" containerID="cri-o://ccc16bb3e21e85743f91f53dcba2a0662c8e4ad6dcf3fe4b86fcfcda035f702c" gracePeriod=30
Sep 10 22:19:08.956098 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:08.956064    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:19:09.230318 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.230289    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:19:09.293567 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.293534    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-workload-socket\") pod \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") "
Sep 10 22:19:09.293567 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.293566    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-workload-certs\") pod \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") "
Sep 10 22:19:09.293826 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.293611    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istiod-ca-cert\") pod \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") "
Sep 10 22:19:09.293826 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.293632    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-credential-socket\") pod \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") "
Sep 10 22:19:09.293826 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.293663    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gt9w\" (UniqueName: \"kubernetes.io/projected/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-kube-api-access-5gt9w\") pod \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") "
Sep 10 22:19:09.293826 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.293692    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-envoy\") pod \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") "
Sep 10 22:19:09.293826 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.293739    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-data\") pod \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") "
Sep 10 22:19:09.293826 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.293767    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-token\") pod \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") "
Sep 10 22:19:09.294139 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.293877    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8ba6cbf0-4ca2-483b-b743-2f2d776651bb" (UID: "8ba6cbf0-4ca2-483b-b743-2f2d776651bb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:19:09.294139 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.293969    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-podinfo\") pod \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\" (UID: \"8ba6cbf0-4ca2-483b-b743-2f2d776651bb\") "
Sep 10 22:19:09.294139 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.293980    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8ba6cbf0-4ca2-483b-b743-2f2d776651bb" (UID: "8ba6cbf0-4ca2-483b-b743-2f2d776651bb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:19:09.294139 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.294007    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8ba6cbf0-4ca2-483b-b743-2f2d776651bb" (UID: "8ba6cbf0-4ca2-483b-b743-2f2d776651bb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:19:09.294363 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.294180    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8ba6cbf0-4ca2-483b-b743-2f2d776651bb" (UID: "8ba6cbf0-4ca2-483b-b743-2f2d776651bb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:19:09.294363 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.294251    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-workload-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:19:09.294363 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.294265    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-workload-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:19:09.294363 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.294278    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istiod-ca-cert\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:19:09.294363 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.294291    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-credential-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:19:09.294363 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.294309    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-data" (OuterVolumeSpecName: "istio-data") pod "8ba6cbf0-4ca2-483b-b743-2f2d776651bb" (UID: "8ba6cbf0-4ca2-483b-b743-2f2d776651bb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:19:09.296204 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.296178    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-kube-api-access-5gt9w" (OuterVolumeSpecName: "kube-api-access-5gt9w") pod "8ba6cbf0-4ca2-483b-b743-2f2d776651bb" (UID: "8ba6cbf0-4ca2-483b-b743-2f2d776651bb"). InnerVolumeSpecName "kube-api-access-5gt9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:19:09.296347 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.296240    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8ba6cbf0-4ca2-483b-b743-2f2d776651bb" (UID: "8ba6cbf0-4ca2-483b-b743-2f2d776651bb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:19:09.296596 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.296573    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8ba6cbf0-4ca2-483b-b743-2f2d776651bb" (UID: "8ba6cbf0-4ca2-483b-b743-2f2d776651bb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:19:09.296668 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.296580    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-token" (OuterVolumeSpecName: "istio-token") pod "8ba6cbf0-4ca2-483b-b743-2f2d776651bb" (UID: "8ba6cbf0-4ca2-483b-b743-2f2d776651bb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:19:09.395455 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.395424    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-podinfo\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:19:09.395455 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.395451    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gt9w\" (UniqueName: \"kubernetes.io/projected/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-kube-api-access-5gt9w\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:19:09.395455 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.395461    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-envoy\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:19:09.395684 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.395469    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-data\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:19:09.395684 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.395477    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ba6cbf0-4ca2-483b-b743-2f2d776651bb-istio-token\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:19:09.772393 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.772360    2577 generic.go:356] "Generic (PLEG): container finished" podID="8ba6cbf0-4ca2-483b-b743-2f2d776651bb" containerID="ccc16bb3e21e85743f91f53dcba2a0662c8e4ad6dcf3fe4b86fcfcda035f702c" exitCode=0
Sep 10 22:19:09.772567 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.772407    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"
Sep 10 22:19:09.772567 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.772441    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc" event={"ID":"8ba6cbf0-4ca2-483b-b743-2f2d776651bb","Type":"ContainerDied","Data":"ccc16bb3e21e85743f91f53dcba2a0662c8e4ad6dcf3fe4b86fcfcda035f702c"}
Sep 10 22:19:09.772567 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.772490    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc" event={"ID":"8ba6cbf0-4ca2-483b-b743-2f2d776651bb","Type":"ContainerDied","Data":"2972505a73f6e92d8fad1ea705eea52d58dd72290a8b6bafbcbf81bc9afd67ef"}
Sep 10 22:19:09.772567 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.772510    2577 scope.go:117] "RemoveContainer" containerID="ccc16bb3e21e85743f91f53dcba2a0662c8e4ad6dcf3fe4b86fcfcda035f702c"
Sep 10 22:19:09.783531 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.783493    2577 scope.go:117] "RemoveContainer" containerID="0485a463fd757e206e348e062be568884fbf852d1db5c44124b9887fbcfd5fca"
Sep 10 22:19:09.792588 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.792569    2577 scope.go:117] "RemoveContainer" containerID="ccc16bb3e21e85743f91f53dcba2a0662c8e4ad6dcf3fe4b86fcfcda035f702c"
Sep 10 22:19:09.792954 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:19:09.792926    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccc16bb3e21e85743f91f53dcba2a0662c8e4ad6dcf3fe4b86fcfcda035f702c\": container with ID starting with ccc16bb3e21e85743f91f53dcba2a0662c8e4ad6dcf3fe4b86fcfcda035f702c not found: ID does not exist" containerID="ccc16bb3e21e85743f91f53dcba2a0662c8e4ad6dcf3fe4b86fcfcda035f702c"
Sep 10 22:19:09.793022 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.792969    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccc16bb3e21e85743f91f53dcba2a0662c8e4ad6dcf3fe4b86fcfcda035f702c"} err="failed to get container status \"ccc16bb3e21e85743f91f53dcba2a0662c8e4ad6dcf3fe4b86fcfcda035f702c\": rpc error: code = NotFound desc = could not find container \"ccc16bb3e21e85743f91f53dcba2a0662c8e4ad6dcf3fe4b86fcfcda035f702c\": container with ID starting with ccc16bb3e21e85743f91f53dcba2a0662c8e4ad6dcf3fe4b86fcfcda035f702c not found: ID does not exist"
Sep 10 22:19:09.793022 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.792995    2577 scope.go:117] "RemoveContainer" containerID="0485a463fd757e206e348e062be568884fbf852d1db5c44124b9887fbcfd5fca"
Sep 10 22:19:09.793339 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:19:09.793308    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0485a463fd757e206e348e062be568884fbf852d1db5c44124b9887fbcfd5fca\": container with ID starting with 0485a463fd757e206e348e062be568884fbf852d1db5c44124b9887fbcfd5fca not found: ID does not exist" containerID="0485a463fd757e206e348e062be568884fbf852d1db5c44124b9887fbcfd5fca"
Sep 10 22:19:09.793434 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.793348    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0485a463fd757e206e348e062be568884fbf852d1db5c44124b9887fbcfd5fca"} err="failed to get container status \"0485a463fd757e206e348e062be568884fbf852d1db5c44124b9887fbcfd5fca\": rpc error: code = NotFound desc = could not find container \"0485a463fd757e206e348e062be568884fbf852d1db5c44124b9887fbcfd5fca\": container with ID starting with 0485a463fd757e206e348e062be568884fbf852d1db5c44124b9887fbcfd5fca not found: ID does not exist"
Sep 10 22:19:09.794523 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.794502    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"]
Sep 10 22:19:09.800256 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.800231    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-8f9fc7-openshift-default-664f4b59cb-b8wjc"]
Sep 10 22:19:09.849140 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:09.849116    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ba6cbf0-4ca2-483b-b743-2f2d776651bb" path="/var/lib/kubelet/pods/8ba6cbf0-4ca2-483b-b743-2f2d776651bb/volumes"
Sep 10 22:19:10.964703 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:10.964657    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"]
Sep 10 22:19:10.966029 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:10.966000    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ba6cbf0-4ca2-483b-b743-2f2d776651bb" containerName="istio-proxy"
Sep 10 22:19:10.966029 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:10.966025    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ba6cbf0-4ca2-483b-b743-2f2d776651bb" containerName="istio-proxy"
Sep 10 22:19:10.966247 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:10.966037    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ba6cbf0-4ca2-483b-b743-2f2d776651bb" containerName="istio-proxy"
Sep 10 22:19:10.966247 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:10.966045    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ba6cbf0-4ca2-483b-b743-2f2d776651bb" containerName="istio-proxy"
Sep 10 22:19:10.966247 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:10.966055    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2726b582-54e3-4f92-96c3-3d76ab4e1247" containerName="maas-api"
Sep 10 22:19:10.966247 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:10.966063    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2726b582-54e3-4f92-96c3-3d76ab4e1247" containerName="maas-api"
Sep 10 22:19:10.966247 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:10.966210    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ba6cbf0-4ca2-483b-b743-2f2d776651bb" containerName="istio-proxy"
Sep 10 22:19:10.966247 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:10.966224    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2726b582-54e3-4f92-96c3-3d76ab4e1247" containerName="maas-api"
Sep 10 22:19:10.971191 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:10.971168    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:10.973415 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:10.973388    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d98bb58d-openshift-default-dockercfg-kndfw\""
Sep 10 22:19:10.985610 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:10.985583    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"]
Sep 10 22:19:11.009257 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.009196    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-token\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.009257 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.009237    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istiod-ca-cert\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.009488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.009287    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-envoy\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.009488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.009320    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-data\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.009488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.009344    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-podinfo\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.009488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.009384    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2dvp\" (UniqueName: \"kubernetes.io/projected/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-kube-api-access-p2dvp\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.009488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.009407    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-credential-socket\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.009941 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.009558    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-workload-socket\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.009941 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.009603    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-workload-certs\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.110121 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.110088    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-envoy\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.110337 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.110130    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-data\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.110337 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.110157    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-podinfo\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.110337 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.110207    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2dvp\" (UniqueName: \"kubernetes.io/projected/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-kube-api-access-p2dvp\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.110337 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.110231    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-credential-socket\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.110337 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.110288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-workload-socket\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.110337 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.110324    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-workload-certs\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.110653 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.110385    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-token\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.110653 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.110410    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istiod-ca-cert\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.110653 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.110555    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-data\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.110832 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.110664    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-workload-socket\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.110940 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.110904    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-workload-certs\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.111024 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.110993    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-credential-socket\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.111327 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.111305    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istiod-ca-cert\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.112635 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.112616    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-envoy\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.112895 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.112878    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-podinfo\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.119092 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.119068    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-token\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.119218 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.119136    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2dvp\" (UniqueName: \"kubernetes.io/projected/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-kube-api-access-p2dvp\") pod \"e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") " pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.282788 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.282683    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:11.567811 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.567767    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"]
Sep 10 22:19:11.569453 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:19:11.569426    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8dcf3bc_8c9f_4662_9d50_37ef45f7f82d.slice/crio-47ac5f82d1b52c61bf292129e91dcdb69dc79adc72808c7e0e2f27b0e91a0efd WatchSource:0}: Error finding container 47ac5f82d1b52c61bf292129e91dcdb69dc79adc72808c7e0e2f27b0e91a0efd: Status 404 returned error can't find the container with id 47ac5f82d1b52c61bf292129e91dcdb69dc79adc72808c7e0e2f27b0e91a0efd
Sep 10 22:19:11.571599 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.571556    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:19:11.571687 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.571620    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:19:11.571687 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.571651    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:19:11.793080 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.793039    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9" event={"ID":"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d","Type":"ContainerStarted","Data":"b628174192381d50506fc968bf80901eacdb33f4464a096033a0355b386855d4"}
Sep 10 22:19:11.793285 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.793100    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9" event={"ID":"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d","Type":"ContainerStarted","Data":"47ac5f82d1b52c61bf292129e91dcdb69dc79adc72808c7e0e2f27b0e91a0efd"}
Sep 10 22:19:11.820669 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:11.820556    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9" podStartSLOduration=1.820538236 podStartE2EDuration="1.820538236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:19:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:11.818376557 +0000 UTC m=+1056.490474479" watchObservedRunningTime="2026-09-10 22:19:11.820538236 +0000 UTC m=+1056.492636159"
Sep 10 22:19:12.283282 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:12.283243    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:12.288481 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:12.288454    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:12.799613 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:12.799580    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:12.800552 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:12.800534    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:26.462725 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:26.462684    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:19:28.153724 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:28.153690    2577 patch_prober.go:28] interesting pod/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": read tcp 10.134.0.2:44022->10.134.0.71:15021: read: connection reset by peer" start-of-body=
Sep 10 22:19:28.154146 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:28.153771    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9" podUID="d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": read tcp 10.134.0.2:44022->10.134.0.71:15021: read: connection reset by peer"
Sep 10 22:19:28.911312 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:28.911279    2577 generic.go:356] "Generic (PLEG): container finished" podID="d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" containerID="b628174192381d50506fc968bf80901eacdb33f4464a096033a0355b386855d4" exitCode=0
Sep 10 22:19:28.911489 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:28.911344    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9" event={"ID":"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d","Type":"ContainerDied","Data":"b628174192381d50506fc968bf80901eacdb33f4464a096033a0355b386855d4"}
Sep 10 22:19:28.911752 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:28.911738    2577 scope.go:117] "RemoveContainer" containerID="b628174192381d50506fc968bf80901eacdb33f4464a096033a0355b386855d4"
Sep 10 22:19:28.912873 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:28.912842    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:19:28.912943 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:28.912913    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:19:28.912987 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:28.912944    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:19:29.920015 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:29.919975    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9" event={"ID":"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d","Type":"ContainerStarted","Data":"2943c4be6495816b885efa785486282cd5d53df61b0a65524386d64baf759ee6"}
Sep 10 22:19:30.283264 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:30.283178    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:30.283418 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:30.283382    2577 patch_prober.go:28] interesting pod/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 10 22:19:30.283468 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:30.283438    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9" podUID="d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 10 22:19:31.283610 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:31.283569    2577 patch_prober.go:28] interesting pod/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 10 22:19:31.284044 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:31.283656    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9" podUID="d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 10 22:19:32.283840 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:32.283802    2577 patch_prober.go:28] interesting pod/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 10 22:19:32.284225 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:32.283876    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9" podUID="d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 10 22:19:33.283673 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:33.283641    2577 patch_prober.go:28] interesting pod/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 10 22:19:33.283875 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:33.283725    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9" podUID="d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 10 22:19:34.283875 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:34.283834    2577 patch_prober.go:28] interesting pod/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 10 22:19:34.284288 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:34.283893    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9" podUID="d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 10 22:19:35.286835 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:35.286802    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:35.287255 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:35.287214    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:35.287924 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:35.287903    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:19:40.954604 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:40.954571    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:19:46.099356 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:46.099324    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e5a2d7-lj77r"]
Sep 10 22:19:46.099842 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:46.099828    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ba6cbf0-4ca2-483b-b743-2f2d776651bb" containerName="istio-proxy"
Sep 10 22:19:46.104253 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:46.104234    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e5a2d7-lj77r"
Sep 10 22:19:46.106639 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:46.106617    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8hjrv\""
Sep 10 22:19:46.110588 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:46.110561    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e5a2d7-lj77r"]
Sep 10 22:19:46.159724 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:46.159687    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6543825c-32b2-4659-9483-5f2d9ea73d3c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e5a2d7-lj77r\" (UID: \"6543825c-32b2-4659-9483-5f2d9ea73d3c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e5a2d7-lj77r"
Sep 10 22:19:46.260674 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:46.260643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6543825c-32b2-4659-9483-5f2d9ea73d3c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e5a2d7-lj77r\" (UID: \"6543825c-32b2-4659-9483-5f2d9ea73d3c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e5a2d7-lj77r"
Sep 10 22:19:46.261283 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:46.261265    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6543825c-32b2-4659-9483-5f2d9ea73d3c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e5a2d7-lj77r\" (UID: \"6543825c-32b2-4659-9483-5f2d9ea73d3c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e5a2d7-lj77r"
Sep 10 22:19:46.416195 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:46.416138    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e5a2d7-lj77r"
Sep 10 22:19:46.488177 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:46.488127    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d98bb58d-xfmgb"]
Sep 10 22:19:46.505552 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:46.505525    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d98bb58d-xfmgb"]
Sep 10 22:19:46.505873 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:46.505850    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d98bb58d-xfmgb"
Sep 10 22:19:46.564497 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:46.564457    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e369bae3-e71f-4d64-9fbd-d63cdd39d1d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d98bb58d-xfmgb\" (UID: \"e369bae3-e71f-4d64-9fbd-d63cdd39d1d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d98bb58d-xfmgb"
Sep 10 22:19:46.665273 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:46.665231    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e369bae3-e71f-4d64-9fbd-d63cdd39d1d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d98bb58d-xfmgb\" (UID: \"e369bae3-e71f-4d64-9fbd-d63cdd39d1d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d98bb58d-xfmgb"
Sep 10 22:19:46.665895 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:46.665873    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e369bae3-e71f-4d64-9fbd-d63cdd39d1d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d98bb58d-xfmgb\" (UID: \"e369bae3-e71f-4d64-9fbd-d63cdd39d1d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d98bb58d-xfmgb"
Sep 10 22:19:46.700177 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:46.700151    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e5a2d7-lj77r"]
Sep 10 22:19:46.702032 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:19:46.701997    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6543825c_32b2_4659_9483_5f2d9ea73d3c.slice/crio-b13385999387887de5154c42065f9cba6fd33f4a02d9fa1f0462c79f3b5686e1 WatchSource:0}: Error finding container b13385999387887de5154c42065f9cba6fd33f4a02d9fa1f0462c79f3b5686e1: Status 404 returned error can't find the container with id b13385999387887de5154c42065f9cba6fd33f4a02d9fa1f0462c79f3b5686e1
Sep 10 22:19:46.817962 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:46.817927    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d98bb58d-xfmgb"
Sep 10 22:19:47.036965 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:47.036920    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e5a2d7-lj77r" event={"ID":"6543825c-32b2-4659-9483-5f2d9ea73d3c","Type":"ContainerStarted","Data":"b13385999387887de5154c42065f9cba6fd33f4a02d9fa1f0462c79f3b5686e1"}
Sep 10 22:19:47.101683 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:47.101658    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d98bb58d-xfmgb"]
Sep 10 22:19:47.103289 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:19:47.103250    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode369bae3_e71f_4d64_9fbd_d63cdd39d1d3.slice/crio-35283c9d35452a7331d7798f6dbcde3d5810649a5e096ad2aeba5b87f4241385 WatchSource:0}: Error finding container 35283c9d35452a7331d7798f6dbcde3d5810649a5e096ad2aeba5b87f4241385: Status 404 returned error can't find the container with id 35283c9d35452a7331d7798f6dbcde3d5810649a5e096ad2aeba5b87f4241385
Sep 10 22:19:48.045157 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:48.045063    2577 generic.go:356] "Generic (PLEG): container finished" podID="6543825c-32b2-4659-9483-5f2d9ea73d3c" containerID="d8ebf261c87e6fcc6f7bf64e52937abd659097b7de68b3275d2e48b477742c1d" exitCode=0
Sep 10 22:19:48.045334 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:48.045160    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e5a2d7-lj77r" event={"ID":"6543825c-32b2-4659-9483-5f2d9ea73d3c","Type":"ContainerDied","Data":"d8ebf261c87e6fcc6f7bf64e52937abd659097b7de68b3275d2e48b477742c1d"}
Sep 10 22:19:48.046645 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:48.046619    2577 generic.go:356] "Generic (PLEG): container finished" podID="e369bae3-e71f-4d64-9fbd-d63cdd39d1d3" containerID="8edfaa148b1284e3a1c418f93eaea8ab3e3befd0e2ceb14d33dccbcbacbedfa0" exitCode=0
Sep 10 22:19:48.046742 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:48.046698    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d98bb58d-xfmgb" event={"ID":"e369bae3-e71f-4d64-9fbd-d63cdd39d1d3","Type":"ContainerDied","Data":"8edfaa148b1284e3a1c418f93eaea8ab3e3befd0e2ceb14d33dccbcbacbedfa0"}
Sep 10 22:19:48.046797 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:48.046744    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d98bb58d-xfmgb" event={"ID":"e369bae3-e71f-4d64-9fbd-d63cdd39d1d3","Type":"ContainerStarted","Data":"35283c9d35452a7331d7798f6dbcde3d5810649a5e096ad2aeba5b87f4241385"}
Sep 10 22:19:49.183587 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:49.183564    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e5a2d7-lj77r"
Sep 10 22:19:49.216613 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:49.216587    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d98bb58d-xfmgb"
Sep 10 22:19:49.293429 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:49.293393    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6543825c-32b2-4659-9483-5f2d9ea73d3c-maas-api-service-ca\") pod \"6543825c-32b2-4659-9483-5f2d9ea73d3c\" (UID: \"6543825c-32b2-4659-9483-5f2d9ea73d3c\") "
Sep 10 22:19:49.293579 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:49.293506    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e369bae3-e71f-4d64-9fbd-d63cdd39d1d3-maas-api-service-ca\") pod \"e369bae3-e71f-4d64-9fbd-d63cdd39d1d3\" (UID: \"e369bae3-e71f-4d64-9fbd-d63cdd39d1d3\") "
Sep 10 22:19:49.293878 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:49.293853    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6543825c-32b2-4659-9483-5f2d9ea73d3c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6543825c-32b2-4659-9483-5f2d9ea73d3c" (UID: "6543825c-32b2-4659-9483-5f2d9ea73d3c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:19:49.293933 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:49.293859    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e369bae3-e71f-4d64-9fbd-d63cdd39d1d3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e369bae3-e71f-4d64-9fbd-d63cdd39d1d3" (UID: "e369bae3-e71f-4d64-9fbd-d63cdd39d1d3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:19:49.395136 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:49.395107    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6543825c-32b2-4659-9483-5f2d9ea73d3c-maas-api-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:19:49.395136 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:49.395133    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e369bae3-e71f-4d64-9fbd-d63cdd39d1d3-maas-api-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:19:50.060646 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:50.060613    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e5a2d7-lj77r"
Sep 10 22:19:50.060646 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:50.060641    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e5a2d7-lj77r" event={"ID":"6543825c-32b2-4659-9483-5f2d9ea73d3c","Type":"ContainerDied","Data":"b13385999387887de5154c42065f9cba6fd33f4a02d9fa1f0462c79f3b5686e1"}
Sep 10 22:19:50.060901 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:50.060691    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b13385999387887de5154c42065f9cba6fd33f4a02d9fa1f0462c79f3b5686e1"
Sep 10 22:19:50.062300 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:50.062279    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d98bb58d-xfmgb"
Sep 10 22:19:50.062300 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:50.062286    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d98bb58d-xfmgb" event={"ID":"e369bae3-e71f-4d64-9fbd-d63cdd39d1d3","Type":"ContainerDied","Data":"35283c9d35452a7331d7798f6dbcde3d5810649a5e096ad2aeba5b87f4241385"}
Sep 10 22:19:50.062504 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:50.062320    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35283c9d35452a7331d7798f6dbcde3d5810649a5e096ad2aeba5b87f4241385"
Sep 10 22:19:54.860874 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:54.860835    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:19:56.925064 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:56.925021    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d98bb58d-xfmgb"]
Sep 10 22:19:56.929012 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:56.928983    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d98bb58d-xfmgb"]
Sep 10 22:19:57.102383 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:57.102346    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e5a2d7-lj77r"]
Sep 10 22:19:57.107907 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:57.107882    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e5a2d7-lj77r"]
Sep 10 22:19:57.848965 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:57.848935    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6543825c-32b2-4659-9483-5f2d9ea73d3c" path="/var/lib/kubelet/pods/6543825c-32b2-4659-9483-5f2d9ea73d3c/volumes"
Sep 10 22:19:57.849257 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:19:57.849244    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e369bae3-e71f-4d64-9fbd-d63cdd39d1d3" path="/var/lib/kubelet/pods/e369bae3-e71f-4d64-9fbd-d63cdd39d1d3/volumes"
Sep 10 22:20:03.772158 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:03.772121    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"]
Sep 10 22:20:03.772635 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:03.772363    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9" podUID="d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" containerName="istio-proxy" containerID="cri-o://2943c4be6495816b885efa785486282cd5d53df61b0a65524386d64baf759ee6" gracePeriod=30
Sep 10 22:20:03.976248 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:03.976211    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"]
Sep 10 22:20:03.976482 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:03.976443    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r" podUID="36c89b81-ed84-445d-8fe3-acdf2077a846" containerName="istio-proxy" containerID="cri-o://9a9539559ae3bd7a0535eb85015fcc89fe47c564b0298fb6a83ea6c0c40c2586" gracePeriod=30
Sep 10 22:20:04.379070 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:04.379027    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1c252b-q7m28"]
Sep 10 22:20:04.379459 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:04.379446    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6543825c-32b2-4659-9483-5f2d9ea73d3c" containerName="revoke-keys"
Sep 10 22:20:04.379521 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:04.379461    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6543825c-32b2-4659-9483-5f2d9ea73d3c" containerName="revoke-keys"
Sep 10 22:20:04.379521 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:04.379471    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e369bae3-e71f-4d64-9fbd-d63cdd39d1d3" containerName="revoke-keys"
Sep 10 22:20:04.379521 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:04.379477    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e369bae3-e71f-4d64-9fbd-d63cdd39d1d3" containerName="revoke-keys"
Sep 10 22:20:04.379625 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:04.379541    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6543825c-32b2-4659-9483-5f2d9ea73d3c" containerName="revoke-keys"
Sep 10 22:20:04.379625 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:04.379550    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e369bae3-e71f-4d64-9fbd-d63cdd39d1d3" containerName="revoke-keys"
Sep 10 22:20:04.381594 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:04.381574    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1c252b-q7m28"
Sep 10 22:20:04.389454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:04.389435    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8hjrv\""
Sep 10 22:20:04.406724 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:04.406691    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1c252b-q7m28"]
Sep 10 22:20:04.549348 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:04.549306    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d418e0ac-8d00-4f28-95a2-735cbcfe926e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1c252b-q7m28\" (UID: \"d418e0ac-8d00-4f28-95a2-735cbcfe926e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1c252b-q7m28"
Sep 10 22:20:04.649985 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:04.649951    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d418e0ac-8d00-4f28-95a2-735cbcfe926e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1c252b-q7m28\" (UID: \"d418e0ac-8d00-4f28-95a2-735cbcfe926e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1c252b-q7m28"
Sep 10 22:20:04.650542 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:04.650524    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d418e0ac-8d00-4f28-95a2-735cbcfe926e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1c252b-q7m28\" (UID: \"d418e0ac-8d00-4f28-95a2-735cbcfe926e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1c252b-q7m28"
Sep 10 22:20:04.691760 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:04.691731    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1c252b-q7m28"
Sep 10 22:20:04.967301 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:04.967269    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1c252b-q7m28"]
Sep 10 22:20:04.969504 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:20:04.969473    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd418e0ac_8d00_4f28_95a2_735cbcfe926e.slice/crio-1e9a7ad7506cda6168eabaf9d2f8f4c2894ab560f825388d9b633314a854e033 WatchSource:0}: Error finding container 1e9a7ad7506cda6168eabaf9d2f8f4c2894ab560f825388d9b633314a854e033: Status 404 returned error can't find the container with id 1e9a7ad7506cda6168eabaf9d2f8f4c2894ab560f825388d9b633314a854e033
Sep 10 22:20:05.156091 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:05.156044    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1c252b-q7m28" event={"ID":"d418e0ac-8d00-4f28-95a2-735cbcfe926e","Type":"ContainerStarted","Data":"1e9a7ad7506cda6168eabaf9d2f8f4c2894ab560f825388d9b633314a854e033"}
Sep 10 22:20:05.289258 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:05.289223    2577 patch_prober.go:28] interesting pod/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 22:20:05.289413 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:05.289276    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9" podUID="d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 22:20:06.163588 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:06.163552    2577 generic.go:356] "Generic (PLEG): container finished" podID="d418e0ac-8d00-4f28-95a2-735cbcfe926e" containerID="d8354d77a5d5de8a3f26d19d83f1e22a2c1483a331b06b8ba608821ca4771d2b" exitCode=0
Sep 10 22:20:06.164062 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:06.163638    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1c252b-q7m28" event={"ID":"d418e0ac-8d00-4f28-95a2-735cbcfe926e","Type":"ContainerDied","Data":"d8354d77a5d5de8a3f26d19d83f1e22a2c1483a331b06b8ba608821ca4771d2b"}
Sep 10 22:20:06.456643 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:06.456541    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:20:07.307616 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:07.307584    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1c252b-q7m28"
Sep 10 22:20:07.407569 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:07.407534    2577 patch_prober.go:28] interesting pod/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 22:20:07.407735 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:07.407585    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r" podUID="36c89b81-ed84-445d-8fe3-acdf2077a846" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 22:20:07.475936 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:07.475839    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d418e0ac-8d00-4f28-95a2-735cbcfe926e-maas-api-service-ca\") pod \"d418e0ac-8d00-4f28-95a2-735cbcfe926e\" (UID: \"d418e0ac-8d00-4f28-95a2-735cbcfe926e\") "
Sep 10 22:20:07.476203 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:07.476178    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d418e0ac-8d00-4f28-95a2-735cbcfe926e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d418e0ac-8d00-4f28-95a2-735cbcfe926e" (UID: "d418e0ac-8d00-4f28-95a2-735cbcfe926e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:20:07.577193 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:07.577158    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d418e0ac-8d00-4f28-95a2-735cbcfe926e-maas-api-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:08.177205 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:08.177175    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1c252b-q7m28"
Sep 10 22:20:08.177398 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:08.177212    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1c252b-q7m28" event={"ID":"d418e0ac-8d00-4f28-95a2-735cbcfe926e","Type":"ContainerDied","Data":"1e9a7ad7506cda6168eabaf9d2f8f4c2894ab560f825388d9b633314a854e033"}
Sep 10 22:20:08.177398 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:08.177269    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e9a7ad7506cda6168eabaf9d2f8f4c2894ab560f825388d9b633314a854e033"
Sep 10 22:20:09.103410 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.103383    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:20:09.188653 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.188619    2577 generic.go:356] "Generic (PLEG): container finished" podID="36c89b81-ed84-445d-8fe3-acdf2077a846" containerID="9a9539559ae3bd7a0535eb85015fcc89fe47c564b0298fb6a83ea6c0c40c2586" exitCode=0
Sep 10 22:20:09.188839 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.188699    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r" event={"ID":"36c89b81-ed84-445d-8fe3-acdf2077a846","Type":"ContainerDied","Data":"9a9539559ae3bd7a0535eb85015fcc89fe47c564b0298fb6a83ea6c0c40c2586"}
Sep 10 22:20:09.188839 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.188771    2577 scope.go:117] "RemoveContainer" containerID="8baef7bc6cc878b3a74b5e8cc417459826099ea458549c2cd54df2ba953ec1bb"
Sep 10 22:20:09.191071 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.191045    2577 generic.go:356] "Generic (PLEG): container finished" podID="d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" containerID="2943c4be6495816b885efa785486282cd5d53df61b0a65524386d64baf759ee6" exitCode=0
Sep 10 22:20:09.191191 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.191106    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"
Sep 10 22:20:09.191191 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.191100    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9" event={"ID":"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d","Type":"ContainerDied","Data":"2943c4be6495816b885efa785486282cd5d53df61b0a65524386d64baf759ee6"}
Sep 10 22:20:09.191304 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.191234    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9" event={"ID":"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d","Type":"ContainerDied","Data":"47ac5f82d1b52c61bf292129e91dcdb69dc79adc72808c7e0e2f27b0e91a0efd"}
Sep 10 22:20:09.191679 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.191663    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-credential-socket\") pod \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") "
Sep 10 22:20:09.191754 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.191705    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2dvp\" (UniqueName: \"kubernetes.io/projected/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-kube-api-access-p2dvp\") pod \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") "
Sep 10 22:20:09.191889 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.191751    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-data\") pod \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") "
Sep 10 22:20:09.191889 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.191876    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-envoy\") pod \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") "
Sep 10 22:20:09.191998 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.191920    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-workload-socket\") pod \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") "
Sep 10 22:20:09.191998 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.191963    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-workload-certs\") pod \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") "
Sep 10 22:20:09.191998 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.191992    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istiod-ca-cert\") pod \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") "
Sep 10 22:20:09.192140 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.192045    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" (UID: "d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:20:09.192140 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.192068    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-podinfo\") pod \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") "
Sep 10 22:20:09.192140 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.192101    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-token\") pod \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\" (UID: \"d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d\") "
Sep 10 22:20:09.192488 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.192470    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-credential-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.192882 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.192852    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" (UID: "d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:20:09.193118 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.193093    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" (UID: "d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:20:09.193329 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.193304    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-data" (OuterVolumeSpecName: "istio-data") pod "d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" (UID: "d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:20:09.193444 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.193366    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" (UID: "d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:20:09.194932 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.194910    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" (UID: "d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:20:09.195139 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.195106    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-kube-api-access-p2dvp" (OuterVolumeSpecName: "kube-api-access-p2dvp") pod "d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" (UID: "d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d"). InnerVolumeSpecName "kube-api-access-p2dvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:20:09.195598 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.195573    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-token" (OuterVolumeSpecName: "istio-token") pod "d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" (UID: "d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:20:09.195700 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.195617    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" (UID: "d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:20:09.201206 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.201186    2577 scope.go:117] "RemoveContainer" containerID="2943c4be6495816b885efa785486282cd5d53df61b0a65524386d64baf759ee6"
Sep 10 22:20:09.210628 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.210603    2577 scope.go:117] "RemoveContainer" containerID="b628174192381d50506fc968bf80901eacdb33f4464a096033a0355b386855d4"
Sep 10 22:20:09.219616 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.219596    2577 scope.go:117] "RemoveContainer" containerID="2943c4be6495816b885efa785486282cd5d53df61b0a65524386d64baf759ee6"
Sep 10 22:20:09.220048 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:20:09.220027    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2943c4be6495816b885efa785486282cd5d53df61b0a65524386d64baf759ee6\": container with ID starting with 2943c4be6495816b885efa785486282cd5d53df61b0a65524386d64baf759ee6 not found: ID does not exist" containerID="2943c4be6495816b885efa785486282cd5d53df61b0a65524386d64baf759ee6"
Sep 10 22:20:09.220134 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.220057    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2943c4be6495816b885efa785486282cd5d53df61b0a65524386d64baf759ee6"} err="failed to get container status \"2943c4be6495816b885efa785486282cd5d53df61b0a65524386d64baf759ee6\": rpc error: code = NotFound desc = could not find container \"2943c4be6495816b885efa785486282cd5d53df61b0a65524386d64baf759ee6\": container with ID starting with 2943c4be6495816b885efa785486282cd5d53df61b0a65524386d64baf759ee6 not found: ID does not exist"
Sep 10 22:20:09.220134 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.220077    2577 scope.go:117] "RemoveContainer" containerID="b628174192381d50506fc968bf80901eacdb33f4464a096033a0355b386855d4"
Sep 10 22:20:09.220383 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:20:09.220368    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b628174192381d50506fc968bf80901eacdb33f4464a096033a0355b386855d4\": container with ID starting with b628174192381d50506fc968bf80901eacdb33f4464a096033a0355b386855d4 not found: ID does not exist" containerID="b628174192381d50506fc968bf80901eacdb33f4464a096033a0355b386855d4"
Sep 10 22:20:09.220420 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.220389    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b628174192381d50506fc968bf80901eacdb33f4464a096033a0355b386855d4"} err="failed to get container status \"b628174192381d50506fc968bf80901eacdb33f4464a096033a0355b386855d4\": rpc error: code = NotFound desc = could not find container \"b628174192381d50506fc968bf80901eacdb33f4464a096033a0355b386855d4\": container with ID starting with b628174192381d50506fc968bf80901eacdb33f4464a096033a0355b386855d4 not found: ID does not exist"
Sep 10 22:20:09.231046 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.231023    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:20:09.294109 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.294077    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2dvp\" (UniqueName: \"kubernetes.io/projected/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-kube-api-access-p2dvp\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.294109 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.294105    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-data\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.294109 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.294114    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-envoy\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.294349 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.294123    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-workload-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.294349 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.294131    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-workload-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.294349 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.294139    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istiod-ca-cert\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.294349 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.294146    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-podinfo\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.294349 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.294154    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d-istio-token\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.395294 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.395265    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pllh8\" (UniqueName: \"kubernetes.io/projected/36c89b81-ed84-445d-8fe3-acdf2077a846-kube-api-access-pllh8\") pod \"36c89b81-ed84-445d-8fe3-acdf2077a846\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") "
Sep 10 22:20:09.395466 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.395330    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-podinfo\") pod \"36c89b81-ed84-445d-8fe3-acdf2077a846\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") "
Sep 10 22:20:09.395466 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.395359    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-envoy\") pod \"36c89b81-ed84-445d-8fe3-acdf2077a846\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") "
Sep 10 22:20:09.395466 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.395419    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-workload-certs\") pod \"36c89b81-ed84-445d-8fe3-acdf2077a846\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") "
Sep 10 22:20:09.395624 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.395482    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36c89b81-ed84-445d-8fe3-acdf2077a846-istiod-ca-cert\") pod \"36c89b81-ed84-445d-8fe3-acdf2077a846\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") "
Sep 10 22:20:09.395624 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.395508    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-credential-socket\") pod \"36c89b81-ed84-445d-8fe3-acdf2077a846\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") "
Sep 10 22:20:09.395624 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.395547    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-data\") pod \"36c89b81-ed84-445d-8fe3-acdf2077a846\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") "
Sep 10 22:20:09.395624 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.395582    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-token\") pod \"36c89b81-ed84-445d-8fe3-acdf2077a846\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") "
Sep 10 22:20:09.395624 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.395610    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-workload-socket\") pod \"36c89b81-ed84-445d-8fe3-acdf2077a846\" (UID: \"36c89b81-ed84-445d-8fe3-acdf2077a846\") "
Sep 10 22:20:09.395914 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.395807    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "36c89b81-ed84-445d-8fe3-acdf2077a846" (UID: "36c89b81-ed84-445d-8fe3-acdf2077a846"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:20:09.395914 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.395821    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "36c89b81-ed84-445d-8fe3-acdf2077a846" (UID: "36c89b81-ed84-445d-8fe3-acdf2077a846"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:20:09.396018 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.395969    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-data" (OuterVolumeSpecName: "istio-data") pod "36c89b81-ed84-445d-8fe3-acdf2077a846" (UID: "36c89b81-ed84-445d-8fe3-acdf2077a846"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:20:09.396018 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.395985    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c89b81-ed84-445d-8fe3-acdf2077a846-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "36c89b81-ed84-445d-8fe3-acdf2077a846" (UID: "36c89b81-ed84-445d-8fe3-acdf2077a846"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:20:09.396130 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.396025    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "36c89b81-ed84-445d-8fe3-acdf2077a846" (UID: "36c89b81-ed84-445d-8fe3-acdf2077a846"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:20:09.396130 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.396092    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-workload-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.396130 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.396110    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36c89b81-ed84-445d-8fe3-acdf2077a846-istiod-ca-cert\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.396130 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.396123    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-credential-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.396349 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.396136    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-data\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.397864 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.397842    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "36c89b81-ed84-445d-8fe3-acdf2077a846" (UID: "36c89b81-ed84-445d-8fe3-acdf2077a846"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:20:09.397977 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.397867    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36c89b81-ed84-445d-8fe3-acdf2077a846-kube-api-access-pllh8" (OuterVolumeSpecName: "kube-api-access-pllh8") pod "36c89b81-ed84-445d-8fe3-acdf2077a846" (UID: "36c89b81-ed84-445d-8fe3-acdf2077a846"). InnerVolumeSpecName "kube-api-access-pllh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:20:09.397977 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.397962    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "36c89b81-ed84-445d-8fe3-acdf2077a846" (UID: "36c89b81-ed84-445d-8fe3-acdf2077a846"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:20:09.398065 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.398029    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-token" (OuterVolumeSpecName: "istio-token") pod "36c89b81-ed84-445d-8fe3-acdf2077a846" (UID: "36c89b81-ed84-445d-8fe3-acdf2077a846"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:20:09.496996 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.496966    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-podinfo\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.496996 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.496990    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-envoy\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.496996 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.496998    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36c89b81-ed84-445d-8fe3-acdf2077a846-istio-token\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.497219 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.497006    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36c89b81-ed84-445d-8fe3-acdf2077a846-workload-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.497219 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.497014    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pllh8\" (UniqueName: \"kubernetes.io/projected/36c89b81-ed84-445d-8fe3-acdf2077a846-kube-api-access-pllh8\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.513231 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.513199    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"]
Sep 10 22:20:09.521103 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.521079    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d98bb58d-openshift-default-69f6bfcdb4-wbvz9"]
Sep 10 22:20:09.847608 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:09.847575    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" path="/var/lib/kubelet/pods/d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d/volumes"
Sep 10 22:20:10.204765 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:10.204735    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"
Sep 10 22:20:10.205243 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:10.204733    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r" event={"ID":"36c89b81-ed84-445d-8fe3-acdf2077a846","Type":"ContainerDied","Data":"3e2df4137109c51d5a302f8219716f1e0a77dcb29facad3da917790df5589f06"}
Sep 10 22:20:10.205243 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:10.204873    2577 scope.go:117] "RemoveContainer" containerID="9a9539559ae3bd7a0535eb85015fcc89fe47c564b0298fb6a83ea6c0c40c2586"
Sep 10 22:20:10.222442 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:10.222410    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"]
Sep 10 22:20:10.227554 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:10.227529    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-e5a2d7-openshift-default-5784856f58-qb88r"]
Sep 10 22:20:11.848709 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:11.848675    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36c89b81-ed84-445d-8fe3-acdf2077a846" path="/var/lib/kubelet/pods/36c89b81-ed84-445d-8fe3-acdf2077a846/volumes"
Sep 10 22:20:15.561441 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:15.561405    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1c252b-q7m28"]
Sep 10 22:20:15.565523 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:15.565497    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1c252b-q7m28"]
Sep 10 22:20:15.848133 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:15.848053    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d418e0ac-8d00-4f28-95a2-735cbcfe926e" path="/var/lib/kubelet/pods/d418e0ac-8d00-4f28-95a2-735cbcfe926e/volumes"
Sep 10 22:20:18.095183 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:18.095144    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:20:22.510999 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.510952    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"]
Sep 10 22:20:22.511417 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.511240    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf" podUID="b15d88c9-4847-45b0-a0d0-7a21cd2d1545" containerName="istio-proxy" containerID="cri-o://929d680140cfda7b331d37163a7ef60bd41950b8d520827183707810503421f3" gracePeriod=30
Sep 10 22:20:22.813198 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.813101    2577 patch_prober.go:28] interesting pod/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 22:20:22.813198 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.813181    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf" podUID="b15d88c9-4847-45b0-a0d0-7a21cd2d1545" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 22:20:22.888582 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.888547    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"]
Sep 10 22:20:22.889000 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.888980    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36c89b81-ed84-445d-8fe3-acdf2077a846" containerName="istio-proxy"
Sep 10 22:20:22.889210 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.889008    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="36c89b81-ed84-445d-8fe3-acdf2077a846" containerName="istio-proxy"
Sep 10 22:20:22.889210 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.889024    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d418e0ac-8d00-4f28-95a2-735cbcfe926e" containerName="revoke-keys"
Sep 10 22:20:22.889210 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.889034    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d418e0ac-8d00-4f28-95a2-735cbcfe926e" containerName="revoke-keys"
Sep 10 22:20:22.889210 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.889058    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" containerName="istio-proxy"
Sep 10 22:20:22.889210 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.889066    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" containerName="istio-proxy"
Sep 10 22:20:22.889210 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.889075    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36c89b81-ed84-445d-8fe3-acdf2077a846" containerName="istio-proxy"
Sep 10 22:20:22.889210 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.889083    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="36c89b81-ed84-445d-8fe3-acdf2077a846" containerName="istio-proxy"
Sep 10 22:20:22.889210 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.889104    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" containerName="istio-proxy"
Sep 10 22:20:22.889210 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.889112    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" containerName="istio-proxy"
Sep 10 22:20:22.889210 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.889209    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d418e0ac-8d00-4f28-95a2-735cbcfe926e" containerName="revoke-keys"
Sep 10 22:20:22.889714 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.889222    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="36c89b81-ed84-445d-8fe3-acdf2077a846" containerName="istio-proxy"
Sep 10 22:20:22.889714 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.889233    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" containerName="istio-proxy"
Sep 10 22:20:22.889714 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.889240    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8dcf3bc-8c9f-4662-9d50-37ef45f7f82d" containerName="istio-proxy"
Sep 10 22:20:22.889714 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.889250    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="36c89b81-ed84-445d-8fe3-acdf2077a846" containerName="istio-proxy"
Sep 10 22:20:22.894197 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.894177    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"
Sep 10 22:20:22.896652 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.896629    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 22:20:22.896889 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.896661    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-a9b6f6-serving-cert\""
Sep 10 22:20:22.896966 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.896880    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-spztp\""
Sep 10 22:20:22.905317 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.905293    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"]
Sep 10 22:20:22.915348 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.915318    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92ce1629-71f9-46df-9ae9-3415d16296ee-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6\" (UID: \"92ce1629-71f9-46df-9ae9-3415d16296ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"
Sep 10 22:20:22.915512 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.915387    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92ce1629-71f9-46df-9ae9-3415d16296ee-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6\" (UID: \"92ce1629-71f9-46df-9ae9-3415d16296ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"
Sep 10 22:20:22.915512 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.915475    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4xg7\" (UniqueName: \"kubernetes.io/projected/92ce1629-71f9-46df-9ae9-3415d16296ee-kube-api-access-p4xg7\") pod \"maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6\" (UID: \"92ce1629-71f9-46df-9ae9-3415d16296ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"
Sep 10 22:20:22.915512 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:22.915502    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92ce1629-71f9-46df-9ae9-3415d16296ee-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6\" (UID: \"92ce1629-71f9-46df-9ae9-3415d16296ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"
Sep 10 22:20:23.016139 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:23.016102    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92ce1629-71f9-46df-9ae9-3415d16296ee-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6\" (UID: \"92ce1629-71f9-46df-9ae9-3415d16296ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"
Sep 10 22:20:23.016347 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:23.016173    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4xg7\" (UniqueName: \"kubernetes.io/projected/92ce1629-71f9-46df-9ae9-3415d16296ee-kube-api-access-p4xg7\") pod \"maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6\" (UID: \"92ce1629-71f9-46df-9ae9-3415d16296ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"
Sep 10 22:20:23.016347 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:23.016191    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92ce1629-71f9-46df-9ae9-3415d16296ee-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6\" (UID: \"92ce1629-71f9-46df-9ae9-3415d16296ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"
Sep 10 22:20:23.016347 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:23.016217    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92ce1629-71f9-46df-9ae9-3415d16296ee-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6\" (UID: \"92ce1629-71f9-46df-9ae9-3415d16296ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"
Sep 10 22:20:23.016347 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:20:23.016331    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-serving-cert: secret "maas-api-e2e-shared-a-w2-a9b6f6-serving-cert" not found
Sep 10 22:20:23.016572 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:20:23.016403    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92ce1629-71f9-46df-9ae9-3415d16296ee-maas-api-tls podName:92ce1629-71f9-46df-9ae9-3415d16296ee nodeName:}" failed. No retries permitted until 2026-09-10 22:20:23.516382287 +0000 UTC m=+1128.188480186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/92ce1629-71f9-46df-9ae9-3415d16296ee-maas-api-tls") pod "maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6" (UID: "92ce1629-71f9-46df-9ae9-3415d16296ee") : secret "maas-api-e2e-shared-a-w2-a9b6f6-serving-cert" not found
Sep 10 22:20:23.016819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:23.016773    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92ce1629-71f9-46df-9ae9-3415d16296ee-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6\" (UID: \"92ce1629-71f9-46df-9ae9-3415d16296ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"
Sep 10 22:20:23.018843 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:23.018824    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92ce1629-71f9-46df-9ae9-3415d16296ee-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6\" (UID: \"92ce1629-71f9-46df-9ae9-3415d16296ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"
Sep 10 22:20:23.028278 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:23.028250    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4xg7\" (UniqueName: \"kubernetes.io/projected/92ce1629-71f9-46df-9ae9-3415d16296ee-kube-api-access-p4xg7\") pod \"maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6\" (UID: \"92ce1629-71f9-46df-9ae9-3415d16296ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"
Sep 10 22:20:23.522025 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:23.521986    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92ce1629-71f9-46df-9ae9-3415d16296ee-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6\" (UID: \"92ce1629-71f9-46df-9ae9-3415d16296ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"
Sep 10 22:20:23.524598 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:23.524579    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92ce1629-71f9-46df-9ae9-3415d16296ee-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6\" (UID: \"92ce1629-71f9-46df-9ae9-3415d16296ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"
Sep 10 22:20:23.807409 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:23.807317    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"
Sep 10 22:20:24.091758 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:20:24.091732    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92ce1629_71f9_46df_9ae9_3415d16296ee.slice/crio-9c68dd0c6bf1a6228bc2a6387eabe44d87b839ea476696e92bd1049c8a1643ba WatchSource:0}: Error finding container 9c68dd0c6bf1a6228bc2a6387eabe44d87b839ea476696e92bd1049c8a1643ba: Status 404 returned error can't find the container with id 9c68dd0c6bf1a6228bc2a6387eabe44d87b839ea476696e92bd1049c8a1643ba
Sep 10 22:20:24.092846 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:24.092818    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"]
Sep 10 22:20:24.300179 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:24.300143    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6" event={"ID":"92ce1629-71f9-46df-9ae9-3415d16296ee","Type":"ContainerStarted","Data":"9c68dd0c6bf1a6228bc2a6387eabe44d87b839ea476696e92bd1049c8a1643ba"}
Sep 10 22:20:25.308631 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:25.308589    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6" event={"ID":"92ce1629-71f9-46df-9ae9-3415d16296ee","Type":"ContainerStarted","Data":"507896f4933c77c5d11b34a4f38d1afe3d584099f43658c844c8b4b2797671ca"}
Sep 10 22:20:25.309154 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:25.308703    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"
Sep 10 22:20:25.328579 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:25.328519    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6" podStartSLOduration=2.903448465 podStartE2EDuration="3.328502504s" totalImagesPullingTime="425.054039ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:20:25.327520059 +0000 UTC m=+1129.999617981" watchObservedRunningTime="2026-09-10 22:20:25.328502504 +0000 UTC m=+1130.000600460"
Sep 10 22:20:26.885757 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:26.885718    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:20:27.770253 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.770228    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:20:27.864920 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.864829    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istiod-ca-cert\") pod \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") "
Sep 10 22:20:27.864920 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.864869    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-podinfo\") pod \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") "
Sep 10 22:20:27.864920 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.864887    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-data\") pod \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") "
Sep 10 22:20:27.864920 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.864912    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-token\") pod \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") "
Sep 10 22:20:27.865246 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.864935    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-envoy\") pod \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") "
Sep 10 22:20:27.865246 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.864955    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twcz7\" (UniqueName: \"kubernetes.io/projected/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-kube-api-access-twcz7\") pod \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") "
Sep 10 22:20:27.865246 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.865031    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-workload-socket\") pod \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") "
Sep 10 22:20:27.865246 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.865052    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-workload-certs\") pod \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") "
Sep 10 22:20:27.865246 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.865068    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-credential-socket\") pod \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\" (UID: \"b15d88c9-4847-45b0-a0d0-7a21cd2d1545\") "
Sep 10 22:20:27.865510 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.865258    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b15d88c9-4847-45b0-a0d0-7a21cd2d1545" (UID: "b15d88c9-4847-45b0-a0d0-7a21cd2d1545"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:20:27.865510 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.865439    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b15d88c9-4847-45b0-a0d0-7a21cd2d1545" (UID: "b15d88c9-4847-45b0-a0d0-7a21cd2d1545"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:20:27.865633 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.865533    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b15d88c9-4847-45b0-a0d0-7a21cd2d1545" (UID: "b15d88c9-4847-45b0-a0d0-7a21cd2d1545"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:20:27.865697 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.865676    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b15d88c9-4847-45b0-a0d0-7a21cd2d1545" (UID: "b15d88c9-4847-45b0-a0d0-7a21cd2d1545"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:20:27.865954 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.865926    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-data" (OuterVolumeSpecName: "istio-data") pod "b15d88c9-4847-45b0-a0d0-7a21cd2d1545" (UID: "b15d88c9-4847-45b0-a0d0-7a21cd2d1545"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:20:27.867477 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.867451    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-kube-api-access-twcz7" (OuterVolumeSpecName: "kube-api-access-twcz7") pod "b15d88c9-4847-45b0-a0d0-7a21cd2d1545" (UID: "b15d88c9-4847-45b0-a0d0-7a21cd2d1545"). InnerVolumeSpecName "kube-api-access-twcz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:20:27.867818 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.867771    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b15d88c9-4847-45b0-a0d0-7a21cd2d1545" (UID: "b15d88c9-4847-45b0-a0d0-7a21cd2d1545"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:20:27.867898 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.867816    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-token" (OuterVolumeSpecName: "istio-token") pod "b15d88c9-4847-45b0-a0d0-7a21cd2d1545" (UID: "b15d88c9-4847-45b0-a0d0-7a21cd2d1545"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:20:27.867985 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.867967    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b15d88c9-4847-45b0-a0d0-7a21cd2d1545" (UID: "b15d88c9-4847-45b0-a0d0-7a21cd2d1545"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:20:27.965738 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.965696    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-workload-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:27.965738 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.965729    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-workload-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:27.965738 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.965739    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-credential-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:27.965738 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.965748    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istiod-ca-cert\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:27.966276 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.965756    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-podinfo\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:27.966276 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.965764    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-data\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:27.966276 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.965772    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-token\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:27.966276 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.965814    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-istio-envoy\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:27.966276 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:27.965825    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twcz7\" (UniqueName: \"kubernetes.io/projected/b15d88c9-4847-45b0-a0d0-7a21cd2d1545-kube-api-access-twcz7\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:20:28.329666 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:28.329631    2577 generic.go:356] "Generic (PLEG): container finished" podID="b15d88c9-4847-45b0-a0d0-7a21cd2d1545" containerID="929d680140cfda7b331d37163a7ef60bd41950b8d520827183707810503421f3" exitCode=0
Sep 10 22:20:28.329906 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:28.329693    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"
Sep 10 22:20:28.329906 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:28.329722    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf" event={"ID":"b15d88c9-4847-45b0-a0d0-7a21cd2d1545","Type":"ContainerDied","Data":"929d680140cfda7b331d37163a7ef60bd41950b8d520827183707810503421f3"}
Sep 10 22:20:28.329906 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:28.329817    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf" event={"ID":"b15d88c9-4847-45b0-a0d0-7a21cd2d1545","Type":"ContainerDied","Data":"e21ef7272dfc9ddda0639c344807f6d6f784ee54054d9bfcbdef5acb77fb066f"}
Sep 10 22:20:28.329906 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:28.329853    2577 scope.go:117] "RemoveContainer" containerID="929d680140cfda7b331d37163a7ef60bd41950b8d520827183707810503421f3"
Sep 10 22:20:28.340955 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:28.340935    2577 scope.go:117] "RemoveContainer" containerID="14eaaf417a154b3924c0f28ff3c50fe352d647d90abb6945db2a5688fe8e5744"
Sep 10 22:20:28.350130 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:28.350107    2577 scope.go:117] "RemoveContainer" containerID="929d680140cfda7b331d37163a7ef60bd41950b8d520827183707810503421f3"
Sep 10 22:20:28.350445 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:20:28.350425    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"929d680140cfda7b331d37163a7ef60bd41950b8d520827183707810503421f3\": container with ID starting with 929d680140cfda7b331d37163a7ef60bd41950b8d520827183707810503421f3 not found: ID does not exist" containerID="929d680140cfda7b331d37163a7ef60bd41950b8d520827183707810503421f3"
Sep 10 22:20:28.350518 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:28.350453    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"929d680140cfda7b331d37163a7ef60bd41950b8d520827183707810503421f3"} err="failed to get container status \"929d680140cfda7b331d37163a7ef60bd41950b8d520827183707810503421f3\": rpc error: code = NotFound desc = could not find container \"929d680140cfda7b331d37163a7ef60bd41950b8d520827183707810503421f3\": container with ID starting with 929d680140cfda7b331d37163a7ef60bd41950b8d520827183707810503421f3 not found: ID does not exist"
Sep 10 22:20:28.350518 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:28.350472    2577 scope.go:117] "RemoveContainer" containerID="14eaaf417a154b3924c0f28ff3c50fe352d647d90abb6945db2a5688fe8e5744"
Sep 10 22:20:28.350719 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:20:28.350704    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14eaaf417a154b3924c0f28ff3c50fe352d647d90abb6945db2a5688fe8e5744\": container with ID starting with 14eaaf417a154b3924c0f28ff3c50fe352d647d90abb6945db2a5688fe8e5744 not found: ID does not exist" containerID="14eaaf417a154b3924c0f28ff3c50fe352d647d90abb6945db2a5688fe8e5744"
Sep 10 22:20:28.350766 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:28.350722    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14eaaf417a154b3924c0f28ff3c50fe352d647d90abb6945db2a5688fe8e5744"} err="failed to get container status \"14eaaf417a154b3924c0f28ff3c50fe352d647d90abb6945db2a5688fe8e5744\": rpc error: code = NotFound desc = could not find container \"14eaaf417a154b3924c0f28ff3c50fe352d647d90abb6945db2a5688fe8e5744\": container with ID starting with 14eaaf417a154b3924c0f28ff3c50fe352d647d90abb6945db2a5688fe8e5744 not found: ID does not exist"
Sep 10 22:20:28.364717 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:28.358914    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"]
Sep 10 22:20:28.369815 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:28.369764    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-1c252b-openshift-default-6c5bc56566-q92rf"]
Sep 10 22:20:29.848043 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:29.848007    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b15d88c9-4847-45b0-a0d0-7a21cd2d1545" path="/var/lib/kubelet/pods/b15d88c9-4847-45b0-a0d0-7a21cd2d1545/volumes"
Sep 10 22:20:31.321455 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:31.321428    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"
Sep 10 22:20:36.068353 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:36.068319    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:20:47.352857 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.352820    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"]
Sep 10 22:20:47.353316 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.353301    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b15d88c9-4847-45b0-a0d0-7a21cd2d1545" containerName="istio-proxy"
Sep 10 22:20:47.353361 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.353318    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b15d88c9-4847-45b0-a0d0-7a21cd2d1545" containerName="istio-proxy"
Sep 10 22:20:47.353361 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.353327    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b15d88c9-4847-45b0-a0d0-7a21cd2d1545" containerName="istio-proxy"
Sep 10 22:20:47.353361 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.353335    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b15d88c9-4847-45b0-a0d0-7a21cd2d1545" containerName="istio-proxy"
Sep 10 22:20:47.353459 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.353412    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b15d88c9-4847-45b0-a0d0-7a21cd2d1545" containerName="istio-proxy"
Sep 10 22:20:47.358218 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.358181    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.360683 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.360661    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-a9b3ec-openshift-default-dockercfg-rj8v2\""
Sep 10 22:20:47.378370 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.378340    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"]
Sep 10 22:20:47.446751 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.446717    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-credential-socket\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.446948 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.446761    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-workload-socket\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.446948 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.446849    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-istio-data\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.446948 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.446928    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ff6320-60ea-4b7b-87d2-547a31866300-istio-token\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.447302 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.446959    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ff6320-60ea-4b7b-87d2-547a31866300-istio-podinfo\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.447302 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.447012    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-workload-certs\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.447302 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.447042    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44b8l\" (UniqueName: \"kubernetes.io/projected/09ff6320-60ea-4b7b-87d2-547a31866300-kube-api-access-44b8l\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.447302 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.447103    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ff6320-60ea-4b7b-87d2-547a31866300-istiod-ca-cert\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.447302 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.447139    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-istio-envoy\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.548307 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.548271    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-istio-envoy\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.548307 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.548315    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-credential-socket\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.548570 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.548336    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-workload-socket\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.548570 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.548357    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-istio-data\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.548570 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.548407    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ff6320-60ea-4b7b-87d2-547a31866300-istio-token\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.548570 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.548429    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ff6320-60ea-4b7b-87d2-547a31866300-istio-podinfo\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.548570 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.548474    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-workload-certs\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.548570 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.548502    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44b8l\" (UniqueName: \"kubernetes.io/projected/09ff6320-60ea-4b7b-87d2-547a31866300-kube-api-access-44b8l\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.548570 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.548539    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ff6320-60ea-4b7b-87d2-547a31866300-istiod-ca-cert\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.548956 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.548832    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-workload-socket\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.548956 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.548922    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-istio-data\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.549059 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.548957    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-workload-certs\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.549059 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.549042    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-credential-socket\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.549330 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.549183    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ff6320-60ea-4b7b-87d2-547a31866300-istiod-ca-cert\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.550947 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.550923    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-istio-envoy\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.551260 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.551244    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ff6320-60ea-4b7b-87d2-547a31866300-istio-podinfo\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.557357 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.557326    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ff6320-60ea-4b7b-87d2-547a31866300-istio-token\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.557537 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.557406    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44b8l\" (UniqueName: \"kubernetes.io/projected/09ff6320-60ea-4b7b-87d2-547a31866300-kube-api-access-44b8l\") pod \"e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") " pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.669465 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.669428    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:47.965680 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.965632    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"]
Sep 10 22:20:47.968121 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:20:47.968088    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09ff6320_60ea_4b7b_87d2_547a31866300.slice/crio-6d3310c085bb30dc8d7e1c905951e69cde2dcc6f62b4a81bcaa90dd3f644d995 WatchSource:0}: Error finding container 6d3310c085bb30dc8d7e1c905951e69cde2dcc6f62b4a81bcaa90dd3f644d995: Status 404 returned error can't find the container with id 6d3310c085bb30dc8d7e1c905951e69cde2dcc6f62b4a81bcaa90dd3f644d995
Sep 10 22:20:47.970395 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.970362    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:20:47.970560 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.970426    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:20:47.970560 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:47.970457    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:20:48.454758 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:48.454724    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw" event={"ID":"09ff6320-60ea-4b7b-87d2-547a31866300","Type":"ContainerStarted","Data":"4c944970f7eca752d6c68b187864708d0c377a27524dec125307339427453e8e"}
Sep 10 22:20:48.455184 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:48.454802    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw" event={"ID":"09ff6320-60ea-4b7b-87d2-547a31866300","Type":"ContainerStarted","Data":"6d3310c085bb30dc8d7e1c905951e69cde2dcc6f62b4a81bcaa90dd3f644d995"}
Sep 10 22:20:48.478013 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:48.477956    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw" podStartSLOduration=1.477938008 podStartE2EDuration="1.477938008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:20:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:20:48.475758744 +0000 UTC m=+1153.147856662" watchObservedRunningTime="2026-09-10 22:20:48.477938008 +0000 UTC m=+1153.150035928"
Sep 10 22:20:48.669815 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:48.669759    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:49.676352 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:49.676321    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:50.470379 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:50.470339    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:50.471144 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:50.471128    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:20:51.793793 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:51.793738    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"]
Sep 10 22:20:51.794274 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:51.794258    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b15d88c9-4847-45b0-a0d0-7a21cd2d1545" containerName="istio-proxy"
Sep 10 22:20:51.797543 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:51.797521    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"
Sep 10 22:20:51.800760 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:51.800738    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-a9b3ec-serving-cert\""
Sep 10 22:20:51.817881 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:51.817850    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"]
Sep 10 22:20:51.889066 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:51.889020    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h\" (UID: \"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"
Sep 10 22:20:51.889271 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:51.889075    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h\" (UID: \"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"
Sep 10 22:20:51.889271 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:51.889099    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h\" (UID: \"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"
Sep 10 22:20:51.889271 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:51.889154    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blwc9\" (UniqueName: \"kubernetes.io/projected/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-kube-api-access-blwc9\") pod \"maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h\" (UID: \"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"
Sep 10 22:20:51.990602 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:51.990570    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h\" (UID: \"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"
Sep 10 22:20:51.990602 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:51.990612    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h\" (UID: \"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"
Sep 10 22:20:51.990894 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:51.990638    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h\" (UID: \"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"
Sep 10 22:20:51.990894 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:51.990702    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blwc9\" (UniqueName: \"kubernetes.io/projected/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-kube-api-access-blwc9\") pod \"maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h\" (UID: \"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"
Sep 10 22:20:51.990894 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:20:51.990727    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-serving-cert: secret "maas-api-e2e-shared-b-w2-a9b3ec-serving-cert" not found
Sep 10 22:20:51.990894 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:20:51.990831    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-maas-api-tls podName:0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc nodeName:}" failed. No retries permitted until 2026-09-10 22:20:52.490806347 +0000 UTC m=+1157.162904263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-maas-api-tls") pod "maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h" (UID: "0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc") : secret "maas-api-e2e-shared-b-w2-a9b3ec-serving-cert" not found
Sep 10 22:20:51.991403 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:51.991384    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h\" (UID: \"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"
Sep 10 22:20:51.993344 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:51.993314    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h\" (UID: \"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"
Sep 10 22:20:51.999515 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:51.999490    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blwc9\" (UniqueName: \"kubernetes.io/projected/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-kube-api-access-blwc9\") pod \"maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h\" (UID: \"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"
Sep 10 22:20:52.495409 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:52.495371    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h\" (UID: \"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"
Sep 10 22:20:52.498037 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:52.498003    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h\" (UID: \"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"
Sep 10 22:20:52.709338 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:52.709297    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"
Sep 10 22:20:52.987423 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:52.987316    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"]
Sep 10 22:20:52.990174 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:20:52.990135    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fd1b4a4_6806_44ec_bef4_6bd48fd88ecc.slice/crio-a846de0e996efb1f305b8ea4548625bdf579d3d7ecdc733b397b6e5d93bcccaa WatchSource:0}: Error finding container a846de0e996efb1f305b8ea4548625bdf579d3d7ecdc733b397b6e5d93bcccaa: Status 404 returned error can't find the container with id a846de0e996efb1f305b8ea4548625bdf579d3d7ecdc733b397b6e5d93bcccaa
Sep 10 22:20:53.490788 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:53.490751    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h" event={"ID":"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc","Type":"ContainerStarted","Data":"2d9a1667c78c037941173a1b4cbd67ca7f6536a5d1fd21e17efdc8c5408b8e03"}
Sep 10 22:20:53.490967 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:53.490824    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h" event={"ID":"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc","Type":"ContainerStarted","Data":"a846de0e996efb1f305b8ea4548625bdf579d3d7ecdc733b397b6e5d93bcccaa"}
Sep 10 22:20:53.490967 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:53.490848    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"
Sep 10 22:20:53.510264 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:53.510200    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h" podStartSLOduration=2.195867651 podStartE2EDuration="2.510185998s" totalImagesPullingTime="314.318347ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:20:53.509892892 +0000 UTC m=+1158.181990813" watchObservedRunningTime="2026-09-10 22:20:53.510185998 +0000 UTC m=+1158.182283920"
Sep 10 22:20:56.970068 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:56.969985    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"]
Sep 10 22:20:56.973806 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:56.973769    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"
Sep 10 22:20:56.977164 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:56.977140    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-ec6d47-serving-cert\""
Sep 10 22:20:56.995578 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:56.995547    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"]
Sep 10 22:20:57.037792 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:57.037748    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56017827-0fbc-4ae8-b507-e572be309dad-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5\" (UID: \"56017827-0fbc-4ae8-b507-e572be309dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"
Sep 10 22:20:57.037957 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:57.037816    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56017827-0fbc-4ae8-b507-e572be309dad-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5\" (UID: \"56017827-0fbc-4ae8-b507-e572be309dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"
Sep 10 22:20:57.037957 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:57.037865    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvb77\" (UniqueName: \"kubernetes.io/projected/56017827-0fbc-4ae8-b507-e572be309dad-kube-api-access-fvb77\") pod \"maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5\" (UID: \"56017827-0fbc-4ae8-b507-e572be309dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"
Sep 10 22:20:57.037957 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:57.037926    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56017827-0fbc-4ae8-b507-e572be309dad-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5\" (UID: \"56017827-0fbc-4ae8-b507-e572be309dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"
Sep 10 22:20:57.078213 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:57.078171    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:20:57.139301 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:57.139258    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56017827-0fbc-4ae8-b507-e572be309dad-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5\" (UID: \"56017827-0fbc-4ae8-b507-e572be309dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"
Sep 10 22:20:57.139474 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:57.139323    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvb77\" (UniqueName: \"kubernetes.io/projected/56017827-0fbc-4ae8-b507-e572be309dad-kube-api-access-fvb77\") pod \"maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5\" (UID: \"56017827-0fbc-4ae8-b507-e572be309dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"
Sep 10 22:20:57.139474 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:57.139368    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56017827-0fbc-4ae8-b507-e572be309dad-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5\" (UID: \"56017827-0fbc-4ae8-b507-e572be309dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"
Sep 10 22:20:57.139474 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:57.139453    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56017827-0fbc-4ae8-b507-e572be309dad-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5\" (UID: \"56017827-0fbc-4ae8-b507-e572be309dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"
Sep 10 22:20:57.140176 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:57.140138    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56017827-0fbc-4ae8-b507-e572be309dad-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5\" (UID: \"56017827-0fbc-4ae8-b507-e572be309dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"
Sep 10 22:20:57.141946 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:57.141913    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56017827-0fbc-4ae8-b507-e572be309dad-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5\" (UID: \"56017827-0fbc-4ae8-b507-e572be309dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"
Sep 10 22:20:57.142041 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:57.141954    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56017827-0fbc-4ae8-b507-e572be309dad-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5\" (UID: \"56017827-0fbc-4ae8-b507-e572be309dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"
Sep 10 22:20:57.156544 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:57.156518    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvb77\" (UniqueName: \"kubernetes.io/projected/56017827-0fbc-4ae8-b507-e572be309dad-kube-api-access-fvb77\") pod \"maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5\" (UID: \"56017827-0fbc-4ae8-b507-e572be309dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"
Sep 10 22:20:57.298164 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:57.298062    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"
Sep 10 22:20:57.580342 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:57.580316    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"]
Sep 10 22:20:57.581812 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:20:57.581748    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56017827_0fbc_4ae8_b507_e572be309dad.slice/crio-4189b25a6edb1881f03e7ea41d88d58bc6af09b9d4fe28f4aea6db9f47eef003 WatchSource:0}: Error finding container 4189b25a6edb1881f03e7ea41d88d58bc6af09b9d4fe28f4aea6db9f47eef003: Status 404 returned error can't find the container with id 4189b25a6edb1881f03e7ea41d88d58bc6af09b9d4fe28f4aea6db9f47eef003
Sep 10 22:20:58.522618 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:58.522581    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5" event={"ID":"56017827-0fbc-4ae8-b507-e572be309dad","Type":"ContainerStarted","Data":"8ba08ce7f79666b4c51155e25341911668b6e4aefeb1e0a3a2a5395a7a779d5c"}
Sep 10 22:20:58.523105 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:58.522636    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5" event={"ID":"56017827-0fbc-4ae8-b507-e572be309dad","Type":"ContainerStarted","Data":"4189b25a6edb1881f03e7ea41d88d58bc6af09b9d4fe28f4aea6db9f47eef003"}
Sep 10 22:20:58.523105 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:58.522659    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"
Sep 10 22:20:58.550627 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:58.550566    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5" podStartSLOduration=2.152328089 podStartE2EDuration="2.550545806s" totalImagesPullingTime="398.217717ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:20:58.547442536 +0000 UTC m=+1163.219540457" watchObservedRunningTime="2026-09-10 22:20:58.550545806 +0000 UTC m=+1163.222643726"
Sep 10 22:20:59.502505 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:20:59.502480    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"
Sep 10 22:21:04.534333 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:04.534301    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"
Sep 10 22:21:06.511968 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:06.511930    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 22:21:06.512375 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:06.511996    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw" podUID="09ff6320-60ea-4b7b-87d2-547a31866300" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 22:21:06.969534 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:06.969490    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:21:08.605284 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:08.605253    2577 generic.go:356] "Generic (PLEG): container finished" podID="09ff6320-60ea-4b7b-87d2-547a31866300" containerID="4c944970f7eca752d6c68b187864708d0c377a27524dec125307339427453e8e" exitCode=0
Sep 10 22:21:08.605755 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:08.605334    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw" event={"ID":"09ff6320-60ea-4b7b-87d2-547a31866300","Type":"ContainerDied","Data":"4c944970f7eca752d6c68b187864708d0c377a27524dec125307339427453e8e"}
Sep 10 22:21:08.605755 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:08.605744    2577 scope.go:117] "RemoveContainer" containerID="4c944970f7eca752d6c68b187864708d0c377a27524dec125307339427453e8e"
Sep 10 22:21:08.606890 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:08.606864    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:21:08.606959 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:08.606928    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:21:08.606995 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:08.606961    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:21:09.614393 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:09.614362    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw" event={"ID":"09ff6320-60ea-4b7b-87d2-547a31866300","Type":"ContainerStarted","Data":"f9a4882abfaf4799e29b74c4650ddd49978a38f281db125f451d69c4ab487a9a"}
Sep 10 22:21:09.670177 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:09.670140    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:21:09.670409 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:09.670385    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Sep 10 22:21:09.670455 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:09.670437    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw" podUID="09ff6320-60ea-4b7b-87d2-547a31866300" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Sep 10 22:21:10.670078 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:10.670027    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Sep 10 22:21:10.670509 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:10.670097    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw" podUID="09ff6320-60ea-4b7b-87d2-547a31866300" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Sep 10 22:21:11.670615 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:11.670576    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Sep 10 22:21:11.671058 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:11.670646    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw" podUID="09ff6320-60ea-4b7b-87d2-547a31866300" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Sep 10 22:21:12.670318 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:12.670279    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Sep 10 22:21:12.670513 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:12.670344    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw" podUID="09ff6320-60ea-4b7b-87d2-547a31866300" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Sep 10 22:21:13.670424 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:13.670388    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Sep 10 22:21:13.670846 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:13.670443    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw" podUID="09ff6320-60ea-4b7b-87d2-547a31866300" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Sep 10 22:21:14.670056 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:14.670019    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Sep 10 22:21:14.670252 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:14.670071    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw" podUID="09ff6320-60ea-4b7b-87d2-547a31866300" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Sep 10 22:21:15.673661 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:15.673631    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:21:15.674139 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:15.674100    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:21:15.674669 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:15.674650    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:21:16.220653 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:16.220619    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7508-3f2638"]
Sep 10 22:21:16.224292 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:16.224273    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-3f2638"
Sep 10 22:21:16.226525 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:16.226498    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-znq4v\""
Sep 10 22:21:16.230989 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:16.230958    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7508-3f2638"]
Sep 10 22:21:16.321011 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:16.320982    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx27q\" (UniqueName: \"kubernetes.io/projected/4ce20229-9275-4214-bcde-ed11527083ac-kube-api-access-hx27q\") pod \"test-curl-7508-3f2638\" (UID: \"4ce20229-9275-4214-bcde-ed11527083ac\") " pod="opendatahub/test-curl-7508-3f2638"
Sep 10 22:21:16.422342 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:16.422304    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx27q\" (UniqueName: \"kubernetes.io/projected/4ce20229-9275-4214-bcde-ed11527083ac-kube-api-access-hx27q\") pod \"test-curl-7508-3f2638\" (UID: \"4ce20229-9275-4214-bcde-ed11527083ac\") " pod="opendatahub/test-curl-7508-3f2638"
Sep 10 22:21:16.431900 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:16.431872    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx27q\" (UniqueName: \"kubernetes.io/projected/4ce20229-9275-4214-bcde-ed11527083ac-kube-api-access-hx27q\") pod \"test-curl-7508-3f2638\" (UID: \"4ce20229-9275-4214-bcde-ed11527083ac\") " pod="opendatahub/test-curl-7508-3f2638"
Sep 10 22:21:16.536153 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:16.536045    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-3f2638"
Sep 10 22:21:16.811725 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:16.811702    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7508-3f2638"]
Sep 10 22:21:16.813359 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:21:16.813335    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ce20229_9275_4214_bcde_ed11527083ac.slice/crio-af72a99e71fb09e77c3493a78ba2f311fc174a36c99f0d83a028c0dcdada5919 WatchSource:0}: Error finding container af72a99e71fb09e77c3493a78ba2f311fc174a36c99f0d83a028c0dcdada5919: Status 404 returned error can't find the container with id af72a99e71fb09e77c3493a78ba2f311fc174a36c99f0d83a028c0dcdada5919
Sep 10 22:21:17.673698 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:17.673658    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7508-3f2638" event={"ID":"4ce20229-9275-4214-bcde-ed11527083ac","Type":"ContainerStarted","Data":"af72a99e71fb09e77c3493a78ba2f311fc174a36c99f0d83a028c0dcdada5919"}
Sep 10 22:21:19.689451 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:19.689409    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7508-3f2638" event={"ID":"4ce20229-9275-4214-bcde-ed11527083ac","Type":"ContainerStarted","Data":"f14912804366cafc8308353f2711fdb508bed4e017af406e7502d88bafb22115"}
Sep 10 22:21:19.706383 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:19.706333    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7508-3f2638" podStartSLOduration=1.183521605 podStartE2EDuration="3.706318408s" totalImagesPullingTime="2.522796803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:21:19.704837677 +0000 UTC m=+1184.376935598" watchObservedRunningTime="2026-09-10 22:21:19.706318408 +0000 UTC m=+1184.378416328"
Sep 10 22:21:20.337337 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:20.337301    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7508-3f2638"]
Sep 10 22:21:20.344084 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:20.344053    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7508-3f2638"]
Sep 10 22:21:20.460808 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:20.460744    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7508-1e1281"]
Sep 10 22:21:20.461196 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:20.461181    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ce20229-9275-4214-bcde-ed11527083ac" containerName="test-curl-7508-3f2638"
Sep 10 22:21:20.461196 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:20.461196    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ce20229-9275-4214-bcde-ed11527083ac" containerName="test-curl-7508-3f2638"
Sep 10 22:21:20.461298 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:20.461259    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ce20229-9275-4214-bcde-ed11527083ac" containerName="test-curl-7508-3f2638"
Sep 10 22:21:20.464660 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:20.464639    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-1e1281"
Sep 10 22:21:20.468643 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:20.468610    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7508-1e1281"]
Sep 10 22:21:20.562466 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:20.562424    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgrmb\" (UniqueName: \"kubernetes.io/projected/d1606bc8-3934-470b-a1c0-04ab51d4a942-kube-api-access-fgrmb\") pod \"test-curl-7508-1e1281\" (UID: \"d1606bc8-3934-470b-a1c0-04ab51d4a942\") " pod="opendatahub/test-curl-7508-1e1281"
Sep 10 22:21:20.663115 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:20.663072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgrmb\" (UniqueName: \"kubernetes.io/projected/d1606bc8-3934-470b-a1c0-04ab51d4a942-kube-api-access-fgrmb\") pod \"test-curl-7508-1e1281\" (UID: \"d1606bc8-3934-470b-a1c0-04ab51d4a942\") " pod="opendatahub/test-curl-7508-1e1281"
Sep 10 22:21:20.672217 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:20.672180    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgrmb\" (UniqueName: \"kubernetes.io/projected/d1606bc8-3934-470b-a1c0-04ab51d4a942-kube-api-access-fgrmb\") pod \"test-curl-7508-1e1281\" (UID: \"d1606bc8-3934-470b-a1c0-04ab51d4a942\") " pod="opendatahub/test-curl-7508-1e1281"
Sep 10 22:21:20.695425 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:20.695399    2577 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7508-3f2638" container="test-curl-7508-3f2638"
Sep 10 22:21:20.775907 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:20.775823    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-1e1281"
Sep 10 22:21:21.054888 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:21.054847    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7508-1e1281"]
Sep 10 22:21:21.056577 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:21:21.056552    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1606bc8_3934_470b_a1c0_04ab51d4a942.slice/crio-01c5d16ddf7e9330697babff47070315260b1fbbcd516c667cc63c51379be02d WatchSource:0}: Error finding container 01c5d16ddf7e9330697babff47070315260b1fbbcd516c667cc63c51379be02d: Status 404 returned error can't find the container with id 01c5d16ddf7e9330697babff47070315260b1fbbcd516c667cc63c51379be02d
Sep 10 22:21:21.703194 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:21.703156    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7508-1e1281" event={"ID":"d1606bc8-3934-470b-a1c0-04ab51d4a942","Type":"ContainerStarted","Data":"012ee0b888f80693dc7c7ec001062aa946c3a746643a36aeeab61cff2fa24150"}
Sep 10 22:21:21.703194 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:21.703203    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7508-1e1281" event={"ID":"d1606bc8-3934-470b-a1c0-04ab51d4a942","Type":"ContainerStarted","Data":"01c5d16ddf7e9330697babff47070315260b1fbbcd516c667cc63c51379be02d"}
Sep 10 22:21:21.703710 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:21.703271    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7508-3f2638" podUID="4ce20229-9275-4214-bcde-ed11527083ac" containerName="test-curl-7508-3f2638" containerID="cri-o://f14912804366cafc8308353f2711fdb508bed4e017af406e7502d88bafb22115" gracePeriod=2
Sep 10 22:21:21.730885 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:21.730844    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-3f2638\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="4ce20229-9275-4214-bcde-ed11527083ac" pod="opendatahub/test-curl-7508-3f2638"
Sep 10 22:21:21.731062 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:21.730983    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7508-1e1281" podStartSLOduration=1.7309676139999999 podStartE2EDuration="1.730967614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:21:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:21:21.728270802 +0000 UTC m=+1186.400368724" watchObservedRunningTime="2026-09-10 22:21:21.730967614 +0000 UTC m=+1186.403065534"
Sep 10 22:21:21.732654 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:21.732631    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-3f2638\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="4ce20229-9275-4214-bcde-ed11527083ac" pod="opendatahub/test-curl-7508-3f2638"
Sep 10 22:21:22.376743 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:22.376649    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7508-1e1281"]
Sep 10 22:21:22.387097 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:22.387064    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7508-1e1281"]
Sep 10 22:21:22.502157 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:22.502120    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7508-552767"]
Sep 10 22:21:22.502569 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:22.502556    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1606bc8-3934-470b-a1c0-04ab51d4a942" containerName="test-curl-7508-1e1281"
Sep 10 22:21:22.502615 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:22.502571    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1606bc8-3934-470b-a1c0-04ab51d4a942" containerName="test-curl-7508-1e1281"
Sep 10 22:21:22.502654 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:22.502647    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1606bc8-3934-470b-a1c0-04ab51d4a942" containerName="test-curl-7508-1e1281"
Sep 10 22:21:22.505983 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:22.505968    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-552767"
Sep 10 22:21:22.510804 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:22.510761    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7508-552767"]
Sep 10 22:21:22.582039 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:22.581974    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64qkj\" (UniqueName: \"kubernetes.io/projected/0941e3bd-a75b-4862-82c9-0c589145892b-kube-api-access-64qkj\") pod \"test-curl-7508-552767\" (UID: \"0941e3bd-a75b-4862-82c9-0c589145892b\") " pod="opendatahub/test-curl-7508-552767"
Sep 10 22:21:22.683607 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:22.683569    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64qkj\" (UniqueName: \"kubernetes.io/projected/0941e3bd-a75b-4862-82c9-0c589145892b-kube-api-access-64qkj\") pod \"test-curl-7508-552767\" (UID: \"0941e3bd-a75b-4862-82c9-0c589145892b\") " pod="opendatahub/test-curl-7508-552767"
Sep 10 22:21:22.692830 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:22.692798    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64qkj\" (UniqueName: \"kubernetes.io/projected/0941e3bd-a75b-4862-82c9-0c589145892b-kube-api-access-64qkj\") pod \"test-curl-7508-552767\" (UID: \"0941e3bd-a75b-4862-82c9-0c589145892b\") " pod="opendatahub/test-curl-7508-552767"
Sep 10 22:21:22.709454 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:22.709427    2577 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7508-1e1281" container="test-curl-7508-1e1281"
Sep 10 22:21:22.817405 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:22.817360    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-552767"
Sep 10 22:21:23.093476 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:23.093447    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7508-552767"]
Sep 10 22:21:23.094929 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:21:23.094903    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0941e3bd_a75b_4862_82c9_0c589145892b.slice/crio-0c010f17f2b2ee77f23def7f3c6a8a3b2ad0e7188f58c4affe336ecf72f71349 WatchSource:0}: Error finding container 0c010f17f2b2ee77f23def7f3c6a8a3b2ad0e7188f58c4affe336ecf72f71349: Status 404 returned error can't find the container with id 0c010f17f2b2ee77f23def7f3c6a8a3b2ad0e7188f58c4affe336ecf72f71349
Sep 10 22:21:23.720138 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:23.720110    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7508-552767" event={"ID":"0941e3bd-a75b-4862-82c9-0c589145892b","Type":"ContainerStarted","Data":"0e98707d345cb363c374c018083ed315d6286c84a4e22e7736506c94d248f6b9"}
Sep 10 22:21:23.720463 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:23.720153    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7508-552767" event={"ID":"0941e3bd-a75b-4862-82c9-0c589145892b","Type":"ContainerStarted","Data":"0c010f17f2b2ee77f23def7f3c6a8a3b2ad0e7188f58c4affe336ecf72f71349"}
Sep 10 22:21:23.720463 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:23.720168    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7508-1e1281" podUID="d1606bc8-3934-470b-a1c0-04ab51d4a942" containerName="test-curl-7508-1e1281" containerID="cri-o://012ee0b888f80693dc7c7ec001062aa946c3a746643a36aeeab61cff2fa24150" gracePeriod=2
Sep 10 22:21:23.724511 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:23.724482    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-1e1281\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="d1606bc8-3934-470b-a1c0-04ab51d4a942" pod="opendatahub/test-curl-7508-1e1281"
Sep 10 22:21:23.756198 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:23.756159    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-1e1281\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="d1606bc8-3934-470b-a1c0-04ab51d4a942" pod="opendatahub/test-curl-7508-1e1281"
Sep 10 22:21:23.758810 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:23.758733    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7508-552767" podStartSLOduration=1.75871424 podStartE2EDuration="1.75871424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:21:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:21:23.754337718 +0000 UTC m=+1188.426435640" watchObservedRunningTime="2026-09-10 22:21:23.75871424 +0000 UTC m=+1188.430812162"
Sep 10 22:21:23.854882 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:23.854857    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-3f2638"
Sep 10 22:21:23.895878 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:23.895845    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx27q\" (UniqueName: \"kubernetes.io/projected/4ce20229-9275-4214-bcde-ed11527083ac-kube-api-access-hx27q\") pod \"4ce20229-9275-4214-bcde-ed11527083ac\" (UID: \"4ce20229-9275-4214-bcde-ed11527083ac\") "
Sep 10 22:21:23.898303 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:23.898272    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ce20229-9275-4214-bcde-ed11527083ac-kube-api-access-hx27q" (OuterVolumeSpecName: "kube-api-access-hx27q") pod "4ce20229-9275-4214-bcde-ed11527083ac" (UID: "4ce20229-9275-4214-bcde-ed11527083ac"). InnerVolumeSpecName "kube-api-access-hx27q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:21:23.997523 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:23.997446    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx27q\" (UniqueName: \"kubernetes.io/projected/4ce20229-9275-4214-bcde-ed11527083ac-kube-api-access-hx27q\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:21:24.337910 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:24.337813    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7508-552767"]
Sep 10 22:21:24.345125 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:24.345088    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7508-552767"]
Sep 10 22:21:24.463982 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:24.463945    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7508-0eb702"]
Sep 10 22:21:24.464398 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:24.464386    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0941e3bd-a75b-4862-82c9-0c589145892b" containerName="test-curl-7508-552767"
Sep 10 22:21:24.464447 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:24.464400    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0941e3bd-a75b-4862-82c9-0c589145892b" containerName="test-curl-7508-552767"
Sep 10 22:21:24.464487 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:24.464467    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0941e3bd-a75b-4862-82c9-0c589145892b" containerName="test-curl-7508-552767"
Sep 10 22:21:24.467600 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:24.467584    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-0eb702"
Sep 10 22:21:24.476500 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:24.476474    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7508-0eb702"]
Sep 10 22:21:24.503188 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:24.503148    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94p8l\" (UniqueName: \"kubernetes.io/projected/5b50268e-b3ef-4d8a-80d8-5d843b27e19c-kube-api-access-94p8l\") pod \"test-curl-7508-0eb702\" (UID: \"5b50268e-b3ef-4d8a-80d8-5d843b27e19c\") " pod="opendatahub/test-curl-7508-0eb702"
Sep 10 22:21:24.604658 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:24.604574    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94p8l\" (UniqueName: \"kubernetes.io/projected/5b50268e-b3ef-4d8a-80d8-5d843b27e19c-kube-api-access-94p8l\") pod \"test-curl-7508-0eb702\" (UID: \"5b50268e-b3ef-4d8a-80d8-5d843b27e19c\") " pod="opendatahub/test-curl-7508-0eb702"
Sep 10 22:21:24.614893 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:24.614863    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94p8l\" (UniqueName: \"kubernetes.io/projected/5b50268e-b3ef-4d8a-80d8-5d843b27e19c-kube-api-access-94p8l\") pod \"test-curl-7508-0eb702\" (UID: \"5b50268e-b3ef-4d8a-80d8-5d843b27e19c\") " pod="opendatahub/test-curl-7508-0eb702"
Sep 10 22:21:24.727950 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:24.727914    2577 generic.go:356] "Generic (PLEG): container finished" podID="4ce20229-9275-4214-bcde-ed11527083ac" containerID="f14912804366cafc8308353f2711fdb508bed4e017af406e7502d88bafb22115" exitCode=137
Sep 10 22:21:24.728409 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:24.727958    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-3f2638"
Sep 10 22:21:24.728409 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:24.728014    2577 scope.go:117] "RemoveContainer" containerID="f14912804366cafc8308353f2711fdb508bed4e017af406e7502d88bafb22115"
Sep 10 22:21:24.728409 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:24.728247    2577 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7508-552767" container="test-curl-7508-552767"
Sep 10 22:21:24.739005 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:24.738971    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-3f2638\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="4ce20229-9275-4214-bcde-ed11527083ac" pod="opendatahub/test-curl-7508-3f2638"
Sep 10 22:21:24.740146 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:24.740131    2577 scope.go:117] "RemoveContainer" containerID="f14912804366cafc8308353f2711fdb508bed4e017af406e7502d88bafb22115"
Sep 10 22:21:24.740430 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:24.740415    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f14912804366cafc8308353f2711fdb508bed4e017af406e7502d88bafb22115\": container with ID starting with f14912804366cafc8308353f2711fdb508bed4e017af406e7502d88bafb22115 not found: ID does not exist" containerID="f14912804366cafc8308353f2711fdb508bed4e017af406e7502d88bafb22115"
Sep 10 22:21:24.740494 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:24.740440    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f14912804366cafc8308353f2711fdb508bed4e017af406e7502d88bafb22115"} err="failed to get container status \"f14912804366cafc8308353f2711fdb508bed4e017af406e7502d88bafb22115\": rpc error: code = NotFound desc = could not find container \"f14912804366cafc8308353f2711fdb508bed4e017af406e7502d88bafb22115\": container with ID starting with f14912804366cafc8308353f2711fdb508bed4e017af406e7502d88bafb22115 not found: ID does not exist"
Sep 10 22:21:24.779072 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:24.779044    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-0eb702"
Sep 10 22:21:25.056004 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:25.055979    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7508-0eb702"]
Sep 10 22:21:25.057771 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:21:25.057741    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b50268e_b3ef_4d8a_80d8_5d843b27e19c.slice/crio-2cdeb6b6c3020604075fd18a2c262916f42c567aeb249598311df9492e6ff8b8 WatchSource:0}: Error finding container 2cdeb6b6c3020604075fd18a2c262916f42c567aeb249598311df9492e6ff8b8: Status 404 returned error can't find the container with id 2cdeb6b6c3020604075fd18a2c262916f42c567aeb249598311df9492e6ff8b8
Sep 10 22:21:25.736847 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:25.736760    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7508-0eb702" event={"ID":"5b50268e-b3ef-4d8a-80d8-5d843b27e19c","Type":"ContainerStarted","Data":"955daadb71781ebc180ef33610640973405b1bfc09458b07cf7e2f8c03c599ef"}
Sep 10 22:21:25.737248 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:25.736866    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7508-0eb702" event={"ID":"5b50268e-b3ef-4d8a-80d8-5d843b27e19c","Type":"ContainerStarted","Data":"2cdeb6b6c3020604075fd18a2c262916f42c567aeb249598311df9492e6ff8b8"}
Sep 10 22:21:25.737967 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:25.737942    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7508-552767" podUID="0941e3bd-a75b-4862-82c9-0c589145892b" containerName="test-curl-7508-552767" containerID="cri-o://0e98707d345cb363c374c018083ed315d6286c84a4e22e7736506c94d248f6b9" gracePeriod=2
Sep 10 22:21:25.773355 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:25.773319    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-3f2638\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="4ce20229-9275-4214-bcde-ed11527083ac" pod="opendatahub/test-curl-7508-3f2638"
Sep 10 22:21:25.774128 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:25.774085    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7508-0eb702" podStartSLOduration=1.774070473 podStartE2EDuration="1.774070473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:21:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:21:25.770146863 +0000 UTC m=+1190.442244784" watchObservedRunningTime="2026-09-10 22:21:25.774070473 +0000 UTC m=+1190.446168394"
Sep 10 22:21:25.778308 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:25.778276    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-552767\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="0941e3bd-a75b-4862-82c9-0c589145892b" pod="opendatahub/test-curl-7508-552767"
Sep 10 22:21:25.783328 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:25.783301    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-3f2638\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="4ce20229-9275-4214-bcde-ed11527083ac" pod="opendatahub/test-curl-7508-3f2638"
Sep 10 22:21:25.849444 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:25.849404    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-552767\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="0941e3bd-a75b-4862-82c9-0c589145892b" pod="opendatahub/test-curl-7508-552767"
Sep 10 22:21:25.850719 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:25.850692    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ce20229-9275-4214-bcde-ed11527083ac" path="/var/lib/kubelet/pods/4ce20229-9275-4214-bcde-ed11527083ac/volumes"
Sep 10 22:21:25.851303 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:25.851281    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-3f2638\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="4ce20229-9275-4214-bcde-ed11527083ac" pod="opendatahub/test-curl-7508-3f2638"
Sep 10 22:21:25.913857 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:25.913830    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-1e1281"
Sep 10 22:21:25.915863 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:25.915838    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-1e1281\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="d1606bc8-3934-470b-a1c0-04ab51d4a942" pod="opendatahub/test-curl-7508-1e1281"
Sep 10 22:21:26.020801 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:26.020683    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgrmb\" (UniqueName: \"kubernetes.io/projected/d1606bc8-3934-470b-a1c0-04ab51d4a942-kube-api-access-fgrmb\") pod \"d1606bc8-3934-470b-a1c0-04ab51d4a942\" (UID: \"d1606bc8-3934-470b-a1c0-04ab51d4a942\") "
Sep 10 22:21:26.023005 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:26.022984    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1606bc8-3934-470b-a1c0-04ab51d4a942-kube-api-access-fgrmb" (OuterVolumeSpecName: "kube-api-access-fgrmb") pod "d1606bc8-3934-470b-a1c0-04ab51d4a942" (UID: "d1606bc8-3934-470b-a1c0-04ab51d4a942"). InnerVolumeSpecName "kube-api-access-fgrmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:21:26.122011 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:26.121982    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgrmb\" (UniqueName: \"kubernetes.io/projected/d1606bc8-3934-470b-a1c0-04ab51d4a942-kube-api-access-fgrmb\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:21:26.350151 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:26.350060    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7508-0eb702"]
Sep 10 22:21:26.354113 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:26.354080    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7508-0eb702"]
Sep 10 22:21:26.745744 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:26.745705    2577 generic.go:356] "Generic (PLEG): container finished" podID="d1606bc8-3934-470b-a1c0-04ab51d4a942" containerID="012ee0b888f80693dc7c7ec001062aa946c3a746643a36aeeab61cff2fa24150" exitCode=137
Sep 10 22:21:26.746172 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:26.745750    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-1e1281"
Sep 10 22:21:26.746172 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:26.745820    2577 scope.go:117] "RemoveContainer" containerID="012ee0b888f80693dc7c7ec001062aa946c3a746643a36aeeab61cff2fa24150"
Sep 10 22:21:26.746172 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:26.746154    2577 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7508-0eb702" container="test-curl-7508-0eb702"
Sep 10 22:21:26.748332 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:26.748295    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-1e1281\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="d1606bc8-3934-470b-a1c0-04ab51d4a942" pod="opendatahub/test-curl-7508-1e1281"
Sep 10 22:21:26.755832 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:26.755812    2577 scope.go:117] "RemoveContainer" containerID="012ee0b888f80693dc7c7ec001062aa946c3a746643a36aeeab61cff2fa24150"
Sep 10 22:21:26.756120 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:26.756096    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"012ee0b888f80693dc7c7ec001062aa946c3a746643a36aeeab61cff2fa24150\": container with ID starting with 012ee0b888f80693dc7c7ec001062aa946c3a746643a36aeeab61cff2fa24150 not found: ID does not exist" containerID="012ee0b888f80693dc7c7ec001062aa946c3a746643a36aeeab61cff2fa24150"
Sep 10 22:21:26.756182 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:26.756126    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"012ee0b888f80693dc7c7ec001062aa946c3a746643a36aeeab61cff2fa24150"} err="failed to get container status \"012ee0b888f80693dc7c7ec001062aa946c3a746643a36aeeab61cff2fa24150\": rpc error: code = NotFound desc = could not find container \"012ee0b888f80693dc7c7ec001062aa946c3a746643a36aeeab61cff2fa24150\": container with ID starting with 012ee0b888f80693dc7c7ec001062aa946c3a746643a36aeeab61cff2fa24150 not found: ID does not exist"
Sep 10 22:21:26.757287 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:26.757262    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-1e1281\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="d1606bc8-3934-470b-a1c0-04ab51d4a942" pod="opendatahub/test-curl-7508-1e1281"
Sep 10 22:21:27.240029 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.240000    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"]
Sep 10 22:21:27.240450 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.240438    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b50268e-b3ef-4d8a-80d8-5d843b27e19c" containerName="test-curl-7508-0eb702"
Sep 10 22:21:27.240500 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.240452    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b50268e-b3ef-4d8a-80d8-5d843b27e19c" containerName="test-curl-7508-0eb702"
Sep 10 22:21:27.240536 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.240531    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b50268e-b3ef-4d8a-80d8-5d843b27e19c" containerName="test-curl-7508-0eb702"
Sep 10 22:21:27.245166 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.245146    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.247263 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:27.247236    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-1e1281\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="d1606bc8-3934-470b-a1c0-04ab51d4a942" pod="opendatahub/test-curl-7508-1e1281"
Sep 10 22:21:27.247455 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.247440    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-676c26ab-openshift-default-dockercfg-cfvtx\""
Sep 10 22:21:27.257829 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.257795    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"]
Sep 10 22:21:27.335326 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.335276    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-data\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.335522 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.335333    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-workload-socket\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.335522 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.335446    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-credential-socket\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.335522 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.335493    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-workload-certs\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.335701 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.335569    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-token\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.335701 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.335607    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istiod-ca-cert\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.335701 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.335675    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb7lj\" (UniqueName: \"kubernetes.io/projected/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-kube-api-access-hb7lj\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.335900 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.335731    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-envoy\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.335900 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.335792    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-podinfo\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.436559 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.436526    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-data\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.436559 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.436565    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-workload-socket\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.436849 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.436585    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-credential-socket\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.436849 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.436602    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-workload-certs\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.436849 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.436650    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-token\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.436849 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.436672    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istiod-ca-cert\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.436849 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.436749    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb7lj\" (UniqueName: \"kubernetes.io/projected/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-kube-api-access-hb7lj\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.436849 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.436800    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-envoy\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.436849 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.436830    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-podinfo\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.437193 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.437026    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-data\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.437509 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.437391    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-workload-certs\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.437509 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.437406    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-workload-socket\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.437509 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.437423    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istiod-ca-cert\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.437509 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.437468    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-credential-socket\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.439476 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.439446    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-envoy\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.439622 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.439601    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-podinfo\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.445038 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.445016    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb7lj\" (UniqueName: \"kubernetes.io/projected/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-kube-api-access-hb7lj\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.445240 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.445222    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-token\") pod \"e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") " pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.558213 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.558130    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:27.753585 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.753557    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7508-0eb702" podUID="5b50268e-b3ef-4d8a-80d8-5d843b27e19c" containerName="test-curl-7508-0eb702" containerID="cri-o://955daadb71781ebc180ef33610640973405b1bfc09458b07cf7e2f8c03c599ef" gracePeriod=2
Sep 10 22:21:27.755611 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:27.755582    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-0eb702\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="5b50268e-b3ef-4d8a-80d8-5d843b27e19c" pod="opendatahub/test-curl-7508-0eb702"
Sep 10 22:21:27.757233 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:27.757211    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-1e1281\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="d1606bc8-3934-470b-a1c0-04ab51d4a942" pod="opendatahub/test-curl-7508-1e1281"
Sep 10 22:21:27.840122 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.839997    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"]
Sep 10 22:21:27.843301 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:21:27.843259    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8af8f6e4_edcb_4e13_9117_6efc86a7e2ee.slice/crio-6ec5fd76076a6f3640b6c44119a71df113fd75ccdb3a366f915d8cacb54b6e36 WatchSource:0}: Error finding container 6ec5fd76076a6f3640b6c44119a71df113fd75ccdb3a366f915d8cacb54b6e36: Status 404 returned error can't find the container with id 6ec5fd76076a6f3640b6c44119a71df113fd75ccdb3a366f915d8cacb54b6e36
Sep 10 22:21:27.846187 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.846148    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:21:27.846312 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.846241    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:21:27.846312 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.846284    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:21:27.850942 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.850916    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1606bc8-3934-470b-a1c0-04ab51d4a942" path="/var/lib/kubelet/pods/d1606bc8-3934-470b-a1c0-04ab51d4a942/volumes"
Sep 10 22:21:27.930276 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:27.930252    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-552767"
Sep 10 22:21:28.044690 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:28.044648    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64qkj\" (UniqueName: \"kubernetes.io/projected/0941e3bd-a75b-4862-82c9-0c589145892b-kube-api-access-64qkj\") pod \"0941e3bd-a75b-4862-82c9-0c589145892b\" (UID: \"0941e3bd-a75b-4862-82c9-0c589145892b\") "
Sep 10 22:21:28.046962 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:28.046927    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0941e3bd-a75b-4862-82c9-0c589145892b-kube-api-access-64qkj" (OuterVolumeSpecName: "kube-api-access-64qkj") pod "0941e3bd-a75b-4862-82c9-0c589145892b" (UID: "0941e3bd-a75b-4862-82c9-0c589145892b"). InnerVolumeSpecName "kube-api-access-64qkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:21:28.145909 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:28.145877    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64qkj\" (UniqueName: \"kubernetes.io/projected/0941e3bd-a75b-4862-82c9-0c589145892b-kube-api-access-64qkj\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:21:28.761035 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:28.760946    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r" event={"ID":"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee","Type":"ContainerStarted","Data":"526937b34cb52ddd27a25f2416ba56dd08d2e41b5c005c84165a58316fa52cec"}
Sep 10 22:21:28.761035 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:28.760998    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r" event={"ID":"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee","Type":"ContainerStarted","Data":"6ec5fd76076a6f3640b6c44119a71df113fd75ccdb3a366f915d8cacb54b6e36"}
Sep 10 22:21:28.762306 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:28.762278    2577 generic.go:356] "Generic (PLEG): container finished" podID="0941e3bd-a75b-4862-82c9-0c589145892b" containerID="0e98707d345cb363c374c018083ed315d6286c84a4e22e7736506c94d248f6b9" exitCode=137
Sep 10 22:21:28.762409 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:28.762313    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-552767"
Sep 10 22:21:28.762409 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:28.762364    2577 scope.go:117] "RemoveContainer" containerID="0e98707d345cb363c374c018083ed315d6286c84a4e22e7736506c94d248f6b9"
Sep 10 22:21:28.774996 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:28.774977    2577 scope.go:117] "RemoveContainer" containerID="0e98707d345cb363c374c018083ed315d6286c84a4e22e7736506c94d248f6b9"
Sep 10 22:21:28.775275 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:28.775257    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e98707d345cb363c374c018083ed315d6286c84a4e22e7736506c94d248f6b9\": container with ID starting with 0e98707d345cb363c374c018083ed315d6286c84a4e22e7736506c94d248f6b9 not found: ID does not exist" containerID="0e98707d345cb363c374c018083ed315d6286c84a4e22e7736506c94d248f6b9"
Sep 10 22:21:28.775333 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:28.775285    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e98707d345cb363c374c018083ed315d6286c84a4e22e7736506c94d248f6b9"} err="failed to get container status \"0e98707d345cb363c374c018083ed315d6286c84a4e22e7736506c94d248f6b9\": rpc error: code = NotFound desc = could not find container \"0e98707d345cb363c374c018083ed315d6286c84a4e22e7736506c94d248f6b9\": container with ID starting with 0e98707d345cb363c374c018083ed315d6286c84a4e22e7736506c94d248f6b9 not found: ID does not exist"
Sep 10 22:21:28.787747 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:28.780540    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-552767\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="0941e3bd-a75b-4862-82c9-0c589145892b" pod="opendatahub/test-curl-7508-552767"
Sep 10 22:21:28.787747 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:28.783124    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r" podStartSLOduration=1.783102811 podStartE2EDuration="1.783102811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:21:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:21:28.778589384 +0000 UTC m=+1193.450687305" watchObservedRunningTime="2026-09-10 22:21:28.783102811 +0000 UTC m=+1193.455200732"
Sep 10 22:21:29.558925 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:29.558887    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:29.564122 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:29.564097    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:29.600187 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:29.600149    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-552767\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="0941e3bd-a75b-4862-82c9-0c589145892b" pod="opendatahub/test-curl-7508-552767"
Sep 10 22:21:29.769628 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:29.769607    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:29.770869 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:29.770848    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:21:29.772787 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:29.772753    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-552767\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="0941e3bd-a75b-4862-82c9-0c589145892b" pod="opendatahub/test-curl-7508-552767"
Sep 10 22:21:29.849315 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:29.849280    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0941e3bd-a75b-4862-82c9-0c589145892b" path="/var/lib/kubelet/pods/0941e3bd-a75b-4862-82c9-0c589145892b/volumes"
Sep 10 22:21:29.948945 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:29.948921    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-0eb702"
Sep 10 22:21:30.064085 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:30.063994    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94p8l\" (UniqueName: \"kubernetes.io/projected/5b50268e-b3ef-4d8a-80d8-5d843b27e19c-kube-api-access-94p8l\") pod \"5b50268e-b3ef-4d8a-80d8-5d843b27e19c\" (UID: \"5b50268e-b3ef-4d8a-80d8-5d843b27e19c\") "
Sep 10 22:21:30.066263 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:30.066237    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b50268e-b3ef-4d8a-80d8-5d843b27e19c-kube-api-access-94p8l" (OuterVolumeSpecName: "kube-api-access-94p8l") pod "5b50268e-b3ef-4d8a-80d8-5d843b27e19c" (UID: "5b50268e-b3ef-4d8a-80d8-5d843b27e19c"). InnerVolumeSpecName "kube-api-access-94p8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:21:30.164759 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:30.164727    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94p8l\" (UniqueName: \"kubernetes.io/projected/5b50268e-b3ef-4d8a-80d8-5d843b27e19c-kube-api-access-94p8l\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:21:30.776697 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:30.776664    2577 generic.go:356] "Generic (PLEG): container finished" podID="5b50268e-b3ef-4d8a-80d8-5d843b27e19c" containerID="955daadb71781ebc180ef33610640973405b1bfc09458b07cf7e2f8c03c599ef" exitCode=137
Sep 10 22:21:30.777209 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:30.776710    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7508-0eb702"
Sep 10 22:21:30.777209 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:30.776765    2577 scope.go:117] "RemoveContainer" containerID="955daadb71781ebc180ef33610640973405b1bfc09458b07cf7e2f8c03c599ef"
Sep 10 22:21:30.787011 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:30.786984    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-0eb702\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="5b50268e-b3ef-4d8a-80d8-5d843b27e19c" pod="opendatahub/test-curl-7508-0eb702"
Sep 10 22:21:30.787429 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:30.787412    2577 scope.go:117] "RemoveContainer" containerID="955daadb71781ebc180ef33610640973405b1bfc09458b07cf7e2f8c03c599ef"
Sep 10 22:21:30.787830 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:30.787800    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"955daadb71781ebc180ef33610640973405b1bfc09458b07cf7e2f8c03c599ef\": container with ID starting with 955daadb71781ebc180ef33610640973405b1bfc09458b07cf7e2f8c03c599ef not found: ID does not exist" containerID="955daadb71781ebc180ef33610640973405b1bfc09458b07cf7e2f8c03c599ef"
Sep 10 22:21:30.787922 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:30.787843    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"955daadb71781ebc180ef33610640973405b1bfc09458b07cf7e2f8c03c599ef"} err="failed to get container status \"955daadb71781ebc180ef33610640973405b1bfc09458b07cf7e2f8c03c599ef\": rpc error: code = NotFound desc = could not find container \"955daadb71781ebc180ef33610640973405b1bfc09458b07cf7e2f8c03c599ef\": container with ID starting with 955daadb71781ebc180ef33610640973405b1bfc09458b07cf7e2f8c03c599ef not found: ID does not exist"
Sep 10 22:21:31.847952 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:31.847912    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b50268e-b3ef-4d8a-80d8-5d843b27e19c" path="/var/lib/kubelet/pods/5b50268e-b3ef-4d8a-80d8-5d843b27e19c/volumes"
Sep 10 22:21:32.060146 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:32.060112    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"]
Sep 10 22:21:32.065353 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:32.065331    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"
Sep 10 22:21:32.067824 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:32.067799    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-676c26ab-serving-cert\""
Sep 10 22:21:32.087934 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:32.087902    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"]
Sep 10 22:21:32.183366 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:32.183324    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/afa6a97f-bf55-4476-9d13-34b99aec87b6-openshift-service-ca\") pod \"maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96\" (UID: \"afa6a97f-bf55-4476-9d13-34b99aec87b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"
Sep 10 22:21:32.183566 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:32.183482    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/afa6a97f-bf55-4476-9d13-34b99aec87b6-maas-api-tls\") pod \"maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96\" (UID: \"afa6a97f-bf55-4476-9d13-34b99aec87b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"
Sep 10 22:21:32.183629 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:32.183608    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss68s\" (UniqueName: \"kubernetes.io/projected/afa6a97f-bf55-4476-9d13-34b99aec87b6-kube-api-access-ss68s\") pod \"maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96\" (UID: \"afa6a97f-bf55-4476-9d13-34b99aec87b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"
Sep 10 22:21:32.183696 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:32.183681    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afa6a97f-bf55-4476-9d13-34b99aec87b6-metrics-certs\") pod \"maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96\" (UID: \"afa6a97f-bf55-4476-9d13-34b99aec87b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"
Sep 10 22:21:32.285032 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:32.285000    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss68s\" (UniqueName: \"kubernetes.io/projected/afa6a97f-bf55-4476-9d13-34b99aec87b6-kube-api-access-ss68s\") pod \"maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96\" (UID: \"afa6a97f-bf55-4476-9d13-34b99aec87b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"
Sep 10 22:21:32.285193 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:32.285046    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afa6a97f-bf55-4476-9d13-34b99aec87b6-metrics-certs\") pod \"maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96\" (UID: \"afa6a97f-bf55-4476-9d13-34b99aec87b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"
Sep 10 22:21:32.285193 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:32.285073    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/afa6a97f-bf55-4476-9d13-34b99aec87b6-openshift-service-ca\") pod \"maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96\" (UID: \"afa6a97f-bf55-4476-9d13-34b99aec87b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"
Sep 10 22:21:32.285287 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:32.285259    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/afa6a97f-bf55-4476-9d13-34b99aec87b6-maas-api-tls\") pod \"maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96\" (UID: \"afa6a97f-bf55-4476-9d13-34b99aec87b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"
Sep 10 22:21:32.285415 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:32.285392    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-serving-cert: secret "maas-api-e2e-mt-676c26ab-serving-cert" not found
Sep 10 22:21:32.285499 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:21:32.285486    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afa6a97f-bf55-4476-9d13-34b99aec87b6-maas-api-tls podName:afa6a97f-bf55-4476-9d13-34b99aec87b6 nodeName:}" failed. No retries permitted until 2026-09-10 22:21:32.785464117 +0000 UTC m=+1197.457562039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/afa6a97f-bf55-4476-9d13-34b99aec87b6-maas-api-tls") pod "maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96" (UID: "afa6a97f-bf55-4476-9d13-34b99aec87b6") : secret "maas-api-e2e-mt-676c26ab-serving-cert" not found
Sep 10 22:21:32.285806 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:32.285768    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/afa6a97f-bf55-4476-9d13-34b99aec87b6-openshift-service-ca\") pod \"maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96\" (UID: \"afa6a97f-bf55-4476-9d13-34b99aec87b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"
Sep 10 22:21:32.287794 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:32.287765    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afa6a97f-bf55-4476-9d13-34b99aec87b6-metrics-certs\") pod \"maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96\" (UID: \"afa6a97f-bf55-4476-9d13-34b99aec87b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"
Sep 10 22:21:32.293646 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:32.293623    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss68s\" (UniqueName: \"kubernetes.io/projected/afa6a97f-bf55-4476-9d13-34b99aec87b6-kube-api-access-ss68s\") pod \"maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96\" (UID: \"afa6a97f-bf55-4476-9d13-34b99aec87b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"
Sep 10 22:21:32.789767 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:32.789729    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/afa6a97f-bf55-4476-9d13-34b99aec87b6-maas-api-tls\") pod \"maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96\" (UID: \"afa6a97f-bf55-4476-9d13-34b99aec87b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"
Sep 10 22:21:32.792391 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:32.792369    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/afa6a97f-bf55-4476-9d13-34b99aec87b6-maas-api-tls\") pod \"maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96\" (UID: \"afa6a97f-bf55-4476-9d13-34b99aec87b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"
Sep 10 22:21:32.977662 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:32.977628    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"
Sep 10 22:21:33.255838 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:33.255806    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"]
Sep 10 22:21:33.257338 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:21:33.257306    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafa6a97f_bf55_4476_9d13_34b99aec87b6.slice/crio-b00e374e2fe09c9cc738452e8adb6f0eb329db1dba82016a989b7ffb714760c1 WatchSource:0}: Error finding container b00e374e2fe09c9cc738452e8adb6f0eb329db1dba82016a989b7ffb714760c1: Status 404 returned error can't find the container with id b00e374e2fe09c9cc738452e8adb6f0eb329db1dba82016a989b7ffb714760c1
Sep 10 22:21:33.807336 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:33.807303    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96" event={"ID":"afa6a97f-bf55-4476-9d13-34b99aec87b6","Type":"ContainerStarted","Data":"47b035bc4b4e224ee12e7ca687d4fe1894aeb84932ca32bd473ed1d1b4ab2101"}
Sep 10 22:21:33.807504 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:33.807391    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96" event={"ID":"afa6a97f-bf55-4476-9d13-34b99aec87b6","Type":"ContainerStarted","Data":"b00e374e2fe09c9cc738452e8adb6f0eb329db1dba82016a989b7ffb714760c1"}
Sep 10 22:21:33.807504 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:33.807419    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"
Sep 10 22:21:33.827280 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:33.827224    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96" podStartSLOduration=1.391538899 podStartE2EDuration="1.827207496s" totalImagesPullingTime="435.668597ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:21:33.823402493 +0000 UTC m=+1198.495500426" watchObservedRunningTime="2026-09-10 22:21:33.827207496 +0000 UTC m=+1198.499305417"
Sep 10 22:21:39.822204 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:39.822161    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"
Sep 10 22:21:39.887436 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:39.887399    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:21:42.106772 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:42.106734    2577 scope.go:117] "RemoveContainer" containerID="edb9f3274bb0c0eea57d44d269aff423591a5c092ef0d4ac259ff4209de1c599"
Sep 10 22:21:42.115926 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:42.115906    2577 scope.go:117] "RemoveContainer" containerID="39769c93b9a45b98c25bc787d7d74559d57712709261355e632b5dbcc78a80f3"
Sep 10 22:21:50.576345 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:21:50.576295    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:22:00.810999 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:00.810953    2577 patch_prober.go:28] interesting pod/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 22:22:00.811478 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:00.811036    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r" podUID="8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 22:22:03.008631 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:03.008599    2577 generic.go:356] "Generic (PLEG): container finished" podID="8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" containerID="526937b34cb52ddd27a25f2416ba56dd08d2e41b5c005c84165a58316fa52cec" exitCode=0
Sep 10 22:22:03.009127 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:03.008670    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r" event={"ID":"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee","Type":"ContainerDied","Data":"526937b34cb52ddd27a25f2416ba56dd08d2e41b5c005c84165a58316fa52cec"}
Sep 10 22:22:03.009127 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:03.009119    2577 scope.go:117] "RemoveContainer" containerID="526937b34cb52ddd27a25f2416ba56dd08d2e41b5c005c84165a58316fa52cec"
Sep 10 22:22:03.010318 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:03.010290    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:22:03.010378 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:03.010355    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:22:03.010422 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:03.010388    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:22:04.017808 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:04.017754    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r" event={"ID":"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee","Type":"ContainerStarted","Data":"f35a7b84221c8995385db79c752318629437ddc38ff9bac9231ee3cdd5ca4f15"}
Sep 10 22:22:04.559144 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:04.559110    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:22:04.559420 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:04.559397    2577 patch_prober.go:28] interesting pod/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 10 22:22:04.559523 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:04.559457    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r" podUID="8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 10 22:22:05.559969 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:05.559915    2577 patch_prober.go:28] interesting pod/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 10 22:22:05.560451 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:05.560010    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r" podUID="8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 10 22:22:06.558797 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:06.558731    2577 patch_prober.go:28] interesting pod/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 10 22:22:06.559007 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:06.558838    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r" podUID="8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 10 22:22:06.777516 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:06.777479    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:22:07.559289 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:07.559247    2577 patch_prober.go:28] interesting pod/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 10 22:22:07.559506 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:07.559333    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r" podUID="8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 10 22:22:08.559139 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:08.559090    2577 patch_prober.go:28] interesting pod/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 10 22:22:08.559679 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:08.559173    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r" podUID="8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 10 22:22:09.561968 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:09.561936    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:22:09.562536 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:09.562201    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:22:09.562933 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:09.562917    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:22:20.479855 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:20.479811    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:22:34.474831 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:34.474797    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:22:53.458240 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:22:53.458199    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:23:06.688287 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:06.688254    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"]
Sep 10 22:23:06.688801 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:06.688483    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96" podUID="afa6a97f-bf55-4476-9d13-34b99aec87b6" containerName="maas-api" containerID="cri-o://47b035bc4b4e224ee12e7ca687d4fe1894aeb84932ca32bd473ed1d1b4ab2101" gracePeriod=30
Sep 10 22:23:06.948790 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:06.948709    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"
Sep 10 22:23:07.035254 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:07.035217    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/afa6a97f-bf55-4476-9d13-34b99aec87b6-maas-api-tls\") pod \"afa6a97f-bf55-4476-9d13-34b99aec87b6\" (UID: \"afa6a97f-bf55-4476-9d13-34b99aec87b6\") "
Sep 10 22:23:07.035254 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:07.035259    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/afa6a97f-bf55-4476-9d13-34b99aec87b6-openshift-service-ca\") pod \"afa6a97f-bf55-4476-9d13-34b99aec87b6\" (UID: \"afa6a97f-bf55-4476-9d13-34b99aec87b6\") "
Sep 10 22:23:07.035513 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:07.035321    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ss68s\" (UniqueName: \"kubernetes.io/projected/afa6a97f-bf55-4476-9d13-34b99aec87b6-kube-api-access-ss68s\") pod \"afa6a97f-bf55-4476-9d13-34b99aec87b6\" (UID: \"afa6a97f-bf55-4476-9d13-34b99aec87b6\") "
Sep 10 22:23:07.035513 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:07.035340    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afa6a97f-bf55-4476-9d13-34b99aec87b6-metrics-certs\") pod \"afa6a97f-bf55-4476-9d13-34b99aec87b6\" (UID: \"afa6a97f-bf55-4476-9d13-34b99aec87b6\") "
Sep 10 22:23:07.036278 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:07.036239    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afa6a97f-bf55-4476-9d13-34b99aec87b6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "afa6a97f-bf55-4476-9d13-34b99aec87b6" (UID: "afa6a97f-bf55-4476-9d13-34b99aec87b6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:23:07.048196 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:07.048152    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afa6a97f-bf55-4476-9d13-34b99aec87b6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "afa6a97f-bf55-4476-9d13-34b99aec87b6" (UID: "afa6a97f-bf55-4476-9d13-34b99aec87b6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:23:07.050844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:07.050764    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afa6a97f-bf55-4476-9d13-34b99aec87b6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "afa6a97f-bf55-4476-9d13-34b99aec87b6" (UID: "afa6a97f-bf55-4476-9d13-34b99aec87b6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:23:07.051393 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:07.051367    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afa6a97f-bf55-4476-9d13-34b99aec87b6-kube-api-access-ss68s" (OuterVolumeSpecName: "kube-api-access-ss68s") pod "afa6a97f-bf55-4476-9d13-34b99aec87b6" (UID: "afa6a97f-bf55-4476-9d13-34b99aec87b6"). InnerVolumeSpecName "kube-api-access-ss68s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:23:07.136791 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:07.136730    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ss68s\" (UniqueName: \"kubernetes.io/projected/afa6a97f-bf55-4476-9d13-34b99aec87b6-kube-api-access-ss68s\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:23:07.136791 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:07.136761    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afa6a97f-bf55-4476-9d13-34b99aec87b6-metrics-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:23:07.136791 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:07.136771    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/afa6a97f-bf55-4476-9d13-34b99aec87b6-maas-api-tls\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:23:07.136791 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:07.136800    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/afa6a97f-bf55-4476-9d13-34b99aec87b6-openshift-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:23:07.438839 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:07.438773    2577 generic.go:356] "Generic (PLEG): container finished" podID="afa6a97f-bf55-4476-9d13-34b99aec87b6" containerID="47b035bc4b4e224ee12e7ca687d4fe1894aeb84932ca32bd473ed1d1b4ab2101" exitCode=0
Sep 10 22:23:07.439021 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:07.438865    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"
Sep 10 22:23:07.439021 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:07.438885    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96" event={"ID":"afa6a97f-bf55-4476-9d13-34b99aec87b6","Type":"ContainerDied","Data":"47b035bc4b4e224ee12e7ca687d4fe1894aeb84932ca32bd473ed1d1b4ab2101"}
Sep 10 22:23:07.439021 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:07.438964    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96" event={"ID":"afa6a97f-bf55-4476-9d13-34b99aec87b6","Type":"ContainerDied","Data":"b00e374e2fe09c9cc738452e8adb6f0eb329db1dba82016a989b7ffb714760c1"}
Sep 10 22:23:07.439021 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:07.438986    2577 scope.go:117] "RemoveContainer" containerID="47b035bc4b4e224ee12e7ca687d4fe1894aeb84932ca32bd473ed1d1b4ab2101"
Sep 10 22:23:07.449611 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:07.449590    2577 scope.go:117] "RemoveContainer" containerID="47b035bc4b4e224ee12e7ca687d4fe1894aeb84932ca32bd473ed1d1b4ab2101"
Sep 10 22:23:07.449912 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:23:07.449894    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47b035bc4b4e224ee12e7ca687d4fe1894aeb84932ca32bd473ed1d1b4ab2101\": container with ID starting with 47b035bc4b4e224ee12e7ca687d4fe1894aeb84932ca32bd473ed1d1b4ab2101 not found: ID does not exist" containerID="47b035bc4b4e224ee12e7ca687d4fe1894aeb84932ca32bd473ed1d1b4ab2101"
Sep 10 22:23:07.449981 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:07.449920    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47b035bc4b4e224ee12e7ca687d4fe1894aeb84932ca32bd473ed1d1b4ab2101"} err="failed to get container status \"47b035bc4b4e224ee12e7ca687d4fe1894aeb84932ca32bd473ed1d1b4ab2101\": rpc error: code = NotFound desc = could not find container \"47b035bc4b4e224ee12e7ca687d4fe1894aeb84932ca32bd473ed1d1b4ab2101\": container with ID starting with 47b035bc4b4e224ee12e7ca687d4fe1894aeb84932ca32bd473ed1d1b4ab2101 not found: ID does not exist"
Sep 10 22:23:07.460026 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:07.460003    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"]
Sep 10 22:23:07.463990 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:07.463964    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-676c26ab-6b4cc7cb6b-h4h96"]
Sep 10 22:23:07.848194 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:07.848103    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afa6a97f-bf55-4476-9d13-34b99aec87b6" path="/var/lib/kubelet/pods/afa6a97f-bf55-4476-9d13-34b99aec87b6/volumes"
Sep 10 22:23:12.259994 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:12.259946    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:23:30.101785 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:30.101731    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:23:42.167672 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:42.167639    2577 scope.go:117] "RemoveContainer" containerID="d3ffde2e4afe539b24f87e95e80d0f7c5da08c2d0966a2c16edb8a0f4c2271d4"
Sep 10 22:23:42.176793 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:42.176758    2577 scope.go:117] "RemoveContainer" containerID="ccb7c87070ab40e9468615a4552d9d0820c4cd314d131b826e85c0cccde33021"
Sep 10 22:23:42.185183 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:42.185162    2577 scope.go:117] "RemoveContainer" containerID="428be79da8bdd53019902bca1e2c92d7557a8f8605f49d7b25a22d10c76f0636"
Sep 10 22:23:46.471884 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:46.471853    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:23:59.241613 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:59.241531    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"]
Sep 10 22:23:59.242050 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:23:59.241797    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r" podUID="8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" containerName="istio-proxy" containerID="cri-o://f35a7b84221c8995385db79c752318629437ddc38ff9bac9231ee3cdd5ca4f15" gracePeriod=30
Sep 10 22:24:04.507274 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.507213    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:24:04.594218 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.594188    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istiod-ca-cert\") pod \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") "
Sep 10 22:24:04.594413 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.594256    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-workload-certs\") pod \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") "
Sep 10 22:24:04.594413 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.594286    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-data\") pod \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") "
Sep 10 22:24:04.594413 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.594308    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-envoy\") pod \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") "
Sep 10 22:24:04.594413 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.594327    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-workload-socket\") pod \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") "
Sep 10 22:24:04.594413 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.594360    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-token\") pod \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") "
Sep 10 22:24:04.594671 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.594417    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-credential-socket\") pod \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") "
Sep 10 22:24:04.594671 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.594460    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-podinfo\") pod \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") "
Sep 10 22:24:04.594671 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.594502    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hb7lj\" (UniqueName: \"kubernetes.io/projected/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-kube-api-access-hb7lj\") pod \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\" (UID: \"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee\") "
Sep 10 22:24:04.594671 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.594590    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-data" (OuterVolumeSpecName: "istio-data") pod "8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" (UID: "8af8f6e4-edcb-4e13-9117-6efc86a7e2ee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:24:04.594671 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.594642    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" (UID: "8af8f6e4-edcb-4e13-9117-6efc86a7e2ee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:24:04.594961 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.594752    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" (UID: "8af8f6e4-edcb-4e13-9117-6efc86a7e2ee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:24:04.595018 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.594997    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-credential-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:24:04.595077 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.595020    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istiod-ca-cert\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:24:04.595077 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.595024    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" (UID: "8af8f6e4-edcb-4e13-9117-6efc86a7e2ee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:24:04.595077 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.595035    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-data\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:24:04.595077 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.595040    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" (UID: "8af8f6e4-edcb-4e13-9117-6efc86a7e2ee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:24:04.597033 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.596997    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-kube-api-access-hb7lj" (OuterVolumeSpecName: "kube-api-access-hb7lj") pod "8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" (UID: "8af8f6e4-edcb-4e13-9117-6efc86a7e2ee"). InnerVolumeSpecName "kube-api-access-hb7lj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:24:04.597199 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.597152    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-token" (OuterVolumeSpecName: "istio-token") pod "8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" (UID: "8af8f6e4-edcb-4e13-9117-6efc86a7e2ee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:24:04.597450 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.597429    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" (UID: "8af8f6e4-edcb-4e13-9117-6efc86a7e2ee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:24:04.597450 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.597427    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" (UID: "8af8f6e4-edcb-4e13-9117-6efc86a7e2ee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:24:04.696055 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.696018    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-podinfo\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:24:04.696055 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.696049    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hb7lj\" (UniqueName: \"kubernetes.io/projected/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-kube-api-access-hb7lj\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:24:04.696055 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.696060    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-workload-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:24:04.696295 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.696068    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-envoy\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:24:04.696295 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.696076    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-workload-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:24:04.696295 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.696083    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee-istio-token\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:24:04.812273 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.812166    2577 generic.go:356] "Generic (PLEG): container finished" podID="8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" containerID="f35a7b84221c8995385db79c752318629437ddc38ff9bac9231ee3cdd5ca4f15" exitCode=0
Sep 10 22:24:04.812273 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.812215    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"
Sep 10 22:24:04.812483 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.812274    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r" event={"ID":"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee","Type":"ContainerDied","Data":"f35a7b84221c8995385db79c752318629437ddc38ff9bac9231ee3cdd5ca4f15"}
Sep 10 22:24:04.812483 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.812329    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r" event={"ID":"8af8f6e4-edcb-4e13-9117-6efc86a7e2ee","Type":"ContainerDied","Data":"6ec5fd76076a6f3640b6c44119a71df113fd75ccdb3a366f915d8cacb54b6e36"}
Sep 10 22:24:04.812483 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.812351    2577 scope.go:117] "RemoveContainer" containerID="f35a7b84221c8995385db79c752318629437ddc38ff9bac9231ee3cdd5ca4f15"
Sep 10 22:24:04.822711 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.822687    2577 scope.go:117] "RemoveContainer" containerID="526937b34cb52ddd27a25f2416ba56dd08d2e41b5c005c84165a58316fa52cec"
Sep 10 22:24:04.832728 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.832701    2577 scope.go:117] "RemoveContainer" containerID="f35a7b84221c8995385db79c752318629437ddc38ff9bac9231ee3cdd5ca4f15"
Sep 10 22:24:04.833126 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:24:04.833106    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f35a7b84221c8995385db79c752318629437ddc38ff9bac9231ee3cdd5ca4f15\": container with ID starting with f35a7b84221c8995385db79c752318629437ddc38ff9bac9231ee3cdd5ca4f15 not found: ID does not exist" containerID="f35a7b84221c8995385db79c752318629437ddc38ff9bac9231ee3cdd5ca4f15"
Sep 10 22:24:04.833202 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.833135    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f35a7b84221c8995385db79c752318629437ddc38ff9bac9231ee3cdd5ca4f15"} err="failed to get container status \"f35a7b84221c8995385db79c752318629437ddc38ff9bac9231ee3cdd5ca4f15\": rpc error: code = NotFound desc = could not find container \"f35a7b84221c8995385db79c752318629437ddc38ff9bac9231ee3cdd5ca4f15\": container with ID starting with f35a7b84221c8995385db79c752318629437ddc38ff9bac9231ee3cdd5ca4f15 not found: ID does not exist"
Sep 10 22:24:04.833202 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.833155    2577 scope.go:117] "RemoveContainer" containerID="526937b34cb52ddd27a25f2416ba56dd08d2e41b5c005c84165a58316fa52cec"
Sep 10 22:24:04.833448 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:24:04.833429    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"526937b34cb52ddd27a25f2416ba56dd08d2e41b5c005c84165a58316fa52cec\": container with ID starting with 526937b34cb52ddd27a25f2416ba56dd08d2e41b5c005c84165a58316fa52cec not found: ID does not exist" containerID="526937b34cb52ddd27a25f2416ba56dd08d2e41b5c005c84165a58316fa52cec"
Sep 10 22:24:04.833505 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.833462    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"526937b34cb52ddd27a25f2416ba56dd08d2e41b5c005c84165a58316fa52cec"} err="failed to get container status \"526937b34cb52ddd27a25f2416ba56dd08d2e41b5c005c84165a58316fa52cec\": rpc error: code = NotFound desc = could not find container \"526937b34cb52ddd27a25f2416ba56dd08d2e41b5c005c84165a58316fa52cec\": container with ID starting with 526937b34cb52ddd27a25f2416ba56dd08d2e41b5c005c84165a58316fa52cec not found: ID does not exist"
Sep 10 22:24:04.835027 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.835005    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"]
Sep 10 22:24:04.840002 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:04.839964    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-676c26ab-openshift-default-5b6d4c669b-wkb9r"]
Sep 10 22:24:05.849050 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:05.849016    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" path="/var/lib/kubelet/pods/8af8f6e4-edcb-4e13-9117-6efc86a7e2ee/volumes"
Sep 10 22:24:06.036795 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:06.036735    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:24:18.556151 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:18.556110    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:24:21.593766 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:21.593734    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7511-1834ee"]
Sep 10 22:24:21.594188 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:21.594165    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa6a97f-bf55-4476-9d13-34b99aec87b6" containerName="maas-api"
Sep 10 22:24:21.594188 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:21.594178    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa6a97f-bf55-4476-9d13-34b99aec87b6" containerName="maas-api"
Sep 10 22:24:21.594188 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:21.594189    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" containerName="istio-proxy"
Sep 10 22:24:21.594322 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:21.594194    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" containerName="istio-proxy"
Sep 10 22:24:21.594322 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:21.594285    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="afa6a97f-bf55-4476-9d13-34b99aec87b6" containerName="maas-api"
Sep 10 22:24:21.594322 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:21.594297    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" containerName="istio-proxy"
Sep 10 22:24:21.594322 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:21.594302    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" containerName="istio-proxy"
Sep 10 22:24:21.598964 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:21.598947    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7511-1834ee"
Sep 10 22:24:21.601206 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:21.601180    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-znq4v\""
Sep 10 22:24:21.604289 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:21.604263    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7511-1834ee"]
Sep 10 22:24:21.766066 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:21.766033    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv4x9\" (UniqueName: \"kubernetes.io/projected/427c0503-35c9-4fbe-bac5-4885f3913cd6-kube-api-access-rv4x9\") pod \"test-curl-7511-1834ee\" (UID: \"427c0503-35c9-4fbe-bac5-4885f3913cd6\") " pod="opendatahub/test-curl-7511-1834ee"
Sep 10 22:24:21.867277 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:21.867188    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv4x9\" (UniqueName: \"kubernetes.io/projected/427c0503-35c9-4fbe-bac5-4885f3913cd6-kube-api-access-rv4x9\") pod \"test-curl-7511-1834ee\" (UID: \"427c0503-35c9-4fbe-bac5-4885f3913cd6\") " pod="opendatahub/test-curl-7511-1834ee"
Sep 10 22:24:21.875240 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:21.875208    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv4x9\" (UniqueName: \"kubernetes.io/projected/427c0503-35c9-4fbe-bac5-4885f3913cd6-kube-api-access-rv4x9\") pod \"test-curl-7511-1834ee\" (UID: \"427c0503-35c9-4fbe-bac5-4885f3913cd6\") " pod="opendatahub/test-curl-7511-1834ee"
Sep 10 22:24:21.910765 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:21.910733    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7511-1834ee"
Sep 10 22:24:22.182453 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:22.182419    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7511-1834ee"]
Sep 10 22:24:22.185651 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:24:22.185629    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod427c0503_35c9_4fbe_bac5_4885f3913cd6.slice/crio-7356d1552b9f0cba132786d2c81776546696a266466c10658ea5ebbd7cd8a8a1 WatchSource:0}: Error finding container 7356d1552b9f0cba132786d2c81776546696a266466c10658ea5ebbd7cd8a8a1: Status 404 returned error can't find the container with id 7356d1552b9f0cba132786d2c81776546696a266466c10658ea5ebbd7cd8a8a1
Sep 10 22:24:22.930374 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:22.930345    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7511-1834ee" event={"ID":"427c0503-35c9-4fbe-bac5-4885f3913cd6","Type":"ContainerStarted","Data":"3e4fe27f43f35bcd21c31dc542cd6111285a29cdc645ac52456a4eb110375e0f"}
Sep 10 22:24:22.930795 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:22.930382    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7511-1834ee" event={"ID":"427c0503-35c9-4fbe-bac5-4885f3913cd6","Type":"ContainerStarted","Data":"7356d1552b9f0cba132786d2c81776546696a266466c10658ea5ebbd7cd8a8a1"}
Sep 10 22:24:22.945765 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:22.945712    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7511-1834ee" podStartSLOduration=1.945696704 podStartE2EDuration="1.945696704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:24:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:24:22.943650497 +0000 UTC m=+1367.615748419" watchObservedRunningTime="2026-09-10 22:24:22.945696704 +0000 UTC m=+1367.617794625"
Sep 10 22:24:23.529644 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:23.529605    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7511-1834ee"]
Sep 10 22:24:23.533491 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:23.533457    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7511-1834ee"]
Sep 10 22:24:23.936688 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:24:23.936649    2577 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7511-1834ee" container="test-curl-7511-1834ee"
Sep 10 22:24:24.943032 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:24.942996    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7511-1834ee" podUID="427c0503-35c9-4fbe-bac5-4885f3913cd6" containerName="test-curl-7511-1834ee" containerID="cri-o://3e4fe27f43f35bcd21c31dc542cd6111285a29cdc645ac52456a4eb110375e0f" gracePeriod=2
Sep 10 22:24:27.132790 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:27.132758    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7511-1834ee"
Sep 10 22:24:27.221921 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:27.221822    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rv4x9\" (UniqueName: \"kubernetes.io/projected/427c0503-35c9-4fbe-bac5-4885f3913cd6-kube-api-access-rv4x9\") pod \"427c0503-35c9-4fbe-bac5-4885f3913cd6\" (UID: \"427c0503-35c9-4fbe-bac5-4885f3913cd6\") "
Sep 10 22:24:27.224181 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:27.224156    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/427c0503-35c9-4fbe-bac5-4885f3913cd6-kube-api-access-rv4x9" (OuterVolumeSpecName: "kube-api-access-rv4x9") pod "427c0503-35c9-4fbe-bac5-4885f3913cd6" (UID: "427c0503-35c9-4fbe-bac5-4885f3913cd6"). InnerVolumeSpecName "kube-api-access-rv4x9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:24:27.322615 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:27.322580    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rv4x9\" (UniqueName: \"kubernetes.io/projected/427c0503-35c9-4fbe-bac5-4885f3913cd6-kube-api-access-rv4x9\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:24:27.847979 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:27.847947    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="427c0503-35c9-4fbe-bac5-4885f3913cd6" path="/var/lib/kubelet/pods/427c0503-35c9-4fbe-bac5-4885f3913cd6/volumes"
Sep 10 22:24:27.961872 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:27.961837    2577 generic.go:356] "Generic (PLEG): container finished" podID="427c0503-35c9-4fbe-bac5-4885f3913cd6" containerID="3e4fe27f43f35bcd21c31dc542cd6111285a29cdc645ac52456a4eb110375e0f" exitCode=137
Sep 10 22:24:27.962060 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:27.961884    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7511-1834ee"
Sep 10 22:24:27.962060 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:27.961951    2577 scope.go:117] "RemoveContainer" containerID="3e4fe27f43f35bcd21c31dc542cd6111285a29cdc645ac52456a4eb110375e0f"
Sep 10 22:24:27.971794 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:27.971756    2577 scope.go:117] "RemoveContainer" containerID="3e4fe27f43f35bcd21c31dc542cd6111285a29cdc645ac52456a4eb110375e0f"
Sep 10 22:24:27.972156 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:24:27.972134    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e4fe27f43f35bcd21c31dc542cd6111285a29cdc645ac52456a4eb110375e0f\": container with ID starting with 3e4fe27f43f35bcd21c31dc542cd6111285a29cdc645ac52456a4eb110375e0f not found: ID does not exist" containerID="3e4fe27f43f35bcd21c31dc542cd6111285a29cdc645ac52456a4eb110375e0f"
Sep 10 22:24:27.972215 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:27.972169    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e4fe27f43f35bcd21c31dc542cd6111285a29cdc645ac52456a4eb110375e0f"} err="failed to get container status \"3e4fe27f43f35bcd21c31dc542cd6111285a29cdc645ac52456a4eb110375e0f\": rpc error: code = NotFound desc = could not find container \"3e4fe27f43f35bcd21c31dc542cd6111285a29cdc645ac52456a4eb110375e0f\": container with ID starting with 3e4fe27f43f35bcd21c31dc542cd6111285a29cdc645ac52456a4eb110375e0f not found: ID does not exist"
Sep 10 22:24:30.656444 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:30.656405    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:24:40.662121 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:40.662080    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:24:59.005937 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.005903    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"]
Sep 10 22:24:59.006412 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.006327    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="427c0503-35c9-4fbe-bac5-4885f3913cd6" containerName="test-curl-7511-1834ee"
Sep 10 22:24:59.006412 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.006340    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="427c0503-35c9-4fbe-bac5-4885f3913cd6" containerName="test-curl-7511-1834ee"
Sep 10 22:24:59.006412 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.006360    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" containerName="istio-proxy"
Sep 10 22:24:59.006412 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.006366    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8af8f6e4-edcb-4e13-9117-6efc86a7e2ee" containerName="istio-proxy"
Sep 10 22:24:59.006671 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.006451    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="427c0503-35c9-4fbe-bac5-4885f3913cd6" containerName="test-curl-7511-1834ee"
Sep 10 22:24:59.011028 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.011005    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.013622 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.013596    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-9c0e33-openshift-default-dockercfg-shqxm\""
Sep 10 22:24:59.029136 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.029104    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"]
Sep 10 22:24:59.125895 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.125858    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-podinfo\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.125895 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.125899    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-workload-socket\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.126111 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.125991    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-token\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.126111 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.126022    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-workload-certs\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.126111 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.126057    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istiod-ca-cert\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.126227 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.126129    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-envoy\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.126227 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.126185    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-credential-socket\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.126292 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.126246    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5zds\" (UniqueName: \"kubernetes.io/projected/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-kube-api-access-l5zds\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.126292 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.126282    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-data\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.227987 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.227933    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-podinfo\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.228186 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.227995    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-workload-socket\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.228186 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.228069    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-token\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.228186 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.228101    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-workload-certs\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.228186 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.228147    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istiod-ca-cert\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.228421 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.228194    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-envoy\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.228421 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.228235    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-credential-socket\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.228421 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.228289    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5zds\" (UniqueName: \"kubernetes.io/projected/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-kube-api-access-l5zds\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.228421 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.228317    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-data\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.228884 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.228732    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-workload-certs\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.229026 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.228982    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-credential-socket\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.229115 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.229091    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-data\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.229326 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.229302    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-workload-socket\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.229399 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.229324    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istiod-ca-cert\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.230876 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.230840    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-podinfo\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.230979 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.230877    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-envoy\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.235618 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.235587    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-token\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.236729 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.236705    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5zds\" (UniqueName: \"kubernetes.io/projected/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-kube-api-access-l5zds\") pod \"e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") " pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.322011 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.321924    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:24:59.604677 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.604650    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"]
Sep 10 22:24:59.606533 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:24:59.606492    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a78fe8_89bb_4e13_b7f5_c7e469471d7d.slice/crio-5c5d76d8290ecff1a424c37605ef0c8cd736d5d952e4ebd29019cba86cd47810 WatchSource:0}: Error finding container 5c5d76d8290ecff1a424c37605ef0c8cd736d5d952e4ebd29019cba86cd47810: Status 404 returned error can't find the container with id 5c5d76d8290ecff1a424c37605ef0c8cd736d5d952e4ebd29019cba86cd47810
Sep 10 22:24:59.608826 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.608763    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:24:59.608933 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.608860    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:24:59.608933 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:24:59.608896    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:25:00.152683 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:00.152641    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm" event={"ID":"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d","Type":"ContainerStarted","Data":"4513a7f64fae6c6e7c1922189255ec213a587ee207238a6fd2d9c91e3e4a7cc8"}
Sep 10 22:25:00.153082 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:00.152709    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm" event={"ID":"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d","Type":"ContainerStarted","Data":"5c5d76d8290ecff1a424c37605ef0c8cd736d5d952e4ebd29019cba86cd47810"}
Sep 10 22:25:00.174030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:00.173978    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm" podStartSLOduration=2.17396307 podStartE2EDuration="2.17396307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:24:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:25:00.172562129 +0000 UTC m=+1404.844660052" watchObservedRunningTime="2026-09-10 22:25:00.17396307 +0000 UTC m=+1404.846060991"
Sep 10 22:25:00.322764 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:00.322729    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:25:00.329223 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:00.329195    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:25:01.158750 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:01.158720    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:25:01.159851 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:01.159830    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:25:03.275158 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:03.275094    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"]
Sep 10 22:25:03.282009 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:03.281982    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"]
Sep 10 22:25:03.282190 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:03.282091    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"
Sep 10 22:25:03.284630 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:03.284603    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-9c0e33-serving-cert\""
Sep 10 22:25:03.374483 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:03.374414    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12c1f600-3152-461e-b550-d4cee7101df1-metrics-certs\") pod \"maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt\" (UID: \"12c1f600-3152-461e-b550-d4cee7101df1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"
Sep 10 22:25:03.374839 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:03.374812    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12c1f600-3152-461e-b550-d4cee7101df1-maas-api-tls\") pod \"maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt\" (UID: \"12c1f600-3152-461e-b550-d4cee7101df1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"
Sep 10 22:25:03.374985 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:03.374852    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12c1f600-3152-461e-b550-d4cee7101df1-openshift-service-ca\") pod \"maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt\" (UID: \"12c1f600-3152-461e-b550-d4cee7101df1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"
Sep 10 22:25:03.374985 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:03.374939    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfnkc\" (UniqueName: \"kubernetes.io/projected/12c1f600-3152-461e-b550-d4cee7101df1-kube-api-access-tfnkc\") pod \"maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt\" (UID: \"12c1f600-3152-461e-b550-d4cee7101df1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"
Sep 10 22:25:03.476578 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:03.476534    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfnkc\" (UniqueName: \"kubernetes.io/projected/12c1f600-3152-461e-b550-d4cee7101df1-kube-api-access-tfnkc\") pod \"maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt\" (UID: \"12c1f600-3152-461e-b550-d4cee7101df1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"
Sep 10 22:25:03.476768 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:03.476676    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12c1f600-3152-461e-b550-d4cee7101df1-metrics-certs\") pod \"maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt\" (UID: \"12c1f600-3152-461e-b550-d4cee7101df1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"
Sep 10 22:25:03.476768 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:03.476703    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12c1f600-3152-461e-b550-d4cee7101df1-maas-api-tls\") pod \"maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt\" (UID: \"12c1f600-3152-461e-b550-d4cee7101df1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"
Sep 10 22:25:03.476768 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:03.476726    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12c1f600-3152-461e-b550-d4cee7101df1-openshift-service-ca\") pod \"maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt\" (UID: \"12c1f600-3152-461e-b550-d4cee7101df1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"
Sep 10 22:25:03.476980 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:25:03.476853    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-serving-cert: secret "maas-api-e2e-api-a-9c0e33-serving-cert" not found
Sep 10 22:25:03.476980 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:25:03.476932    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12c1f600-3152-461e-b550-d4cee7101df1-maas-api-tls podName:12c1f600-3152-461e-b550-d4cee7101df1 nodeName:}" failed. No retries permitted until 2026-09-10 22:25:03.976910077 +0000 UTC m=+1408.649007979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/12c1f600-3152-461e-b550-d4cee7101df1-maas-api-tls") pod "maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt" (UID: "12c1f600-3152-461e-b550-d4cee7101df1") : secret "maas-api-e2e-api-a-9c0e33-serving-cert" not found
Sep 10 22:25:03.477498 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:03.477477    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12c1f600-3152-461e-b550-d4cee7101df1-openshift-service-ca\") pod \"maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt\" (UID: \"12c1f600-3152-461e-b550-d4cee7101df1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"
Sep 10 22:25:03.479294 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:03.479276    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12c1f600-3152-461e-b550-d4cee7101df1-metrics-certs\") pod \"maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt\" (UID: \"12c1f600-3152-461e-b550-d4cee7101df1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"
Sep 10 22:25:03.489473 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:03.489448    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfnkc\" (UniqueName: \"kubernetes.io/projected/12c1f600-3152-461e-b550-d4cee7101df1-kube-api-access-tfnkc\") pod \"maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt\" (UID: \"12c1f600-3152-461e-b550-d4cee7101df1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"
Sep 10 22:25:03.982079 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:03.982042    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12c1f600-3152-461e-b550-d4cee7101df1-maas-api-tls\") pod \"maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt\" (UID: \"12c1f600-3152-461e-b550-d4cee7101df1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"
Sep 10 22:25:03.984688 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:03.984657    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12c1f600-3152-461e-b550-d4cee7101df1-maas-api-tls\") pod \"maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt\" (UID: \"12c1f600-3152-461e-b550-d4cee7101df1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"
Sep 10 22:25:04.198032 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:04.197995    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"
Sep 10 22:25:04.506364 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:04.506338    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"]
Sep 10 22:25:04.507974 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:25:04.507947    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12c1f600_3152_461e_b550_d4cee7101df1.slice/crio-dd04e9c95e30b6f57d9f778e78d2eca54f92dfdd2f67310638abcaeedabca395 WatchSource:0}: Error finding container dd04e9c95e30b6f57d9f778e78d2eca54f92dfdd2f67310638abcaeedabca395: Status 404 returned error can't find the container with id dd04e9c95e30b6f57d9f778e78d2eca54f92dfdd2f67310638abcaeedabca395
Sep 10 22:25:04.509573 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:04.509554    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 22:25:05.189697 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:05.189656    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt" event={"ID":"12c1f600-3152-461e-b550-d4cee7101df1","Type":"ContainerStarted","Data":"7c3e3ddb55853f0e62cd222f60b5ea483193e9b7d749a4ba119da6390b676861"}
Sep 10 22:25:05.189894 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:05.189734    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"
Sep 10 22:25:05.189894 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:05.189763    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt" event={"ID":"12c1f600-3152-461e-b550-d4cee7101df1","Type":"ContainerStarted","Data":"dd04e9c95e30b6f57d9f778e78d2eca54f92dfdd2f67310638abcaeedabca395"}
Sep 10 22:25:05.209198 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:05.209145    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt" podStartSLOduration=1.7439795299999998 podStartE2EDuration="2.209128059s" totalImagesPullingTime="465.148529ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:25:05.206872095 +0000 UTC m=+1409.878970018" watchObservedRunningTime="2026-09-10 22:25:05.209128059 +0000 UTC m=+1409.881226022"
Sep 10 22:25:11.200821 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:11.200771    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"
Sep 10 22:25:12.662599 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:12.662564    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:25:23.319973 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:23.319941    2577 generic.go:356] "Generic (PLEG): container finished" podID="d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" containerID="4513a7f64fae6c6e7c1922189255ec213a587ee207238a6fd2d9c91e3e4a7cc8" exitCode=0
Sep 10 22:25:23.320380 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:23.320015    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm" event={"ID":"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d","Type":"ContainerDied","Data":"4513a7f64fae6c6e7c1922189255ec213a587ee207238a6fd2d9c91e3e4a7cc8"}
Sep 10 22:25:23.320515 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:23.320495    2577 scope.go:117] "RemoveContainer" containerID="4513a7f64fae6c6e7c1922189255ec213a587ee207238a6fd2d9c91e3e4a7cc8"
Sep 10 22:25:23.321674 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:23.321647    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:25:23.321722 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:23.321715    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:25:23.321760 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:23.321746    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:25:24.328135 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:24.328104    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm" event={"ID":"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d","Type":"ContainerStarted","Data":"469851a5da1b4b84b1337f75076b147adace1f772422157f1dc727ef37fd9829"}
Sep 10 22:25:25.322387 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:25.322348    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:25:25.322703 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:25.322681    2577 patch_prober.go:28] interesting pod/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Sep 10 22:25:25.322760 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:25.322736    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm" podUID="d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Sep 10 22:25:26.323313 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:26.323271    2577 patch_prober.go:28] interesting pod/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Sep 10 22:25:26.323720 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:26.323357    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm" podUID="d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Sep 10 22:25:27.322399 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:27.322361    2577 patch_prober.go:28] interesting pod/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Sep 10 22:25:27.322598 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:27.322433    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm" podUID="d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Sep 10 22:25:27.886728 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:27.886686    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"]
Sep 10 22:25:27.889272 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:27.889249    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:27.896504 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:27.896480    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-c142c5-openshift-default-dockercfg-t8qgq\""
Sep 10 22:25:27.907015 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:27.906987    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"]
Sep 10 22:25:28.029248 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.029206    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-workload-certs\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.029248 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.029254    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-podinfo\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.029522 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.029352    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istiod-ca-cert\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.029522 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.029401    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-credential-socket\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.029522 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.029474    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-token\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.029522 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.029522    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-data\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.029689 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.029550    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-envoy\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.029689 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.029567    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxm4b\" (UniqueName: \"kubernetes.io/projected/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-kube-api-access-kxm4b\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.029689 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.029588    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-workload-socket\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.130671 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.130626    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-workload-certs\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.130671 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.130677    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-podinfo\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.130967 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.130743    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istiod-ca-cert\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.130967 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.130771    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-credential-socket\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.130967 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.130856    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-token\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.130967 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.130909    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-data\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.130967 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.130962    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-envoy\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.131235 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.130989    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxm4b\" (UniqueName: \"kubernetes.io/projected/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-kube-api-access-kxm4b\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.131235 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.131022    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-workload-socket\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.131235 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.131124    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-workload-certs\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.131235 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.131229    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-credential-socket\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.131450 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.131417    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-workload-socket\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.131683 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.131658    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-data\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.131817 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.131772    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istiod-ca-cert\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.139875 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.138897    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-podinfo\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.139875 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.139078    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-envoy\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.146862 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.146798    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxm4b\" (UniqueName: \"kubernetes.io/projected/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-kube-api-access-kxm4b\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.147481 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.147421    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-token\") pod \"e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") " pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.200806 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.200754    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:28.322597 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.322557    2577 patch_prober.go:28] interesting pod/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Sep 10 22:25:28.322805 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.322623    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm" podUID="d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Sep 10 22:25:28.518373 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.518338    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"]
Sep 10 22:25:28.519574 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:25:28.519546    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeac5439d_1dec_4fcf_885e_05e7a3ae3d4e.slice/crio-b9bd8aee9bd273aef7fdbf9b1156137b1d48f48f23c5894afb7d807b37ffc9d3 WatchSource:0}: Error finding container b9bd8aee9bd273aef7fdbf9b1156137b1d48f48f23c5894afb7d807b37ffc9d3: Status 404 returned error can't find the container with id b9bd8aee9bd273aef7fdbf9b1156137b1d48f48f23c5894afb7d807b37ffc9d3
Sep 10 22:25:28.522054 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.522026    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:25:28.522125 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.522088    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:25:28.522125 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:28.522118    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:25:29.322989 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:29.322958    2577 patch_prober.go:28] interesting pod/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Sep 10 22:25:29.323380 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:29.323009    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm" podUID="d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Sep 10 22:25:29.381342 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:29.381305    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4" event={"ID":"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e","Type":"ContainerStarted","Data":"2074d51f63b7143f54b6d2b4634103f9aa7da2653a84ca57fbc132d9a580536f"}
Sep 10 22:25:29.381514 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:29.381367    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4" event={"ID":"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e","Type":"ContainerStarted","Data":"b9bd8aee9bd273aef7fdbf9b1156137b1d48f48f23c5894afb7d807b37ffc9d3"}
Sep 10 22:25:29.401607 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:29.401559    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4" podStartSLOduration=2.401543186 podStartE2EDuration="2.401543186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:25:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:25:29.400286323 +0000 UTC m=+1434.072384248" watchObservedRunningTime="2026-09-10 22:25:29.401543186 +0000 UTC m=+1434.073641108"
Sep 10 22:25:30.201245 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:30.201212    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:30.206647 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:30.206620    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:30.326770 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:30.326740    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:25:30.327252 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:30.327137    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:25:30.327955 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:30.327935    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:25:30.388002 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:30.387961    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:30.388912 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:30.388889    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:32.346728 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:32.346688    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:25:32.606205 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:32.606096    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"]
Sep 10 22:25:32.609323 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:32.609297    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"
Sep 10 22:25:32.613643 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:32.613614    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-c142c5-serving-cert\""
Sep 10 22:25:32.623222 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:32.623196    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"]
Sep 10 22:25:32.702147 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:32.702112    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/796a0558-5eb1-4842-af37-de62f0eb79b6-openshift-service-ca\") pod \"maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr\" (UID: \"796a0558-5eb1-4842-af37-de62f0eb79b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"
Sep 10 22:25:32.702304 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:32.702250    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/796a0558-5eb1-4842-af37-de62f0eb79b6-maas-api-tls\") pod \"maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr\" (UID: \"796a0558-5eb1-4842-af37-de62f0eb79b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"
Sep 10 22:25:32.702304 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:32.702287    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/796a0558-5eb1-4842-af37-de62f0eb79b6-metrics-certs\") pod \"maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr\" (UID: \"796a0558-5eb1-4842-af37-de62f0eb79b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"
Sep 10 22:25:32.702393 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:32.702316    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwq29\" (UniqueName: \"kubernetes.io/projected/796a0558-5eb1-4842-af37-de62f0eb79b6-kube-api-access-bwq29\") pod \"maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr\" (UID: \"796a0558-5eb1-4842-af37-de62f0eb79b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"
Sep 10 22:25:32.803402 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:32.803370    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/796a0558-5eb1-4842-af37-de62f0eb79b6-maas-api-tls\") pod \"maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr\" (UID: \"796a0558-5eb1-4842-af37-de62f0eb79b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"
Sep 10 22:25:32.803633 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:32.803412    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/796a0558-5eb1-4842-af37-de62f0eb79b6-metrics-certs\") pod \"maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr\" (UID: \"796a0558-5eb1-4842-af37-de62f0eb79b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"
Sep 10 22:25:32.803633 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:32.803450    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwq29\" (UniqueName: \"kubernetes.io/projected/796a0558-5eb1-4842-af37-de62f0eb79b6-kube-api-access-bwq29\") pod \"maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr\" (UID: \"796a0558-5eb1-4842-af37-de62f0eb79b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"
Sep 10 22:25:32.803633 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:32.803478    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/796a0558-5eb1-4842-af37-de62f0eb79b6-openshift-service-ca\") pod \"maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr\" (UID: \"796a0558-5eb1-4842-af37-de62f0eb79b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"
Sep 10 22:25:32.803633 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:25:32.803528    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-serving-cert: secret "maas-api-e2e-api-b-c142c5-serving-cert" not found
Sep 10 22:25:32.803633 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:25:32.803624    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/796a0558-5eb1-4842-af37-de62f0eb79b6-maas-api-tls podName:796a0558-5eb1-4842-af37-de62f0eb79b6 nodeName:}" failed. No retries permitted until 2026-09-10 22:25:33.30360274 +0000 UTC m=+1437.975700639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/796a0558-5eb1-4842-af37-de62f0eb79b6-maas-api-tls") pod "maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr" (UID: "796a0558-5eb1-4842-af37-de62f0eb79b6") : secret "maas-api-e2e-api-b-c142c5-serving-cert" not found
Sep 10 22:25:32.804219 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:32.804201    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/796a0558-5eb1-4842-af37-de62f0eb79b6-openshift-service-ca\") pod \"maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr\" (UID: \"796a0558-5eb1-4842-af37-de62f0eb79b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"
Sep 10 22:25:32.806136 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:32.806106    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/796a0558-5eb1-4842-af37-de62f0eb79b6-metrics-certs\") pod \"maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr\" (UID: \"796a0558-5eb1-4842-af37-de62f0eb79b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"
Sep 10 22:25:32.825911 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:32.825881    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwq29\" (UniqueName: \"kubernetes.io/projected/796a0558-5eb1-4842-af37-de62f0eb79b6-kube-api-access-bwq29\") pod \"maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr\" (UID: \"796a0558-5eb1-4842-af37-de62f0eb79b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"
Sep 10 22:25:33.309162 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:33.309120    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/796a0558-5eb1-4842-af37-de62f0eb79b6-maas-api-tls\") pod \"maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr\" (UID: \"796a0558-5eb1-4842-af37-de62f0eb79b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"
Sep 10 22:25:33.311690 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:33.311661    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/796a0558-5eb1-4842-af37-de62f0eb79b6-maas-api-tls\") pod \"maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr\" (UID: \"796a0558-5eb1-4842-af37-de62f0eb79b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"
Sep 10 22:25:33.523757 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:33.523720    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"
Sep 10 22:25:33.839218 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:33.839183    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"]
Sep 10 22:25:33.840695 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:25:33.840669    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod796a0558_5eb1_4842_af37_de62f0eb79b6.slice/crio-8ba0befb63c4ea921cc2ced2d035f0455464cb6fe3dd57518984217c07e02829 WatchSource:0}: Error finding container 8ba0befb63c4ea921cc2ced2d035f0455464cb6fe3dd57518984217c07e02829: Status 404 returned error can't find the container with id 8ba0befb63c4ea921cc2ced2d035f0455464cb6fe3dd57518984217c07e02829
Sep 10 22:25:34.418987 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:34.418950    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr" event={"ID":"796a0558-5eb1-4842-af37-de62f0eb79b6","Type":"ContainerStarted","Data":"793ac09f2ba5f1b50d9da8d3ca6cce61390dee8ef0d288f8da6d8ac585708c4a"}
Sep 10 22:25:34.419160 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:34.419011    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr" event={"ID":"796a0558-5eb1-4842-af37-de62f0eb79b6","Type":"ContainerStarted","Data":"8ba0befb63c4ea921cc2ced2d035f0455464cb6fe3dd57518984217c07e02829"}
Sep 10 22:25:34.419239 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:34.419166    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"
Sep 10 22:25:40.431068 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:40.431041    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"
Sep 10 22:25:40.464601 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:40.464554    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr" podStartSLOduration=8.099176308 podStartE2EDuration="8.464538195s" totalImagesPullingTime="365.361887ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:25:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:25:34.478964467 +0000 UTC m=+1439.151062388" watchObservedRunningTime="2026-09-10 22:25:40.464538195 +0000 UTC m=+1445.136636115"
Sep 10 22:25:51.379968 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:51.379930    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:25:54.549717 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:54.549685    2577 generic.go:356] "Generic (PLEG): container finished" podID="eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" containerID="2074d51f63b7143f54b6d2b4634103f9aa7da2653a84ca57fbc132d9a580536f" exitCode=0
Sep 10 22:25:54.550145 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:54.549758    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4" event={"ID":"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e","Type":"ContainerDied","Data":"2074d51f63b7143f54b6d2b4634103f9aa7da2653a84ca57fbc132d9a580536f"}
Sep 10 22:25:54.550195 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:54.550146    2577 scope.go:117] "RemoveContainer" containerID="2074d51f63b7143f54b6d2b4634103f9aa7da2653a84ca57fbc132d9a580536f"
Sep 10 22:25:54.551336 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:54.551297    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:25:54.551398 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:54.551377    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:25:54.551433 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:54.551407    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:25:55.563499 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:55.563461    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4" event={"ID":"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e","Type":"ContainerStarted","Data":"c6ed4c90cdddf31d53c18598a2bea7855912997d9cbe2f6fda3821f0789329b6"}
Sep 10 22:25:56.200938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:56.200912    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:25:56.202242 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:56.202213    2577 patch_prober.go:28] interesting pod/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Sep 10 22:25:56.202408 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:56.202255    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4" podUID="eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Sep 10 22:25:57.201475 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:57.201438    2577 patch_prober.go:28] interesting pod/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Sep 10 22:25:57.201921 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:57.201494    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4" podUID="eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Sep 10 22:25:58.201157 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:58.201121    2577 patch_prober.go:28] interesting pod/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Sep 10 22:25:58.201342 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:58.201180    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4" podUID="eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Sep 10 22:25:59.201508 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:59.201456    2577 patch_prober.go:28] interesting pod/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Sep 10 22:25:59.201948 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:25:59.201524    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4" podUID="eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Sep 10 22:26:00.201450 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:00.201407    2577 patch_prober.go:28] interesting pod/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Sep 10 22:26:00.201666 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:00.201481    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4" podUID="eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Sep 10 22:26:00.388560 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:00.388524    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:26:01.206164 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:01.206130    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:26:01.207198 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:01.207181    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:26:17.386947 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:17.386913    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:26:19.772936 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:19.772897    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"]
Sep 10 22:26:19.773406 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:19.773145    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt" podUID="12c1f600-3152-461e-b550-d4cee7101df1" containerName="maas-api" containerID="cri-o://7c3e3ddb55853f0e62cd222f60b5ea483193e9b7d749a4ba119da6390b676861" gracePeriod=30
Sep 10 22:26:20.032822 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:20.032740    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"
Sep 10 22:26:20.094757 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:20.094725    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12c1f600-3152-461e-b550-d4cee7101df1-openshift-service-ca\") pod \"12c1f600-3152-461e-b550-d4cee7101df1\" (UID: \"12c1f600-3152-461e-b550-d4cee7101df1\") "
Sep 10 22:26:20.094757 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:20.094764    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12c1f600-3152-461e-b550-d4cee7101df1-maas-api-tls\") pod \"12c1f600-3152-461e-b550-d4cee7101df1\" (UID: \"12c1f600-3152-461e-b550-d4cee7101df1\") "
Sep 10 22:26:20.094993 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:20.094803    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfnkc\" (UniqueName: \"kubernetes.io/projected/12c1f600-3152-461e-b550-d4cee7101df1-kube-api-access-tfnkc\") pod \"12c1f600-3152-461e-b550-d4cee7101df1\" (UID: \"12c1f600-3152-461e-b550-d4cee7101df1\") "
Sep 10 22:26:20.094993 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:20.094888    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12c1f600-3152-461e-b550-d4cee7101df1-metrics-certs\") pod \"12c1f600-3152-461e-b550-d4cee7101df1\" (UID: \"12c1f600-3152-461e-b550-d4cee7101df1\") "
Sep 10 22:26:20.095121 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:20.095100    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12c1f600-3152-461e-b550-d4cee7101df1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "12c1f600-3152-461e-b550-d4cee7101df1" (UID: "12c1f600-3152-461e-b550-d4cee7101df1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:26:20.095269 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:20.095248    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12c1f600-3152-461e-b550-d4cee7101df1-openshift-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:20.097163 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:20.097132    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12c1f600-3152-461e-b550-d4cee7101df1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "12c1f600-3152-461e-b550-d4cee7101df1" (UID: "12c1f600-3152-461e-b550-d4cee7101df1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:26:20.097264 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:20.097212    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12c1f600-3152-461e-b550-d4cee7101df1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "12c1f600-3152-461e-b550-d4cee7101df1" (UID: "12c1f600-3152-461e-b550-d4cee7101df1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:26:20.097264 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:20.097209    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12c1f600-3152-461e-b550-d4cee7101df1-kube-api-access-tfnkc" (OuterVolumeSpecName: "kube-api-access-tfnkc") pod "12c1f600-3152-461e-b550-d4cee7101df1" (UID: "12c1f600-3152-461e-b550-d4cee7101df1"). InnerVolumeSpecName "kube-api-access-tfnkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:26:20.195868 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:20.195831    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12c1f600-3152-461e-b550-d4cee7101df1-metrics-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:20.195868 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:20.195866    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12c1f600-3152-461e-b550-d4cee7101df1-maas-api-tls\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:20.195868 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:20.195882    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfnkc\" (UniqueName: \"kubernetes.io/projected/12c1f600-3152-461e-b550-d4cee7101df1-kube-api-access-tfnkc\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:20.724547 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:20.724511    2577 generic.go:356] "Generic (PLEG): container finished" podID="12c1f600-3152-461e-b550-d4cee7101df1" containerID="7c3e3ddb55853f0e62cd222f60b5ea483193e9b7d749a4ba119da6390b676861" exitCode=0
Sep 10 22:26:20.724828 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:20.724574    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"
Sep 10 22:26:20.724828 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:20.724597    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt" event={"ID":"12c1f600-3152-461e-b550-d4cee7101df1","Type":"ContainerDied","Data":"7c3e3ddb55853f0e62cd222f60b5ea483193e9b7d749a4ba119da6390b676861"}
Sep 10 22:26:20.724828 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:20.724694    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt" event={"ID":"12c1f600-3152-461e-b550-d4cee7101df1","Type":"ContainerDied","Data":"dd04e9c95e30b6f57d9f778e78d2eca54f92dfdd2f67310638abcaeedabca395"}
Sep 10 22:26:20.724828 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:20.724725    2577 scope.go:117] "RemoveContainer" containerID="7c3e3ddb55853f0e62cd222f60b5ea483193e9b7d749a4ba119da6390b676861"
Sep 10 22:26:20.736224 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:20.736202    2577 scope.go:117] "RemoveContainer" containerID="7c3e3ddb55853f0e62cd222f60b5ea483193e9b7d749a4ba119da6390b676861"
Sep 10 22:26:20.736558 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:26:20.736537    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c3e3ddb55853f0e62cd222f60b5ea483193e9b7d749a4ba119da6390b676861\": container with ID starting with 7c3e3ddb55853f0e62cd222f60b5ea483193e9b7d749a4ba119da6390b676861 not found: ID does not exist" containerID="7c3e3ddb55853f0e62cd222f60b5ea483193e9b7d749a4ba119da6390b676861"
Sep 10 22:26:20.736643 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:20.736571    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c3e3ddb55853f0e62cd222f60b5ea483193e9b7d749a4ba119da6390b676861"} err="failed to get container status \"7c3e3ddb55853f0e62cd222f60b5ea483193e9b7d749a4ba119da6390b676861\": rpc error: code = NotFound desc = could not find container \"7c3e3ddb55853f0e62cd222f60b5ea483193e9b7d749a4ba119da6390b676861\": container with ID starting with 7c3e3ddb55853f0e62cd222f60b5ea483193e9b7d749a4ba119da6390b676861 not found: ID does not exist"
Sep 10 22:26:20.746222 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:20.746188    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"]
Sep 10 22:26:20.750772 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:20.750750    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9c0e33-59c868758f-5gzjt"]
Sep 10 22:26:21.301109 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:21.301078    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7511-b1c502"]
Sep 10 22:26:21.301728 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:21.301706    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12c1f600-3152-461e-b550-d4cee7101df1" containerName="maas-api"
Sep 10 22:26:21.301845 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:21.301731    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="12c1f600-3152-461e-b550-d4cee7101df1" containerName="maas-api"
Sep 10 22:26:21.301916 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:21.301882    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="12c1f600-3152-461e-b550-d4cee7101df1" containerName="maas-api"
Sep 10 22:26:21.306213 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:21.306191    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7511-b1c502"
Sep 10 22:26:21.308596 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:21.308570    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-znq4v\""
Sep 10 22:26:21.310509 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:21.310487    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7511-b1c502"]
Sep 10 22:26:21.407478 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:21.407447    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nhvk\" (UniqueName: \"kubernetes.io/projected/8e557907-ffd1-4563-a155-ca912c2811ee-kube-api-access-4nhvk\") pod \"test-curl-7511-b1c502\" (UID: \"8e557907-ffd1-4563-a155-ca912c2811ee\") " pod="opendatahub/test-curl-7511-b1c502"
Sep 10 22:26:21.508965 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:21.508912    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nhvk\" (UniqueName: \"kubernetes.io/projected/8e557907-ffd1-4563-a155-ca912c2811ee-kube-api-access-4nhvk\") pod \"test-curl-7511-b1c502\" (UID: \"8e557907-ffd1-4563-a155-ca912c2811ee\") " pod="opendatahub/test-curl-7511-b1c502"
Sep 10 22:26:21.518266 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:21.518240    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nhvk\" (UniqueName: \"kubernetes.io/projected/8e557907-ffd1-4563-a155-ca912c2811ee-kube-api-access-4nhvk\") pod \"test-curl-7511-b1c502\" (UID: \"8e557907-ffd1-4563-a155-ca912c2811ee\") " pod="opendatahub/test-curl-7511-b1c502"
Sep 10 22:26:21.619216 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:21.619130    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7511-b1c502"
Sep 10 22:26:21.848559 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:21.848529    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12c1f600-3152-461e-b550-d4cee7101df1" path="/var/lib/kubelet/pods/12c1f600-3152-461e-b550-d4cee7101df1/volumes"
Sep 10 22:26:21.895687 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:21.895661    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7511-b1c502"]
Sep 10 22:26:21.897623 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:26:21.897593    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e557907_ffd1_4563_a155_ca912c2811ee.slice/crio-58cc5912f2eb3279a385123af19286ab164e83dd70ca4b4fdbd0a28356f5442a WatchSource:0}: Error finding container 58cc5912f2eb3279a385123af19286ab164e83dd70ca4b4fdbd0a28356f5442a: Status 404 returned error can't find the container with id 58cc5912f2eb3279a385123af19286ab164e83dd70ca4b4fdbd0a28356f5442a
Sep 10 22:26:22.739671 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:22.739638    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7511-b1c502" event={"ID":"8e557907-ffd1-4563-a155-ca912c2811ee","Type":"ContainerStarted","Data":"a0ba8ba3d570da4be537f3f8d2eed05bf2dd15b4bfdc9eb8efc4c7654139a5c8"}
Sep 10 22:26:22.739671 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:22.739677    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7511-b1c502" event={"ID":"8e557907-ffd1-4563-a155-ca912c2811ee","Type":"ContainerStarted","Data":"58cc5912f2eb3279a385123af19286ab164e83dd70ca4b4fdbd0a28356f5442a"}
Sep 10 22:26:22.754370 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:22.754323    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7511-b1c502" podStartSLOduration=1.754307203 podStartE2EDuration="1.754307203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:26:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:26:22.752547679 +0000 UTC m=+1487.424645600" watchObservedRunningTime="2026-09-10 22:26:22.754307203 +0000 UTC m=+1487.426405124"
Sep 10 22:26:23.329390 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:23.329359    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7511-b1c502"]
Sep 10 22:26:23.333654 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:23.333628    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7511-b1c502"]
Sep 10 22:26:23.749386 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:26:23.749359    2577 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7511-b1c502" container="test-curl-7511-b1c502"
Sep 10 22:26:24.755318 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:24.755277    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7511-b1c502" podUID="8e557907-ffd1-4563-a155-ca912c2811ee" containerName="test-curl-7511-b1c502" containerID="cri-o://a0ba8ba3d570da4be537f3f8d2eed05bf2dd15b4bfdc9eb8efc4c7654139a5c8" gracePeriod=2
Sep 10 22:26:26.458700 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:26.458664    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"]
Sep 10 22:26:26.459126 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:26.458947    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm" podUID="d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" containerName="istio-proxy" containerID="cri-o://469851a5da1b4b84b1337f75076b147adace1f772422157f1dc727ef37fd9829" gracePeriod=30
Sep 10 22:26:26.959365 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:26.959339    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7511-b1c502"
Sep 10 22:26:27.066964 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:27.066871    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nhvk\" (UniqueName: \"kubernetes.io/projected/8e557907-ffd1-4563-a155-ca912c2811ee-kube-api-access-4nhvk\") pod \"8e557907-ffd1-4563-a155-ca912c2811ee\" (UID: \"8e557907-ffd1-4563-a155-ca912c2811ee\") "
Sep 10 22:26:27.069246 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:27.069213    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e557907-ffd1-4563-a155-ca912c2811ee-kube-api-access-4nhvk" (OuterVolumeSpecName: "kube-api-access-4nhvk") pod "8e557907-ffd1-4563-a155-ca912c2811ee" (UID: "8e557907-ffd1-4563-a155-ca912c2811ee"). InnerVolumeSpecName "kube-api-access-4nhvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:26:27.168733 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:27.168701    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nhvk\" (UniqueName: \"kubernetes.io/projected/8e557907-ffd1-4563-a155-ca912c2811ee-kube-api-access-4nhvk\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:27.776283 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:27.776243    2577 generic.go:356] "Generic (PLEG): container finished" podID="8e557907-ffd1-4563-a155-ca912c2811ee" containerID="a0ba8ba3d570da4be537f3f8d2eed05bf2dd15b4bfdc9eb8efc4c7654139a5c8" exitCode=137
Sep 10 22:26:27.776283 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:27.776287    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7511-b1c502"
Sep 10 22:26:27.776850 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:27.776349    2577 scope.go:117] "RemoveContainer" containerID="a0ba8ba3d570da4be537f3f8d2eed05bf2dd15b4bfdc9eb8efc4c7654139a5c8"
Sep 10 22:26:27.786522 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:26:27.786492    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7511-b1c502\" is forbidden: User \"system:node:ip-10-0-130-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-67.ec2.internal' and this object" podUID="8e557907-ffd1-4563-a155-ca912c2811ee" pod="opendatahub/test-curl-7511-b1c502"
Sep 10 22:26:27.786751 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:27.786731    2577 scope.go:117] "RemoveContainer" containerID="a0ba8ba3d570da4be537f3f8d2eed05bf2dd15b4bfdc9eb8efc4c7654139a5c8"
Sep 10 22:26:27.787092 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:26:27.787070    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0ba8ba3d570da4be537f3f8d2eed05bf2dd15b4bfdc9eb8efc4c7654139a5c8\": container with ID starting with a0ba8ba3d570da4be537f3f8d2eed05bf2dd15b4bfdc9eb8efc4c7654139a5c8 not found: ID does not exist" containerID="a0ba8ba3d570da4be537f3f8d2eed05bf2dd15b4bfdc9eb8efc4c7654139a5c8"
Sep 10 22:26:27.787180 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:27.787100    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0ba8ba3d570da4be537f3f8d2eed05bf2dd15b4bfdc9eb8efc4c7654139a5c8"} err="failed to get container status \"a0ba8ba3d570da4be537f3f8d2eed05bf2dd15b4bfdc9eb8efc4c7654139a5c8\": rpc error: code = NotFound desc = could not find container \"a0ba8ba3d570da4be537f3f8d2eed05bf2dd15b4bfdc9eb8efc4c7654139a5c8\": container with ID starting with a0ba8ba3d570da4be537f3f8d2eed05bf2dd15b4bfdc9eb8efc4c7654139a5c8 not found: ID does not exist"
Sep 10 22:26:27.849170 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:27.849136    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e557907-ffd1-4563-a155-ca912c2811ee" path="/var/lib/kubelet/pods/8e557907-ffd1-4563-a155-ca912c2811ee/volumes"
Sep 10 22:26:30.330325 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:30.330237    2577 patch_prober.go:28] interesting pod/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 22:26:30.330325 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:30.330311    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm" podUID="d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 22:26:31.725388 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.725325    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:26:31.803651 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.803618    2577 generic.go:356] "Generic (PLEG): container finished" podID="d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" containerID="469851a5da1b4b84b1337f75076b147adace1f772422157f1dc727ef37fd9829" exitCode=0
Sep 10 22:26:31.803840 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.803671    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"
Sep 10 22:26:31.803840 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.803714    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm" event={"ID":"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d","Type":"ContainerDied","Data":"469851a5da1b4b84b1337f75076b147adace1f772422157f1dc727ef37fd9829"}
Sep 10 22:26:31.803840 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.803832    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm" event={"ID":"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d","Type":"ContainerDied","Data":"5c5d76d8290ecff1a424c37605ef0c8cd736d5d952e4ebd29019cba86cd47810"}
Sep 10 22:26:31.804030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.803869    2577 scope.go:117] "RemoveContainer" containerID="469851a5da1b4b84b1337f75076b147adace1f772422157f1dc727ef37fd9829"
Sep 10 22:26:31.815033 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.815013    2577 scope.go:117] "RemoveContainer" containerID="4513a7f64fae6c6e7c1922189255ec213a587ee207238a6fd2d9c91e3e4a7cc8"
Sep 10 22:26:31.815798 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.815759    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istiod-ca-cert\") pod \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") "
Sep 10 22:26:31.816005 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.815983    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-workload-socket\") pod \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") "
Sep 10 22:26:31.816104 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.816054    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-data\") pod \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") "
Sep 10 22:26:31.816234 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.816097    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" (UID: "d2a78fe8-89bb-4e13-b7f5-c7e469471d7d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:26:31.816234 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.816108    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-envoy\") pod \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") "
Sep 10 22:26:31.816234 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.816221    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" (UID: "d2a78fe8-89bb-4e13-b7f5-c7e469471d7d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:26:31.816387 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.816283    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-credential-socket\") pod \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") "
Sep 10 22:26:31.816387 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.816297    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-data" (OuterVolumeSpecName: "istio-data") pod "d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" (UID: "d2a78fe8-89bb-4e13-b7f5-c7e469471d7d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:26:31.816387 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.816342    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-workload-certs\") pod \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") "
Sep 10 22:26:31.816387 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.816380    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5zds\" (UniqueName: \"kubernetes.io/projected/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-kube-api-access-l5zds\") pod \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") "
Sep 10 22:26:31.816594 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.816400    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-podinfo\") pod \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") "
Sep 10 22:26:31.816594 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.816429    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-token\") pod \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\" (UID: \"d2a78fe8-89bb-4e13-b7f5-c7e469471d7d\") "
Sep 10 22:26:31.816594 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.816485    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" (UID: "d2a78fe8-89bb-4e13-b7f5-c7e469471d7d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:26:31.816865 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.816845    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istiod-ca-cert\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:31.816995 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.816975    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-workload-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:31.816995 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.816929    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" (UID: "d2a78fe8-89bb-4e13-b7f5-c7e469471d7d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:26:31.817175 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.816997    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-data\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:31.817175 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.817035    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-credential-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:31.819168 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.819141    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" (UID: "d2a78fe8-89bb-4e13-b7f5-c7e469471d7d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:26:31.819272 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.819135    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" (UID: "d2a78fe8-89bb-4e13-b7f5-c7e469471d7d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:26:31.819365 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.819346    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-kube-api-access-l5zds" (OuterVolumeSpecName: "kube-api-access-l5zds") pod "d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" (UID: "d2a78fe8-89bb-4e13-b7f5-c7e469471d7d"). InnerVolumeSpecName "kube-api-access-l5zds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:26:31.819416 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.819368    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-token" (OuterVolumeSpecName: "istio-token") pod "d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" (UID: "d2a78fe8-89bb-4e13-b7f5-c7e469471d7d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:26:31.843138 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.843114    2577 scope.go:117] "RemoveContainer" containerID="469851a5da1b4b84b1337f75076b147adace1f772422157f1dc727ef37fd9829"
Sep 10 22:26:31.844450 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:26:31.844417    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"469851a5da1b4b84b1337f75076b147adace1f772422157f1dc727ef37fd9829\": container with ID starting with 469851a5da1b4b84b1337f75076b147adace1f772422157f1dc727ef37fd9829 not found: ID does not exist" containerID="469851a5da1b4b84b1337f75076b147adace1f772422157f1dc727ef37fd9829"
Sep 10 22:26:31.844576 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.844462    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"469851a5da1b4b84b1337f75076b147adace1f772422157f1dc727ef37fd9829"} err="failed to get container status \"469851a5da1b4b84b1337f75076b147adace1f772422157f1dc727ef37fd9829\": rpc error: code = NotFound desc = could not find container \"469851a5da1b4b84b1337f75076b147adace1f772422157f1dc727ef37fd9829\": container with ID starting with 469851a5da1b4b84b1337f75076b147adace1f772422157f1dc727ef37fd9829 not found: ID does not exist"
Sep 10 22:26:31.844576 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.844488    2577 scope.go:117] "RemoveContainer" containerID="4513a7f64fae6c6e7c1922189255ec213a587ee207238a6fd2d9c91e3e4a7cc8"
Sep 10 22:26:31.844871 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:26:31.844850    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4513a7f64fae6c6e7c1922189255ec213a587ee207238a6fd2d9c91e3e4a7cc8\": container with ID starting with 4513a7f64fae6c6e7c1922189255ec213a587ee207238a6fd2d9c91e3e4a7cc8 not found: ID does not exist" containerID="4513a7f64fae6c6e7c1922189255ec213a587ee207238a6fd2d9c91e3e4a7cc8"
Sep 10 22:26:31.844928 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.844877    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4513a7f64fae6c6e7c1922189255ec213a587ee207238a6fd2d9c91e3e4a7cc8"} err="failed to get container status \"4513a7f64fae6c6e7c1922189255ec213a587ee207238a6fd2d9c91e3e4a7cc8\": rpc error: code = NotFound desc = could not find container \"4513a7f64fae6c6e7c1922189255ec213a587ee207238a6fd2d9c91e3e4a7cc8\": container with ID starting with 4513a7f64fae6c6e7c1922189255ec213a587ee207238a6fd2d9c91e3e4a7cc8 not found: ID does not exist"
Sep 10 22:26:31.918462 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.918425    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-envoy\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:31.918462 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.918457    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-workload-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:31.918462 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.918466    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5zds\" (UniqueName: \"kubernetes.io/projected/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-kube-api-access-l5zds\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:31.918706 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.918478    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-podinfo\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:31.918706 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:31.918486    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d-istio-token\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:32.121125 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:32.121039    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"]
Sep 10 22:26:32.125313 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:32.125282    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-9c0e33-openshift-default-d4c5c74bb-t67lm"]
Sep 10 22:26:33.848441 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:33.848406    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" path="/var/lib/kubelet/pods/d2a78fe8-89bb-4e13-b7f5-c7e469471d7d/volumes"
Sep 10 22:26:33.960537 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:33.960503    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:26:42.247586 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.247548    2577 scope.go:117] "RemoveContainer" containerID="d8354d77a5d5de8a3f26d19d83f1e22a2c1483a331b06b8ba608821ca4771d2b"
Sep 10 22:26:42.256603 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.256580    2577 scope.go:117] "RemoveContainer" containerID="8edfaa148b1284e3a1c418f93eaea8ab3e3befd0e2ceb14d33dccbcbacbedfa0"
Sep 10 22:26:42.264990 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.264969    2577 scope.go:117] "RemoveContainer" containerID="d8ebf261c87e6fcc6f7bf64e52937abd659097b7de68b3275d2e48b477742c1d"
Sep 10 22:26:42.479824 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.479769    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"]
Sep 10 22:26:42.480157 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.480099    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr" podUID="796a0558-5eb1-4842-af37-de62f0eb79b6" containerName="maas-api" containerID="cri-o://793ac09f2ba5f1b50d9da8d3ca6cce61390dee8ef0d288f8da6d8ac585708c4a" gracePeriod=30
Sep 10 22:26:42.731600 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.731572    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"
Sep 10 22:26:42.827651 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.827570    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwq29\" (UniqueName: \"kubernetes.io/projected/796a0558-5eb1-4842-af37-de62f0eb79b6-kube-api-access-bwq29\") pod \"796a0558-5eb1-4842-af37-de62f0eb79b6\" (UID: \"796a0558-5eb1-4842-af37-de62f0eb79b6\") "
Sep 10 22:26:42.827829 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.827659    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/796a0558-5eb1-4842-af37-de62f0eb79b6-maas-api-tls\") pod \"796a0558-5eb1-4842-af37-de62f0eb79b6\" (UID: \"796a0558-5eb1-4842-af37-de62f0eb79b6\") "
Sep 10 22:26:42.827829 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.827687    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/796a0558-5eb1-4842-af37-de62f0eb79b6-metrics-certs\") pod \"796a0558-5eb1-4842-af37-de62f0eb79b6\" (UID: \"796a0558-5eb1-4842-af37-de62f0eb79b6\") "
Sep 10 22:26:42.827829 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.827706    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/796a0558-5eb1-4842-af37-de62f0eb79b6-openshift-service-ca\") pod \"796a0558-5eb1-4842-af37-de62f0eb79b6\" (UID: \"796a0558-5eb1-4842-af37-de62f0eb79b6\") "
Sep 10 22:26:42.828161 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.828136    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/796a0558-5eb1-4842-af37-de62f0eb79b6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "796a0558-5eb1-4842-af37-de62f0eb79b6" (UID: "796a0558-5eb1-4842-af37-de62f0eb79b6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:26:42.830012 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.829981    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/796a0558-5eb1-4842-af37-de62f0eb79b6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "796a0558-5eb1-4842-af37-de62f0eb79b6" (UID: "796a0558-5eb1-4842-af37-de62f0eb79b6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:26:42.830012 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.829997    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/796a0558-5eb1-4842-af37-de62f0eb79b6-kube-api-access-bwq29" (OuterVolumeSpecName: "kube-api-access-bwq29") pod "796a0558-5eb1-4842-af37-de62f0eb79b6" (UID: "796a0558-5eb1-4842-af37-de62f0eb79b6"). InnerVolumeSpecName "kube-api-access-bwq29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:26:42.830267 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.830245    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/796a0558-5eb1-4842-af37-de62f0eb79b6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "796a0558-5eb1-4842-af37-de62f0eb79b6" (UID: "796a0558-5eb1-4842-af37-de62f0eb79b6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:26:42.882802 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.882707    2577 generic.go:356] "Generic (PLEG): container finished" podID="796a0558-5eb1-4842-af37-de62f0eb79b6" containerID="793ac09f2ba5f1b50d9da8d3ca6cce61390dee8ef0d288f8da6d8ac585708c4a" exitCode=0
Sep 10 22:26:42.883064 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.882970    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr" event={"ID":"796a0558-5eb1-4842-af37-de62f0eb79b6","Type":"ContainerDied","Data":"793ac09f2ba5f1b50d9da8d3ca6cce61390dee8ef0d288f8da6d8ac585708c4a"}
Sep 10 22:26:42.883064 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.883024    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr" event={"ID":"796a0558-5eb1-4842-af37-de62f0eb79b6","Type":"ContainerDied","Data":"8ba0befb63c4ea921cc2ced2d035f0455464cb6fe3dd57518984217c07e02829"}
Sep 10 22:26:42.883239 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.883066    2577 scope.go:117] "RemoveContainer" containerID="793ac09f2ba5f1b50d9da8d3ca6cce61390dee8ef0d288f8da6d8ac585708c4a"
Sep 10 22:26:42.883239 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.883201    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"
Sep 10 22:26:42.896181 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.896153    2577 scope.go:117] "RemoveContainer" containerID="793ac09f2ba5f1b50d9da8d3ca6cce61390dee8ef0d288f8da6d8ac585708c4a"
Sep 10 22:26:42.896614 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:26:42.896577    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"793ac09f2ba5f1b50d9da8d3ca6cce61390dee8ef0d288f8da6d8ac585708c4a\": container with ID starting with 793ac09f2ba5f1b50d9da8d3ca6cce61390dee8ef0d288f8da6d8ac585708c4a not found: ID does not exist" containerID="793ac09f2ba5f1b50d9da8d3ca6cce61390dee8ef0d288f8da6d8ac585708c4a"
Sep 10 22:26:42.896757 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.896630    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"793ac09f2ba5f1b50d9da8d3ca6cce61390dee8ef0d288f8da6d8ac585708c4a"} err="failed to get container status \"793ac09f2ba5f1b50d9da8d3ca6cce61390dee8ef0d288f8da6d8ac585708c4a\": rpc error: code = NotFound desc = could not find container \"793ac09f2ba5f1b50d9da8d3ca6cce61390dee8ef0d288f8da6d8ac585708c4a\": container with ID starting with 793ac09f2ba5f1b50d9da8d3ca6cce61390dee8ef0d288f8da6d8ac585708c4a not found: ID does not exist"
Sep 10 22:26:42.906060 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.906031    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"]
Sep 10 22:26:42.910804 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.910760    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c142c5-759bc6b55c-lhgpr"]
Sep 10 22:26:42.929276 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.929251    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwq29\" (UniqueName: \"kubernetes.io/projected/796a0558-5eb1-4842-af37-de62f0eb79b6-kube-api-access-bwq29\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:42.929276 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.929276    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/796a0558-5eb1-4842-af37-de62f0eb79b6-maas-api-tls\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:42.929417 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.929286    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/796a0558-5eb1-4842-af37-de62f0eb79b6-metrics-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:42.929417 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:42.929295    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/796a0558-5eb1-4842-af37-de62f0eb79b6-openshift-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:43.847723 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:43.847688    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="796a0558-5eb1-4842-af37-de62f0eb79b6" path="/var/lib/kubelet/pods/796a0558-5eb1-4842-af37-de62f0eb79b6/volumes"
Sep 10 22:26:47.262023 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:47.261988    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:26:49.147173 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:49.147129    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"]
Sep 10 22:26:49.147635 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:49.147369    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4" podUID="eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" containerName="istio-proxy" containerID="cri-o://c6ed4c90cdddf31d53c18598a2bea7855912997d9cbe2f6fda3821f0789329b6" gracePeriod=30
Sep 10 22:26:54.415053 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.414986    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:26:54.540564 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.540534    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-credential-socket\") pod \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") "
Sep 10 22:26:54.540755 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.540609    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-data\") pod \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") "
Sep 10 22:26:54.540755 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.540647    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-envoy\") pod \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") "
Sep 10 22:26:54.540755 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.540688    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-token\") pod \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") "
Sep 10 22:26:54.540755 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.540728    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxm4b\" (UniqueName: \"kubernetes.io/projected/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-kube-api-access-kxm4b\") pod \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") "
Sep 10 22:26:54.540999 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.540801    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-podinfo\") pod \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") "
Sep 10 22:26:54.540999 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.540865    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-data" (OuterVolumeSpecName: "istio-data") pod "eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" (UID: "eac5439d-1dec-4fcf-885e-05e7a3ae3d4e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:26:54.540999 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.540895    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" (UID: "eac5439d-1dec-4fcf-885e-05e7a3ae3d4e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:26:54.540999 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.540938    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-workload-socket\") pod \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") "
Sep 10 22:26:54.540999 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.541000    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-workload-certs\") pod \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") "
Sep 10 22:26:54.541261 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.541023    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istiod-ca-cert\") pod \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\" (UID: \"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e\") "
Sep 10 22:26:54.541335 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.541254    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" (UID: "eac5439d-1dec-4fcf-885e-05e7a3ae3d4e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:26:54.541335 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.541268    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" (UID: "eac5439d-1dec-4fcf-885e-05e7a3ae3d4e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:26:54.541458 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.541392    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-workload-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:54.541458 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.541413    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-credential-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:54.541458 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.541428    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-data\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:54.541458 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.541444    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-workload-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:54.541847 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.541575    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" (UID: "eac5439d-1dec-4fcf-885e-05e7a3ae3d4e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:26:54.543212 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.543187    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-token" (OuterVolumeSpecName: "istio-token") pod "eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" (UID: "eac5439d-1dec-4fcf-885e-05e7a3ae3d4e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:26:54.543340 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.543292    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-kube-api-access-kxm4b" (OuterVolumeSpecName: "kube-api-access-kxm4b") pod "eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" (UID: "eac5439d-1dec-4fcf-885e-05e7a3ae3d4e"). InnerVolumeSpecName "kube-api-access-kxm4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:26:54.543388 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.543365    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" (UID: "eac5439d-1dec-4fcf-885e-05e7a3ae3d4e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:26:54.543425 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.543412    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" (UID: "eac5439d-1dec-4fcf-885e-05e7a3ae3d4e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:26:54.642135 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.642104    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-token\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:54.642135 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.642133    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxm4b\" (UniqueName: \"kubernetes.io/projected/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-kube-api-access-kxm4b\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:54.642135 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.642144    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-podinfo\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:54.642385 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.642156    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istiod-ca-cert\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:54.642385 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.642168    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e-istio-envoy\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:26:54.955754 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.955716    2577 generic.go:356] "Generic (PLEG): container finished" podID="eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" containerID="c6ed4c90cdddf31d53c18598a2bea7855912997d9cbe2f6fda3821f0789329b6" exitCode=0
Sep 10 22:26:54.955945 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.955752    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4" event={"ID":"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e","Type":"ContainerDied","Data":"c6ed4c90cdddf31d53c18598a2bea7855912997d9cbe2f6fda3821f0789329b6"}
Sep 10 22:26:54.955945 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.955790    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"
Sep 10 22:26:54.955945 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.955827    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4" event={"ID":"eac5439d-1dec-4fcf-885e-05e7a3ae3d4e","Type":"ContainerDied","Data":"b9bd8aee9bd273aef7fdbf9b1156137b1d48f48f23c5894afb7d807b37ffc9d3"}
Sep 10 22:26:54.955945 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.955851    2577 scope.go:117] "RemoveContainer" containerID="c6ed4c90cdddf31d53c18598a2bea7855912997d9cbe2f6fda3821f0789329b6"
Sep 10 22:26:54.967210 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.967189    2577 scope.go:117] "RemoveContainer" containerID="2074d51f63b7143f54b6d2b4634103f9aa7da2653a84ca57fbc132d9a580536f"
Sep 10 22:26:54.976589 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.976566    2577 scope.go:117] "RemoveContainer" containerID="c6ed4c90cdddf31d53c18598a2bea7855912997d9cbe2f6fda3821f0789329b6"
Sep 10 22:26:54.977121 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:26:54.976933    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6ed4c90cdddf31d53c18598a2bea7855912997d9cbe2f6fda3821f0789329b6\": container with ID starting with c6ed4c90cdddf31d53c18598a2bea7855912997d9cbe2f6fda3821f0789329b6 not found: ID does not exist" containerID="c6ed4c90cdddf31d53c18598a2bea7855912997d9cbe2f6fda3821f0789329b6"
Sep 10 22:26:54.977121 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.976968    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6ed4c90cdddf31d53c18598a2bea7855912997d9cbe2f6fda3821f0789329b6"} err="failed to get container status \"c6ed4c90cdddf31d53c18598a2bea7855912997d9cbe2f6fda3821f0789329b6\": rpc error: code = NotFound desc = could not find container \"c6ed4c90cdddf31d53c18598a2bea7855912997d9cbe2f6fda3821f0789329b6\": container with ID starting with c6ed4c90cdddf31d53c18598a2bea7855912997d9cbe2f6fda3821f0789329b6 not found: ID does not exist"
Sep 10 22:26:54.977121 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.976991    2577 scope.go:117] "RemoveContainer" containerID="2074d51f63b7143f54b6d2b4634103f9aa7da2653a84ca57fbc132d9a580536f"
Sep 10 22:26:54.977443 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:26:54.977416    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2074d51f63b7143f54b6d2b4634103f9aa7da2653a84ca57fbc132d9a580536f\": container with ID starting with 2074d51f63b7143f54b6d2b4634103f9aa7da2653a84ca57fbc132d9a580536f not found: ID does not exist" containerID="2074d51f63b7143f54b6d2b4634103f9aa7da2653a84ca57fbc132d9a580536f"
Sep 10 22:26:54.977500 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.977453    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2074d51f63b7143f54b6d2b4634103f9aa7da2653a84ca57fbc132d9a580536f"} err="failed to get container status \"2074d51f63b7143f54b6d2b4634103f9aa7da2653a84ca57fbc132d9a580536f\": rpc error: code = NotFound desc = could not find container \"2074d51f63b7143f54b6d2b4634103f9aa7da2653a84ca57fbc132d9a580536f\": container with ID starting with 2074d51f63b7143f54b6d2b4634103f9aa7da2653a84ca57fbc132d9a580536f not found: ID does not exist"
Sep 10 22:26:54.979241 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.979221    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"]
Sep 10 22:26:54.982986 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:54.982962    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-c142c5-openshift-default-68bf74fccd-9bsm4"]
Sep 10 22:26:55.848498 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:26:55.848465    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" path="/var/lib/kubelet/pods/eac5439d-1dec-4fcf-885e-05e7a3ae3d4e/volumes"
Sep 10 22:27:00.033905 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:00.033828    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"]
Sep 10 22:27:00.034337 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:00.034041    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6" podUID="92ce1629-71f9-46df-9ae9-3415d16296ee" containerName="maas-api" containerID="cri-o://507896f4933c77c5d11b34a4f38d1afe3d584099f43658c844c8b4b2797671ca" gracePeriod=30
Sep 10 22:27:00.287919 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:00.287848    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"
Sep 10 22:27:00.394300 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:00.394261    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92ce1629-71f9-46df-9ae9-3415d16296ee-metrics-certs\") pod \"92ce1629-71f9-46df-9ae9-3415d16296ee\" (UID: \"92ce1629-71f9-46df-9ae9-3415d16296ee\") "
Sep 10 22:27:00.394497 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:00.394337    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92ce1629-71f9-46df-9ae9-3415d16296ee-maas-api-tls\") pod \"92ce1629-71f9-46df-9ae9-3415d16296ee\" (UID: \"92ce1629-71f9-46df-9ae9-3415d16296ee\") "
Sep 10 22:27:00.394497 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:00.394412    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92ce1629-71f9-46df-9ae9-3415d16296ee-openshift-service-ca\") pod \"92ce1629-71f9-46df-9ae9-3415d16296ee\" (UID: \"92ce1629-71f9-46df-9ae9-3415d16296ee\") "
Sep 10 22:27:00.394497 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:00.394468    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4xg7\" (UniqueName: \"kubernetes.io/projected/92ce1629-71f9-46df-9ae9-3415d16296ee-kube-api-access-p4xg7\") pod \"92ce1629-71f9-46df-9ae9-3415d16296ee\" (UID: \"92ce1629-71f9-46df-9ae9-3415d16296ee\") "
Sep 10 22:27:00.394876 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:00.394844    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92ce1629-71f9-46df-9ae9-3415d16296ee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "92ce1629-71f9-46df-9ae9-3415d16296ee" (UID: "92ce1629-71f9-46df-9ae9-3415d16296ee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:27:00.397031 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:00.397004    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92ce1629-71f9-46df-9ae9-3415d16296ee-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "92ce1629-71f9-46df-9ae9-3415d16296ee" (UID: "92ce1629-71f9-46df-9ae9-3415d16296ee"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:27:00.397352 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:00.397229    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92ce1629-71f9-46df-9ae9-3415d16296ee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "92ce1629-71f9-46df-9ae9-3415d16296ee" (UID: "92ce1629-71f9-46df-9ae9-3415d16296ee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:27:00.397622 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:00.397598    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92ce1629-71f9-46df-9ae9-3415d16296ee-kube-api-access-p4xg7" (OuterVolumeSpecName: "kube-api-access-p4xg7") pod "92ce1629-71f9-46df-9ae9-3415d16296ee" (UID: "92ce1629-71f9-46df-9ae9-3415d16296ee"). InnerVolumeSpecName "kube-api-access-p4xg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:27:00.496137 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:00.496104    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92ce1629-71f9-46df-9ae9-3415d16296ee-openshift-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:27:00.496137 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:00.496133    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4xg7\" (UniqueName: \"kubernetes.io/projected/92ce1629-71f9-46df-9ae9-3415d16296ee-kube-api-access-p4xg7\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:27:00.496137 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:00.496143    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92ce1629-71f9-46df-9ae9-3415d16296ee-metrics-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:27:00.496388 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:00.496152    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92ce1629-71f9-46df-9ae9-3415d16296ee-maas-api-tls\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:27:00.993828 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:00.993764    2577 generic.go:356] "Generic (PLEG): container finished" podID="92ce1629-71f9-46df-9ae9-3415d16296ee" containerID="507896f4933c77c5d11b34a4f38d1afe3d584099f43658c844c8b4b2797671ca" exitCode=0
Sep 10 22:27:00.993828 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:00.993810    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6" event={"ID":"92ce1629-71f9-46df-9ae9-3415d16296ee","Type":"ContainerDied","Data":"507896f4933c77c5d11b34a4f38d1afe3d584099f43658c844c8b4b2797671ca"}
Sep 10 22:27:00.993828 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:00.993828    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"
Sep 10 22:27:00.994119 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:00.993867    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6" event={"ID":"92ce1629-71f9-46df-9ae9-3415d16296ee","Type":"ContainerDied","Data":"9c68dd0c6bf1a6228bc2a6387eabe44d87b839ea476696e92bd1049c8a1643ba"}
Sep 10 22:27:00.994119 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:00.993895    2577 scope.go:117] "RemoveContainer" containerID="507896f4933c77c5d11b34a4f38d1afe3d584099f43658c844c8b4b2797671ca"
Sep 10 22:27:01.005701 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:01.004504    2577 scope.go:117] "RemoveContainer" containerID="507896f4933c77c5d11b34a4f38d1afe3d584099f43658c844c8b4b2797671ca"
Sep 10 22:27:01.005701 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:27:01.005630    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"507896f4933c77c5d11b34a4f38d1afe3d584099f43658c844c8b4b2797671ca\": container with ID starting with 507896f4933c77c5d11b34a4f38d1afe3d584099f43658c844c8b4b2797671ca not found: ID does not exist" containerID="507896f4933c77c5d11b34a4f38d1afe3d584099f43658c844c8b4b2797671ca"
Sep 10 22:27:01.005701 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:01.005663    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"507896f4933c77c5d11b34a4f38d1afe3d584099f43658c844c8b4b2797671ca"} err="failed to get container status \"507896f4933c77c5d11b34a4f38d1afe3d584099f43658c844c8b4b2797671ca\": rpc error: code = NotFound desc = could not find container \"507896f4933c77c5d11b34a4f38d1afe3d584099f43658c844c8b4b2797671ca\": container with ID starting with 507896f4933c77c5d11b34a4f38d1afe3d584099f43658c844c8b4b2797671ca not found: ID does not exist"
Sep 10 22:27:01.016499 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:01.016468    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"]
Sep 10 22:27:01.021112 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:01.021087    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a9b6f6-6b44bc854f-sxzf6"]
Sep 10 22:27:01.849055 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:01.849023    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92ce1629-71f9-46df-9ae9-3415d16296ee" path="/var/lib/kubelet/pods/92ce1629-71f9-46df-9ae9-3415d16296ee/volumes"
Sep 10 22:27:04.072581 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:04.072541    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:27:17.918310 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:17.918272    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"]
Sep 10 22:27:17.918769 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:17.918488    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h" podUID="0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc" containerName="maas-api" containerID="cri-o://2d9a1667c78c037941173a1b4cbd67ca7f6536a5d1fd21e17efdc8c5408b8e03" gracePeriod=30
Sep 10 22:27:18.100659 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:18.100614    2577 generic.go:356] "Generic (PLEG): container finished" podID="0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc" containerID="2d9a1667c78c037941173a1b4cbd67ca7f6536a5d1fd21e17efdc8c5408b8e03" exitCode=0
Sep 10 22:27:18.100858 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:18.100680    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h" event={"ID":"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc","Type":"ContainerDied","Data":"2d9a1667c78c037941173a1b4cbd67ca7f6536a5d1fd21e17efdc8c5408b8e03"}
Sep 10 22:27:18.168208 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:18.168183    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"
Sep 10 22:27:18.271370 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:18.271285    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-metrics-certs\") pod \"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc\" (UID: \"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc\") "
Sep 10 22:27:18.271370 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:18.271319    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blwc9\" (UniqueName: \"kubernetes.io/projected/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-kube-api-access-blwc9\") pod \"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc\" (UID: \"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc\") "
Sep 10 22:27:18.271370 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:18.271361    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-openshift-service-ca\") pod \"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc\" (UID: \"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc\") "
Sep 10 22:27:18.271646 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:18.271500    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-maas-api-tls\") pod \"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc\" (UID: \"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc\") "
Sep 10 22:27:18.271747 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:18.271722    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc" (UID: "0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:27:18.272125 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:18.271998    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-openshift-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:27:18.273735 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:18.273708    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc" (UID: "0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:27:18.273890 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:18.273737    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-kube-api-access-blwc9" (OuterVolumeSpecName: "kube-api-access-blwc9") pod "0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc" (UID: "0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc"). InnerVolumeSpecName "kube-api-access-blwc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:27:18.273890 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:18.273818    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc" (UID: "0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:27:18.373494 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:18.373455    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-maas-api-tls\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:27:18.373494 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:18.373488    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-metrics-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:27:18.373494 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:18.373497    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blwc9\" (UniqueName: \"kubernetes.io/projected/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc-kube-api-access-blwc9\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:27:19.108187 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:19.108151    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"
Sep 10 22:27:19.108587 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:19.108150    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h" event={"ID":"0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc","Type":"ContainerDied","Data":"a846de0e996efb1f305b8ea4548625bdf579d3d7ecdc733b397b6e5d93bcccaa"}
Sep 10 22:27:19.108587 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:19.108285    2577 scope.go:117] "RemoveContainer" containerID="2d9a1667c78c037941173a1b4cbd67ca7f6536a5d1fd21e17efdc8c5408b8e03"
Sep 10 22:27:19.130038 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:19.130003    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"]
Sep 10 22:27:19.137756 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:19.137691    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a9b3ec-569dfd4455-kjh7h"]
Sep 10 22:27:19.847484 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:19.847450    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc" path="/var/lib/kubelet/pods/0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc/volumes"
Sep 10 22:27:20.865158 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:20.865128    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:27:24.956642 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:24.956603    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"]
Sep 10 22:27:24.957168 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:24.956880    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw" podUID="09ff6320-60ea-4b7b-87d2-547a31866300" containerName="istio-proxy" containerID="cri-o://f9a4882abfaf4799e29b74c4650ddd49978a38f281db125f451d69c4ab487a9a" gracePeriod=30
Sep 10 22:27:30.177218 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.177180    2577 generic.go:356] "Generic (PLEG): container finished" podID="09ff6320-60ea-4b7b-87d2-547a31866300" containerID="f9a4882abfaf4799e29b74c4650ddd49978a38f281db125f451d69c4ab487a9a" exitCode=0
Sep 10 22:27:30.177619 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.177261    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw" event={"ID":"09ff6320-60ea-4b7b-87d2-547a31866300","Type":"ContainerDied","Data":"f9a4882abfaf4799e29b74c4650ddd49978a38f281db125f451d69c4ab487a9a"}
Sep 10 22:27:30.177619 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.177336    2577 scope.go:117] "RemoveContainer" containerID="4c944970f7eca752d6c68b187864708d0c377a27524dec125307339427453e8e"
Sep 10 22:27:30.219793 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.219714    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:27:30.385715 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.385677    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ff6320-60ea-4b7b-87d2-547a31866300-istio-podinfo\") pod \"09ff6320-60ea-4b7b-87d2-547a31866300\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") "
Sep 10 22:27:30.385951 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.385732    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ff6320-60ea-4b7b-87d2-547a31866300-istiod-ca-cert\") pod \"09ff6320-60ea-4b7b-87d2-547a31866300\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") "
Sep 10 22:27:30.385951 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.385770    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-istio-envoy\") pod \"09ff6320-60ea-4b7b-87d2-547a31866300\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") "
Sep 10 22:27:30.385951 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.385823    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-workload-certs\") pod \"09ff6320-60ea-4b7b-87d2-547a31866300\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") "
Sep 10 22:27:30.385951 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.385870    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44b8l\" (UniqueName: \"kubernetes.io/projected/09ff6320-60ea-4b7b-87d2-547a31866300-kube-api-access-44b8l\") pod \"09ff6320-60ea-4b7b-87d2-547a31866300\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") "
Sep 10 22:27:30.385951 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.385899    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-istio-data\") pod \"09ff6320-60ea-4b7b-87d2-547a31866300\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") "
Sep 10 22:27:30.385951 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.385924    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ff6320-60ea-4b7b-87d2-547a31866300-istio-token\") pod \"09ff6320-60ea-4b7b-87d2-547a31866300\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") "
Sep 10 22:27:30.386263 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.385965    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-credential-socket\") pod \"09ff6320-60ea-4b7b-87d2-547a31866300\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") "
Sep 10 22:27:30.386263 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.386008    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-workload-socket\") pod \"09ff6320-60ea-4b7b-87d2-547a31866300\" (UID: \"09ff6320-60ea-4b7b-87d2-547a31866300\") "
Sep 10 22:27:30.386263 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.386200    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-istio-data" (OuterVolumeSpecName: "istio-data") pod "09ff6320-60ea-4b7b-87d2-547a31866300" (UID: "09ff6320-60ea-4b7b-87d2-547a31866300"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:27:30.386263 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.386216    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "09ff6320-60ea-4b7b-87d2-547a31866300" (UID: "09ff6320-60ea-4b7b-87d2-547a31866300"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:27:30.386474 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.386406    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-workload-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:27:30.386474 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.386425    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-istio-data\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:27:30.386474 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.386427    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "09ff6320-60ea-4b7b-87d2-547a31866300" (UID: "09ff6320-60ea-4b7b-87d2-547a31866300"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:27:30.386474 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.386445    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "09ff6320-60ea-4b7b-87d2-547a31866300" (UID: "09ff6320-60ea-4b7b-87d2-547a31866300"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:27:30.386604 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.386474    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09ff6320-60ea-4b7b-87d2-547a31866300-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "09ff6320-60ea-4b7b-87d2-547a31866300" (UID: "09ff6320-60ea-4b7b-87d2-547a31866300"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:27:30.388237 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.388218    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "09ff6320-60ea-4b7b-87d2-547a31866300" (UID: "09ff6320-60ea-4b7b-87d2-547a31866300"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:27:30.388453 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.388435    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09ff6320-60ea-4b7b-87d2-547a31866300-istio-token" (OuterVolumeSpecName: "istio-token") pod "09ff6320-60ea-4b7b-87d2-547a31866300" (UID: "09ff6320-60ea-4b7b-87d2-547a31866300"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:27:30.388656 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.388635    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09ff6320-60ea-4b7b-87d2-547a31866300-kube-api-access-44b8l" (OuterVolumeSpecName: "kube-api-access-44b8l") pod "09ff6320-60ea-4b7b-87d2-547a31866300" (UID: "09ff6320-60ea-4b7b-87d2-547a31866300"). InnerVolumeSpecName "kube-api-access-44b8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:27:30.388656 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.388644    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/09ff6320-60ea-4b7b-87d2-547a31866300-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "09ff6320-60ea-4b7b-87d2-547a31866300" (UID: "09ff6320-60ea-4b7b-87d2-547a31866300"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:27:30.487772 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.487674    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-credential-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:27:30.487772 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.487707    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-workload-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:27:30.487772 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.487721    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ff6320-60ea-4b7b-87d2-547a31866300-istio-podinfo\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:27:30.487772 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.487732    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ff6320-60ea-4b7b-87d2-547a31866300-istiod-ca-cert\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:27:30.487772 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.487744    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ff6320-60ea-4b7b-87d2-547a31866300-istio-envoy\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:27:30.487772 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.487756    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44b8l\" (UniqueName: \"kubernetes.io/projected/09ff6320-60ea-4b7b-87d2-547a31866300-kube-api-access-44b8l\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:27:30.487772 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:30.487768    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ff6320-60ea-4b7b-87d2-547a31866300-istio-token\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:27:31.184359 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:31.184328    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"
Sep 10 22:27:31.184359 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:31.184342    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw" event={"ID":"09ff6320-60ea-4b7b-87d2-547a31866300","Type":"ContainerDied","Data":"6d3310c085bb30dc8d7e1c905951e69cde2dcc6f62b4a81bcaa90dd3f644d995"}
Sep 10 22:27:31.184903 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:31.184410    2577 scope.go:117] "RemoveContainer" containerID="f9a4882abfaf4799e29b74c4650ddd49978a38f281db125f451d69c4ab487a9a"
Sep 10 22:27:31.205439 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:31.205413    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"]
Sep 10 22:27:31.211896 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:31.211872    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-a9b3ec-openshift-default-5785dd7486-ltgqw"]
Sep 10 22:27:31.848214 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:31.848181    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09ff6320-60ea-4b7b-87d2-547a31866300" path="/var/lib/kubelet/pods/09ff6320-60ea-4b7b-87d2-547a31866300/volumes"
Sep 10 22:27:33.060772 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:33.060730    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:27:43.067964 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:43.067925    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:27:50.505439 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.505399    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"]
Sep 10 22:27:50.505828 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.505813    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09ff6320-60ea-4b7b-87d2-547a31866300" containerName="istio-proxy"
Sep 10 22:27:50.505892 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.505830    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="09ff6320-60ea-4b7b-87d2-547a31866300" containerName="istio-proxy"
Sep 10 22:27:50.505892 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.505839    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc" containerName="maas-api"
Sep 10 22:27:50.505892 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.505845    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc" containerName="maas-api"
Sep 10 22:27:50.505892 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.505853    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" containerName="istio-proxy"
Sep 10 22:27:50.505892 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.505859    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" containerName="istio-proxy"
Sep 10 22:27:50.505892 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.505868    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92ce1629-71f9-46df-9ae9-3415d16296ee" containerName="maas-api"
Sep 10 22:27:50.505892 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.505874    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="92ce1629-71f9-46df-9ae9-3415d16296ee" containerName="maas-api"
Sep 10 22:27:50.505892 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.505879    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" containerName="istio-proxy"
Sep 10 22:27:50.505892 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.505884    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" containerName="istio-proxy"
Sep 10 22:27:50.505892 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.505891    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" containerName="istio-proxy"
Sep 10 22:27:50.505892 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.505896    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" containerName="istio-proxy"
Sep 10 22:27:50.506272 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.505903    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" containerName="istio-proxy"
Sep 10 22:27:50.506272 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.505908    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" containerName="istio-proxy"
Sep 10 22:27:50.506272 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.505914    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e557907-ffd1-4563-a155-ca912c2811ee" containerName="test-curl-7511-b1c502"
Sep 10 22:27:50.506272 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.505921    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e557907-ffd1-4563-a155-ca912c2811ee" containerName="test-curl-7511-b1c502"
Sep 10 22:27:50.506272 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.505932    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="796a0558-5eb1-4842-af37-de62f0eb79b6" containerName="maas-api"
Sep 10 22:27:50.506272 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.505938    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="796a0558-5eb1-4842-af37-de62f0eb79b6" containerName="maas-api"
Sep 10 22:27:50.506272 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.505991    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" containerName="istio-proxy"
Sep 10 22:27:50.506272 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.505997    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" containerName="istio-proxy"
Sep 10 22:27:50.506272 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.506003    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fd1b4a4-6806-44ec-bef4-6bd48fd88ecc" containerName="maas-api"
Sep 10 22:27:50.506272 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.506010    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="09ff6320-60ea-4b7b-87d2-547a31866300" containerName="istio-proxy"
Sep 10 22:27:50.506272 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.506016    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e557907-ffd1-4563-a155-ca912c2811ee" containerName="test-curl-7511-b1c502"
Sep 10 22:27:50.506272 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.506022    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="eac5439d-1dec-4fcf-885e-05e7a3ae3d4e" containerName="istio-proxy"
Sep 10 22:27:50.506272 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.506027    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="09ff6320-60ea-4b7b-87d2-547a31866300" containerName="istio-proxy"
Sep 10 22:27:50.506272 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.506032    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="92ce1629-71f9-46df-9ae9-3415d16296ee" containerName="maas-api"
Sep 10 22:27:50.506272 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.506036    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2a78fe8-89bb-4e13-b7f5-c7e469471d7d" containerName="istio-proxy"
Sep 10 22:27:50.506272 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.506041    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="796a0558-5eb1-4842-af37-de62f0eb79b6" containerName="maas-api"
Sep 10 22:27:50.510382 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.510362    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.515354 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.515330    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-a12859-openshift-default-dockercfg-9z69q\""
Sep 10 22:27:50.534724 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.534689    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"]
Sep 10 22:27:50.569221 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.569158    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pnwx\" (UniqueName: \"kubernetes.io/projected/098b6188-d967-4145-8ffb-886b358b3cca-kube-api-access-5pnwx\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.569221 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.569195    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/098b6188-d967-4145-8ffb-886b358b3cca-istio-podinfo\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.569442 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.569221    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-workload-socket\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.569442 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.569271    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/098b6188-d967-4145-8ffb-886b358b3cca-istio-token\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.569442 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.569302    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/098b6188-d967-4145-8ffb-886b358b3cca-istiod-ca-cert\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.569442 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.569356    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-istio-envoy\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.569442 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.569372    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-istio-data\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.569442 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.569400    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-workload-certs\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.569442 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.569439    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-credential-socket\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.670593 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.670561    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-istio-data\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.670762 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.670606    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-workload-certs\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.670762 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.670634    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-credential-socket\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.670762 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.670679    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pnwx\" (UniqueName: \"kubernetes.io/projected/098b6188-d967-4145-8ffb-886b358b3cca-kube-api-access-5pnwx\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.670762 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.670708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/098b6188-d967-4145-8ffb-886b358b3cca-istio-podinfo\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.670762 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.670735    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-workload-socket\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.671053 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.670767    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/098b6188-d967-4145-8ffb-886b358b3cca-istio-token\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.671053 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.670823    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/098b6188-d967-4145-8ffb-886b358b3cca-istiod-ca-cert\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.671053 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.670872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-istio-envoy\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.671215 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.671094    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-credential-socket\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.671215 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.671092    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-istio-data\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.671343 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.671315    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-workload-socket\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.671554 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.671509    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-workload-certs\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.671829 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.671594    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/098b6188-d967-4145-8ffb-886b358b3cca-istiod-ca-cert\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.673476 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.673451    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-istio-envoy\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.673559 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.673537    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/098b6188-d967-4145-8ffb-886b358b3cca-istio-podinfo\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.678952 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.678933    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pnwx\" (UniqueName: \"kubernetes.io/projected/098b6188-d967-4145-8ffb-886b358b3cca-kube-api-access-5pnwx\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.679194 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.679173    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/098b6188-d967-4145-8ffb-886b358b3cca-istio-token\") pod \"e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") " pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:50.821250 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:50.821150    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:51.101049 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:51.101025    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"]
Sep 10 22:27:51.103237 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:27:51.103208    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod098b6188_d967_4145_8ffb_886b358b3cca.slice/crio-1e401c097b75f38ed4f1bea7e26a53912e33bf6eef6c09a0e098c5c91f7cb62b WatchSource:0}: Error finding container 1e401c097b75f38ed4f1bea7e26a53912e33bf6eef6c09a0e098c5c91f7cb62b: Status 404 returned error can't find the container with id 1e401c097b75f38ed4f1bea7e26a53912e33bf6eef6c09a0e098c5c91f7cb62b
Sep 10 22:27:51.105930 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:51.105895    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:27:51.106036 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:51.105968    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:27:51.106036 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:51.105997    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:27:51.298857 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:51.298818    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w" event={"ID":"098b6188-d967-4145-8ffb-886b358b3cca","Type":"ContainerStarted","Data":"8b15302e8e4c7b1fb7d04b16f557b0bbb792ae2141c2e6feb26c20b23256f01e"}
Sep 10 22:27:51.299024 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:51.298887    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w" event={"ID":"098b6188-d967-4145-8ffb-886b358b3cca","Type":"ContainerStarted","Data":"1e401c097b75f38ed4f1bea7e26a53912e33bf6eef6c09a0e098c5c91f7cb62b"}
Sep 10 22:27:51.319420 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:51.319353    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w" podStartSLOduration=1.3193300479999999 podStartE2EDuration="1.319330048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:27:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:27:51.317306272 +0000 UTC m=+1575.989404195" watchObservedRunningTime="2026-09-10 22:27:51.319330048 +0000 UTC m=+1575.991427970"
Sep 10 22:27:51.822081 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:51.822045    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:52.555600 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:52.555560    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:27:52.827246 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:52.827168    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:53.312175 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:53.312141    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:53.312998 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:53.312980    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:27:54.534576 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:54.534546    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"]
Sep 10 22:27:54.534978 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:54.534965    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09ff6320-60ea-4b7b-87d2-547a31866300" containerName="istio-proxy"
Sep 10 22:27:54.535033 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:54.534980    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="09ff6320-60ea-4b7b-87d2-547a31866300" containerName="istio-proxy"
Sep 10 22:27:54.538344 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:54.538275    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"
Sep 10 22:27:54.541193 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:54.541164    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-a12859-serving-cert\""
Sep 10 22:27:54.560569 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:54.560542    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"]
Sep 10 22:27:54.611143 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:54.611114    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwk59\" (UniqueName: \"kubernetes.io/projected/5f0d9286-c67a-4142-9baf-133b5a69e652-kube-api-access-mwk59\") pod \"maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r\" (UID: \"5f0d9286-c67a-4142-9baf-133b5a69e652\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"
Sep 10 22:27:54.611289 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:54.611167    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f0d9286-c67a-4142-9baf-133b5a69e652-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r\" (UID: \"5f0d9286-c67a-4142-9baf-133b5a69e652\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"
Sep 10 22:27:54.611289 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:54.611229    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f0d9286-c67a-4142-9baf-133b5a69e652-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r\" (UID: \"5f0d9286-c67a-4142-9baf-133b5a69e652\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"
Sep 10 22:27:54.611381 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:54.611296    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f0d9286-c67a-4142-9baf-133b5a69e652-metrics-certs\") pod \"maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r\" (UID: \"5f0d9286-c67a-4142-9baf-133b5a69e652\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"
Sep 10 22:27:54.712375 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:54.712342    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f0d9286-c67a-4142-9baf-133b5a69e652-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r\" (UID: \"5f0d9286-c67a-4142-9baf-133b5a69e652\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"
Sep 10 22:27:54.712578 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:54.712398    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f0d9286-c67a-4142-9baf-133b5a69e652-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r\" (UID: \"5f0d9286-c67a-4142-9baf-133b5a69e652\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"
Sep 10 22:27:54.712578 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:54.712434    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f0d9286-c67a-4142-9baf-133b5a69e652-metrics-certs\") pod \"maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r\" (UID: \"5f0d9286-c67a-4142-9baf-133b5a69e652\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"
Sep 10 22:27:54.712578 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:54.712464    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwk59\" (UniqueName: \"kubernetes.io/projected/5f0d9286-c67a-4142-9baf-133b5a69e652-kube-api-access-mwk59\") pod \"maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r\" (UID: \"5f0d9286-c67a-4142-9baf-133b5a69e652\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"
Sep 10 22:27:54.712772 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:27:54.712577    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-serving-cert: secret "maas-api-e2e-ipp-a-a12859-serving-cert" not found
Sep 10 22:27:54.712772 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:27:54.712655    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f0d9286-c67a-4142-9baf-133b5a69e652-maas-api-tls podName:5f0d9286-c67a-4142-9baf-133b5a69e652 nodeName:}" failed. No retries permitted until 2026-09-10 22:27:55.212633532 +0000 UTC m=+1579.884731459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5f0d9286-c67a-4142-9baf-133b5a69e652-maas-api-tls") pod "maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r" (UID: "5f0d9286-c67a-4142-9baf-133b5a69e652") : secret "maas-api-e2e-ipp-a-a12859-serving-cert" not found
Sep 10 22:27:54.713148 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:54.713129    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f0d9286-c67a-4142-9baf-133b5a69e652-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r\" (UID: \"5f0d9286-c67a-4142-9baf-133b5a69e652\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"
Sep 10 22:27:54.715022 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:54.715001    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f0d9286-c67a-4142-9baf-133b5a69e652-metrics-certs\") pod \"maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r\" (UID: \"5f0d9286-c67a-4142-9baf-133b5a69e652\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"
Sep 10 22:27:54.720879 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:54.720855    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwk59\" (UniqueName: \"kubernetes.io/projected/5f0d9286-c67a-4142-9baf-133b5a69e652-kube-api-access-mwk59\") pod \"maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r\" (UID: \"5f0d9286-c67a-4142-9baf-133b5a69e652\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"
Sep 10 22:27:55.218439 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:55.218399    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f0d9286-c67a-4142-9baf-133b5a69e652-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r\" (UID: \"5f0d9286-c67a-4142-9baf-133b5a69e652\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"
Sep 10 22:27:55.221010 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:55.220991    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f0d9286-c67a-4142-9baf-133b5a69e652-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r\" (UID: \"5f0d9286-c67a-4142-9baf-133b5a69e652\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"
Sep 10 22:27:55.451963 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:55.451929    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"
Sep 10 22:27:55.727381 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:55.727347    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"]
Sep 10 22:27:55.730590 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:27:55.730560    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f0d9286_c67a_4142_9baf_133b5a69e652.slice/crio-1b6c2407b7679e3ea2f2ae76f352112b1b9553624a424e5bac298f3f3dc4f304 WatchSource:0}: Error finding container 1b6c2407b7679e3ea2f2ae76f352112b1b9553624a424e5bac298f3f3dc4f304: Status 404 returned error can't find the container with id 1b6c2407b7679e3ea2f2ae76f352112b1b9553624a424e5bac298f3f3dc4f304
Sep 10 22:27:56.330305 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:56.330264    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r" event={"ID":"5f0d9286-c67a-4142-9baf-133b5a69e652","Type":"ContainerStarted","Data":"10415bf2f2d52b5c09b1b65cc3322f218d3bac8c13a034e6cb8a7ff39ea84bef"}
Sep 10 22:27:56.330483 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:56.330327    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"
Sep 10 22:27:56.330483 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:56.330344    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r" event={"ID":"5f0d9286-c67a-4142-9baf-133b5a69e652","Type":"ContainerStarted","Data":"1b6c2407b7679e3ea2f2ae76f352112b1b9553624a424e5bac298f3f3dc4f304"}
Sep 10 22:27:56.350995 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:27:56.350928    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r" podStartSLOduration=1.954773294 podStartE2EDuration="2.350907707s" totalImagesPullingTime="396.134413ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:27:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:27:56.347451334 +0000 UTC m=+1581.019549257" watchObservedRunningTime="2026-09-10 22:27:56.350907707 +0000 UTC m=+1581.023005631"
Sep 10 22:28:02.350147 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:02.350107    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"
Sep 10 22:28:03.172676 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:03.172638    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:28:08.460695 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:08.460662    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.91:15021/healthz/ready\": read tcp 10.134.0.2:58452->10.134.0.91:15021: read: connection reset by peer" start-of-body=
Sep 10 22:28:08.461152 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:08.460740    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w" podUID="098b6188-d967-4145-8ffb-886b358b3cca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.91:15021/healthz/ready\": read tcp 10.134.0.2:58452->10.134.0.91:15021: read: connection reset by peer"
Sep 10 22:28:09.416862 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:09.416830    2577 generic.go:356] "Generic (PLEG): container finished" podID="098b6188-d967-4145-8ffb-886b358b3cca" containerID="8b15302e8e4c7b1fb7d04b16f557b0bbb792ae2141c2e6feb26c20b23256f01e" exitCode=0
Sep 10 22:28:09.417030 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:09.416909    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w" event={"ID":"098b6188-d967-4145-8ffb-886b358b3cca","Type":"ContainerDied","Data":"8b15302e8e4c7b1fb7d04b16f557b0bbb792ae2141c2e6feb26c20b23256f01e"}
Sep 10 22:28:09.417340 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:09.417327    2577 scope.go:117] "RemoveContainer" containerID="8b15302e8e4c7b1fb7d04b16f557b0bbb792ae2141c2e6feb26c20b23256f01e"
Sep 10 22:28:09.418446 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:09.418417    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:28:09.418513 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:09.418496    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:28:09.418549 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:09.418527    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:28:10.424580 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:10.424545    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w" event={"ID":"098b6188-d967-4145-8ffb-886b358b3cca","Type":"ContainerStarted","Data":"636a1f3901af25f5f2b4aa2846a4207d488760173ebd994036233a25edf38db9"}
Sep 10 22:28:10.821735 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:10.821636    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:28:10.821959 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:10.821937    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused" start-of-body=
Sep 10 22:28:10.822004 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:10.821986    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w" podUID="098b6188-d967-4145-8ffb-886b358b3cca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused"
Sep 10 22:28:11.822127 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:11.822095    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused" start-of-body=
Sep 10 22:28:11.822510 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:11.822149    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w" podUID="098b6188-d967-4145-8ffb-886b358b3cca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused"
Sep 10 22:28:12.821822 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:12.821764    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused" start-of-body=
Sep 10 22:28:12.822010 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:12.821856    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w" podUID="098b6188-d967-4145-8ffb-886b358b3cca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused"
Sep 10 22:28:13.822063 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:13.822027    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused" start-of-body=
Sep 10 22:28:13.822484 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:13.822085    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w" podUID="098b6188-d967-4145-8ffb-886b358b3cca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused"
Sep 10 22:28:14.822179 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:14.822143    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused" start-of-body=
Sep 10 22:28:14.822580 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:14.822201    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w" podUID="098b6188-d967-4145-8ffb-886b358b3cca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused"
Sep 10 22:28:15.822104 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:15.822069    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused" start-of-body=
Sep 10 22:28:15.822292 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:15.822123    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w" podUID="098b6188-d967-4145-8ffb-886b358b3cca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused"
Sep 10 22:28:16.825435 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:16.825407    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:28:16.825845 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:16.825718    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:28:16.826382 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:16.826366    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:28:23.174843 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:23.174803    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"]
Sep 10 22:28:23.177394 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:23.177376    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"
Sep 10 22:28:23.179391 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:23.179372    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-79434a-serving-cert\""
Sep 10 22:28:23.188832 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:23.188773    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"]
Sep 10 22:28:23.286066 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:23.286029    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90746daf-3304-4b96-9f24-f6ceeb167fc2-maas-api-tls\") pod \"maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6\" (UID: \"90746daf-3304-4b96-9f24-f6ceeb167fc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"
Sep 10 22:28:23.286253 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:23.286100    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90746daf-3304-4b96-9f24-f6ceeb167fc2-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6\" (UID: \"90746daf-3304-4b96-9f24-f6ceeb167fc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"
Sep 10 22:28:23.286253 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:23.286135    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90746daf-3304-4b96-9f24-f6ceeb167fc2-metrics-certs\") pod \"maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6\" (UID: \"90746daf-3304-4b96-9f24-f6ceeb167fc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"
Sep 10 22:28:23.286253 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:23.286233    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pmh9\" (UniqueName: \"kubernetes.io/projected/90746daf-3304-4b96-9f24-f6ceeb167fc2-kube-api-access-2pmh9\") pod \"maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6\" (UID: \"90746daf-3304-4b96-9f24-f6ceeb167fc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"
Sep 10 22:28:23.387517 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:23.387474    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90746daf-3304-4b96-9f24-f6ceeb167fc2-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6\" (UID: \"90746daf-3304-4b96-9f24-f6ceeb167fc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"
Sep 10 22:28:23.387695 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:23.387547    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90746daf-3304-4b96-9f24-f6ceeb167fc2-metrics-certs\") pod \"maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6\" (UID: \"90746daf-3304-4b96-9f24-f6ceeb167fc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"
Sep 10 22:28:23.387695 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:23.387575    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pmh9\" (UniqueName: \"kubernetes.io/projected/90746daf-3304-4b96-9f24-f6ceeb167fc2-kube-api-access-2pmh9\") pod \"maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6\" (UID: \"90746daf-3304-4b96-9f24-f6ceeb167fc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"
Sep 10 22:28:23.387695 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:23.387630    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90746daf-3304-4b96-9f24-f6ceeb167fc2-maas-api-tls\") pod \"maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6\" (UID: \"90746daf-3304-4b96-9f24-f6ceeb167fc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"
Sep 10 22:28:23.388213 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:23.388192    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90746daf-3304-4b96-9f24-f6ceeb167fc2-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6\" (UID: \"90746daf-3304-4b96-9f24-f6ceeb167fc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"
Sep 10 22:28:23.390397 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:23.390373    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90746daf-3304-4b96-9f24-f6ceeb167fc2-metrics-certs\") pod \"maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6\" (UID: \"90746daf-3304-4b96-9f24-f6ceeb167fc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"
Sep 10 22:28:23.390509 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:23.390437    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90746daf-3304-4b96-9f24-f6ceeb167fc2-maas-api-tls\") pod \"maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6\" (UID: \"90746daf-3304-4b96-9f24-f6ceeb167fc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"
Sep 10 22:28:23.395767 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:23.395746    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pmh9\" (UniqueName: \"kubernetes.io/projected/90746daf-3304-4b96-9f24-f6ceeb167fc2-kube-api-access-2pmh9\") pod \"maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6\" (UID: \"90746daf-3304-4b96-9f24-f6ceeb167fc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"
Sep 10 22:28:23.488852 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:23.488741    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"
Sep 10 22:28:23.765518 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:23.765494    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"]
Sep 10 22:28:23.767358 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:28:23.767332    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90746daf_3304_4b96_9f24_f6ceeb167fc2.slice/crio-7d40ec8d9528da1387e944a74fbdbf1dd34f469e611f61ecfc818213fbe697ec WatchSource:0}: Error finding container 7d40ec8d9528da1387e944a74fbdbf1dd34f469e611f61ecfc818213fbe697ec: Status 404 returned error can't find the container with id 7d40ec8d9528da1387e944a74fbdbf1dd34f469e611f61ecfc818213fbe697ec
Sep 10 22:28:24.520479 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:24.517658    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6" event={"ID":"90746daf-3304-4b96-9f24-f6ceeb167fc2","Type":"ContainerStarted","Data":"302411f1523bb6f3897f54a870655a184dcb03c507322d959c6d819378cc26b3"}
Sep 10 22:28:24.520479 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:24.517726    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6" event={"ID":"90746daf-3304-4b96-9f24-f6ceeb167fc2","Type":"ContainerStarted","Data":"7d40ec8d9528da1387e944a74fbdbf1dd34f469e611f61ecfc818213fbe697ec"}
Sep 10 22:28:24.520479 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:24.518552    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"
Sep 10 22:28:24.536576 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:24.536517    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6" podStartSLOduration=1.155687226 podStartE2EDuration="1.536497344s" totalImagesPullingTime="380.810118ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:28:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:28:24.534297213 +0000 UTC m=+1609.206395135" watchObservedRunningTime="2026-09-10 22:28:24.536497344 +0000 UTC m=+1609.208595302"
Sep 10 22:28:30.158454 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:30.158364    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:28:31.534601 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:31.534568    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"
Sep 10 22:28:52.205125 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:28:52.205090    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-6dszf_c832a3f5-34f9-4b44-bb0e-329861d77d1d/payload-processing/0.log"
Sep 10 22:29:04.769920 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:04.769885    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:29:21.656266 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:21.656234    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:29:28.070410 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.070381    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-6dszf_c832a3f5-34f9-4b44-bb0e-329861d77d1d/payload-processing/0.log"
Sep 10 22:29:28.848093 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.848058    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"]
Sep 10 22:29:28.851759 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.851742    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.860822 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.854421    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-996d51-openshift-default-dockercfg-264t4\""
Sep 10 22:29:28.871416 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.871386    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"]
Sep 10 22:29:28.896225 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.896186    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-workload-socket\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.896433 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.896239    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-credential-socket\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.896433 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.896297    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-data\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.896433 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.896404    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs7f7\" (UniqueName: \"kubernetes.io/projected/7e495264-e759-40ea-a0b1-37e5a69f836d-kube-api-access-gs7f7\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.896582 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.896460    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-token\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.896582 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.896501    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e495264-e759-40ea-a0b1-37e5a69f836d-istiod-ca-cert\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.896582 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.896551    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-envoy\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.896582 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.896566    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-podinfo\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.896742 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.896629    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-workload-certs\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.997268 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.997234    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs7f7\" (UniqueName: \"kubernetes.io/projected/7e495264-e759-40ea-a0b1-37e5a69f836d-kube-api-access-gs7f7\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.997268 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.997273    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-token\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.997576 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.997297    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e495264-e759-40ea-a0b1-37e5a69f836d-istiod-ca-cert\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.997576 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.997333    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-envoy\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.997576 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.997469    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-podinfo\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.997576 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.997558    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-workload-certs\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.997832 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.997610    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-workload-socket\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.997832 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.997648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-credential-socket\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.997832 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.997686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-data\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.997996 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.997968    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-workload-certs\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.998061 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.998006    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-workload-socket\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.998194 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.998172    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e495264-e759-40ea-a0b1-37e5a69f836d-istiod-ca-cert\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.998249 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.998236    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-credential-socket\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:28.998301 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:28.998277    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-data\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:29.000379 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:29.000357    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-envoy\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:29.000510 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:29.000494    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-podinfo\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:29.014720 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:29.014690    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-token\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:29.015064 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:29.015041    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs7f7\" (UniqueName: \"kubernetes.io/projected/7e495264-e759-40ea-a0b1-37e5a69f836d-kube-api-access-gs7f7\") pod \"e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") " pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:29.168724 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:29.168698    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:29.451020 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:29.450995    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"]
Sep 10 22:29:29.452604 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:29:29.452581    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e495264_e759_40ea_a0b1_37e5a69f836d.slice/crio-656f808328f5c41d3cb24ec5c40c57d00e3402f3ea761c43a0f79a4537f6fbae WatchSource:0}: Error finding container 656f808328f5c41d3cb24ec5c40c57d00e3402f3ea761c43a0f79a4537f6fbae: Status 404 returned error can't find the container with id 656f808328f5c41d3cb24ec5c40c57d00e3402f3ea761c43a0f79a4537f6fbae
Sep 10 22:29:29.454754 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:29.454724    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:29:29.454841 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:29.454828    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:29:29.454888 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:29.454863    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:29:29.896120 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:29.896084    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8" event={"ID":"7e495264-e759-40ea-a0b1-37e5a69f836d","Type":"ContainerStarted","Data":"04502c6099db8fcf2deb42ddac81ffa794eee8e68de2f7eb9a29c9f68ab6bfbb"}
Sep 10 22:29:29.896296 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:29.896150    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8" event={"ID":"7e495264-e759-40ea-a0b1-37e5a69f836d","Type":"ContainerStarted","Data":"656f808328f5c41d3cb24ec5c40c57d00e3402f3ea761c43a0f79a4537f6fbae"}
Sep 10 22:29:29.916133 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:29.916086    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8" podStartSLOduration=1.916068441 podStartE2EDuration="1.916068441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:29:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:29:29.915419733 +0000 UTC m=+1674.587517655" watchObservedRunningTime="2026-09-10 22:29:29.916068441 +0000 UTC m=+1674.588166436"
Sep 10 22:29:30.170020 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:30.169934    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:30.175249 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:30.175225    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:30.902748 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:30.902717    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:30.904335 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:30.904316    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:32.998572 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:32.998539    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"]
Sep 10 22:29:33.003038 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:33.003010    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"
Sep 10 22:29:33.005515 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:33.005482    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-996d51-serving-cert\""
Sep 10 22:29:33.017122 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:33.017090    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"]
Sep 10 22:29:33.137582 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:33.137549    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwhf2\" (UniqueName: \"kubernetes.io/projected/5f84c10b-c6fc-4776-aa6d-146948e663bf-kube-api-access-xwhf2\") pod \"maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd\" (UID: \"5f84c10b-c6fc-4776-aa6d-146948e663bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"
Sep 10 22:29:33.137582 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:33.137588    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f84c10b-c6fc-4776-aa6d-146948e663bf-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd\" (UID: \"5f84c10b-c6fc-4776-aa6d-146948e663bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"
Sep 10 22:29:33.137828 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:33.137665    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f84c10b-c6fc-4776-aa6d-146948e663bf-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd\" (UID: \"5f84c10b-c6fc-4776-aa6d-146948e663bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"
Sep 10 22:29:33.137828 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:33.137689    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f84c10b-c6fc-4776-aa6d-146948e663bf-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd\" (UID: \"5f84c10b-c6fc-4776-aa6d-146948e663bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"
Sep 10 22:29:33.238757 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:33.238717    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwhf2\" (UniqueName: \"kubernetes.io/projected/5f84c10b-c6fc-4776-aa6d-146948e663bf-kube-api-access-xwhf2\") pod \"maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd\" (UID: \"5f84c10b-c6fc-4776-aa6d-146948e663bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"
Sep 10 22:29:33.238990 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:33.238769    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f84c10b-c6fc-4776-aa6d-146948e663bf-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd\" (UID: \"5f84c10b-c6fc-4776-aa6d-146948e663bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"
Sep 10 22:29:33.238990 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:33.238897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f84c10b-c6fc-4776-aa6d-146948e663bf-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd\" (UID: \"5f84c10b-c6fc-4776-aa6d-146948e663bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"
Sep 10 22:29:33.238990 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:33.238933    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f84c10b-c6fc-4776-aa6d-146948e663bf-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd\" (UID: \"5f84c10b-c6fc-4776-aa6d-146948e663bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"
Sep 10 22:29:33.239235 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:29:33.239044    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-serving-cert: secret "maas-api-e2e-ipp-cleanup-996d51-serving-cert" not found
Sep 10 22:29:33.239235 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:29:33.239136    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f84c10b-c6fc-4776-aa6d-146948e663bf-maas-api-tls podName:5f84c10b-c6fc-4776-aa6d-146948e663bf nodeName:}" failed. No retries permitted until 2026-09-10 22:29:33.739113921 +0000 UTC m=+1678.411211830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5f84c10b-c6fc-4776-aa6d-146948e663bf-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd" (UID: "5f84c10b-c6fc-4776-aa6d-146948e663bf") : secret "maas-api-e2e-ipp-cleanup-996d51-serving-cert" not found
Sep 10 22:29:33.239686 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:33.239667    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f84c10b-c6fc-4776-aa6d-146948e663bf-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd\" (UID: \"5f84c10b-c6fc-4776-aa6d-146948e663bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"
Sep 10 22:29:33.241462 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:33.241443    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f84c10b-c6fc-4776-aa6d-146948e663bf-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd\" (UID: \"5f84c10b-c6fc-4776-aa6d-146948e663bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"
Sep 10 22:29:33.248434 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:33.248412    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwhf2\" (UniqueName: \"kubernetes.io/projected/5f84c10b-c6fc-4776-aa6d-146948e663bf-kube-api-access-xwhf2\") pod \"maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd\" (UID: \"5f84c10b-c6fc-4776-aa6d-146948e663bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"
Sep 10 22:29:33.745533 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:33.745502    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f84c10b-c6fc-4776-aa6d-146948e663bf-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd\" (UID: \"5f84c10b-c6fc-4776-aa6d-146948e663bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"
Sep 10 22:29:33.748251 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:33.748227    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f84c10b-c6fc-4776-aa6d-146948e663bf-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd\" (UID: \"5f84c10b-c6fc-4776-aa6d-146948e663bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"
Sep 10 22:29:33.921669 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:33.921642    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"
Sep 10 22:29:34.232160 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:34.232135    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"]
Sep 10 22:29:34.234513 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:29:34.234483    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f84c10b_c6fc_4776_aa6d_146948e663bf.slice/crio-fa1c3705299a29c6acbbd0cae3f80cf3003be3badfa3106f7269bd902a68e8a8 WatchSource:0}: Error finding container fa1c3705299a29c6acbbd0cae3f80cf3003be3badfa3106f7269bd902a68e8a8: Status 404 returned error can't find the container with id fa1c3705299a29c6acbbd0cae3f80cf3003be3badfa3106f7269bd902a68e8a8
Sep 10 22:29:34.930345 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:34.930256    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd" event={"ID":"5f84c10b-c6fc-4776-aa6d-146948e663bf","Type":"ContainerStarted","Data":"42f950916adea88d2094b2a3406260867b1c8453552a78d895b73e12fde8d829"}
Sep 10 22:29:34.930345 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:34.930311    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd" event={"ID":"5f84c10b-c6fc-4776-aa6d-146948e663bf","Type":"ContainerStarted","Data":"fa1c3705299a29c6acbbd0cae3f80cf3003be3badfa3106f7269bd902a68e8a8"}
Sep 10 22:29:34.930563 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:34.930384    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"
Sep 10 22:29:34.982309 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:34.982256    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd" podStartSLOduration=2.55691051 podStartE2EDuration="2.982239141s" totalImagesPullingTime="425.328631ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:29:34.978022755 +0000 UTC m=+1679.650120676" watchObservedRunningTime="2026-09-10 22:29:34.982239141 +0000 UTC m=+1679.654337062"
Sep 10 22:29:40.941956 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:40.941926    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"
Sep 10 22:29:42.358463 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:42.358428    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:29:53.038328 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:53.038290    2577 generic.go:356] "Generic (PLEG): container finished" podID="7e495264-e759-40ea-a0b1-37e5a69f836d" containerID="04502c6099db8fcf2deb42ddac81ffa794eee8e68de2f7eb9a29c9f68ab6bfbb" exitCode=0
Sep 10 22:29:53.038769 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:53.038385    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8" event={"ID":"7e495264-e759-40ea-a0b1-37e5a69f836d","Type":"ContainerDied","Data":"04502c6099db8fcf2deb42ddac81ffa794eee8e68de2f7eb9a29c9f68ab6bfbb"}
Sep 10 22:29:53.038920 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:53.038906    2577 scope.go:117] "RemoveContainer" containerID="04502c6099db8fcf2deb42ddac81ffa794eee8e68de2f7eb9a29c9f68ab6bfbb"
Sep 10 22:29:53.040094 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:53.040058    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:29:53.040164 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:53.040155    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:29:53.040201 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:53.040187    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 22:29:54.053493 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:54.053457    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8" event={"ID":"7e495264-e759-40ea-a0b1-37e5a69f836d","Type":"ContainerStarted","Data":"2764ede9adc2966dd78165bf8f83225c23484893ba428b70f4c729092fc59fa5"}
Sep 10 22:29:54.169317 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:54.169277    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:29:54.169639 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:54.169617    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Sep 10 22:29:54.169691 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:54.169668    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8" podUID="7e495264-e759-40ea-a0b1-37e5a69f836d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Sep 10 22:29:55.169281 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:55.169244    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Sep 10 22:29:55.169688 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:55.169298    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8" podUID="7e495264-e759-40ea-a0b1-37e5a69f836d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Sep 10 22:29:56.169844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:56.169803    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Sep 10 22:29:56.170334 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:56.169885    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8" podUID="7e495264-e759-40ea-a0b1-37e5a69f836d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Sep 10 22:29:57.169853 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:57.169812    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Sep 10 22:29:57.170246 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:57.169873    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8" podUID="7e495264-e759-40ea-a0b1-37e5a69f836d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Sep 10 22:29:58.169703 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:58.169666    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Sep 10 22:29:58.169921 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:58.169726    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8" podUID="7e495264-e759-40ea-a0b1-37e5a69f836d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Sep 10 22:29:59.170093 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:59.170052    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Sep 10 22:29:59.170564 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:29:59.170125    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8" podUID="7e495264-e759-40ea-a0b1-37e5a69f836d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Sep 10 22:30:00.173610 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:00.173581    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:30:00.174102 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:00.174012    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:30:00.174859 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:00.174839    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:30:03.935602 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:03.935569    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"]
Sep 10 22:30:03.936026 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:03.935796    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd" podUID="5f84c10b-c6fc-4776-aa6d-146948e663bf" containerName="maas-api" containerID="cri-o://42f950916adea88d2094b2a3406260867b1c8453552a78d895b73e12fde8d829" gracePeriod=30
Sep 10 22:30:04.121283 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:04.121122    2577 generic.go:356] "Generic (PLEG): container finished" podID="5f84c10b-c6fc-4776-aa6d-146948e663bf" containerID="42f950916adea88d2094b2a3406260867b1c8453552a78d895b73e12fde8d829" exitCode=0
Sep 10 22:30:04.121283 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:04.121172    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd" event={"ID":"5f84c10b-c6fc-4776-aa6d-146948e663bf","Type":"ContainerDied","Data":"42f950916adea88d2094b2a3406260867b1c8453552a78d895b73e12fde8d829"}
Sep 10 22:30:04.198080 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:04.198017    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"
Sep 10 22:30:04.264438 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:04.264406    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwhf2\" (UniqueName: \"kubernetes.io/projected/5f84c10b-c6fc-4776-aa6d-146948e663bf-kube-api-access-xwhf2\") pod \"5f84c10b-c6fc-4776-aa6d-146948e663bf\" (UID: \"5f84c10b-c6fc-4776-aa6d-146948e663bf\") "
Sep 10 22:30:04.264601 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:04.264448    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f84c10b-c6fc-4776-aa6d-146948e663bf-metrics-certs\") pod \"5f84c10b-c6fc-4776-aa6d-146948e663bf\" (UID: \"5f84c10b-c6fc-4776-aa6d-146948e663bf\") "
Sep 10 22:30:04.264601 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:04.264522    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f84c10b-c6fc-4776-aa6d-146948e663bf-maas-api-tls\") pod \"5f84c10b-c6fc-4776-aa6d-146948e663bf\" (UID: \"5f84c10b-c6fc-4776-aa6d-146948e663bf\") "
Sep 10 22:30:04.264601 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:04.264592    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f84c10b-c6fc-4776-aa6d-146948e663bf-openshift-service-ca\") pod \"5f84c10b-c6fc-4776-aa6d-146948e663bf\" (UID: \"5f84c10b-c6fc-4776-aa6d-146948e663bf\") "
Sep 10 22:30:04.265055 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:04.264997    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f84c10b-c6fc-4776-aa6d-146948e663bf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5f84c10b-c6fc-4776-aa6d-146948e663bf" (UID: "5f84c10b-c6fc-4776-aa6d-146948e663bf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:30:04.266668 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:04.266638    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f84c10b-c6fc-4776-aa6d-146948e663bf-kube-api-access-xwhf2" (OuterVolumeSpecName: "kube-api-access-xwhf2") pod "5f84c10b-c6fc-4776-aa6d-146948e663bf" (UID: "5f84c10b-c6fc-4776-aa6d-146948e663bf"). InnerVolumeSpecName "kube-api-access-xwhf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:30:04.266808 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:04.266762    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f84c10b-c6fc-4776-aa6d-146948e663bf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5f84c10b-c6fc-4776-aa6d-146948e663bf" (UID: "5f84c10b-c6fc-4776-aa6d-146948e663bf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:30:04.266862 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:04.266822    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f84c10b-c6fc-4776-aa6d-146948e663bf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5f84c10b-c6fc-4776-aa6d-146948e663bf" (UID: "5f84c10b-c6fc-4776-aa6d-146948e663bf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:30:04.365668 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:04.365628    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f84c10b-c6fc-4776-aa6d-146948e663bf-openshift-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:30:04.365668 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:04.365660    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwhf2\" (UniqueName: \"kubernetes.io/projected/5f84c10b-c6fc-4776-aa6d-146948e663bf-kube-api-access-xwhf2\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:30:04.365668 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:04.365670    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f84c10b-c6fc-4776-aa6d-146948e663bf-metrics-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:30:04.365668 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:04.365678    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f84c10b-c6fc-4776-aa6d-146948e663bf-maas-api-tls\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:30:05.128387 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:05.128355    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd" event={"ID":"5f84c10b-c6fc-4776-aa6d-146948e663bf","Type":"ContainerDied","Data":"fa1c3705299a29c6acbbd0cae3f80cf3003be3badfa3106f7269bd902a68e8a8"}
Sep 10 22:30:05.128387 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:05.128380    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"
Sep 10 22:30:05.128917 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:05.128419    2577 scope.go:117] "RemoveContainer" containerID="42f950916adea88d2094b2a3406260867b1c8453552a78d895b73e12fde8d829"
Sep 10 22:30:05.152325 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:05.152285    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"]
Sep 10 22:30:05.155296 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:05.155269    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-996d51-d56b75fcb-plnfd"]
Sep 10 22:30:05.849633 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:05.849586    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f84c10b-c6fc-4776-aa6d-146948e663bf" path="/var/lib/kubelet/pods/5f84c10b-c6fc-4776-aa6d-146948e663bf/volumes"
Sep 10 22:30:08.860277 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:08.860241    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:30:10.627743 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:10.627705    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"]
Sep 10 22:30:10.628236 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:10.627981    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8" podUID="7e495264-e759-40ea-a0b1-37e5a69f836d" containerName="istio-proxy" containerID="cri-o://2764ede9adc2966dd78165bf8f83225c23484893ba428b70f4c729092fc59fa5" gracePeriod=30
Sep 10 22:30:15.176606 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.176566    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 22:30:15.177017 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.176638    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8" podUID="7e495264-e759-40ea-a0b1-37e5a69f836d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 22:30:15.886897 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.886872    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:30:15.981551 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.981466    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-data\") pod \"7e495264-e759-40ea-a0b1-37e5a69f836d\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") "
Sep 10 22:30:15.981551 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.981514    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e495264-e759-40ea-a0b1-37e5a69f836d-istiod-ca-cert\") pod \"7e495264-e759-40ea-a0b1-37e5a69f836d\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") "
Sep 10 22:30:15.981551 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.981536    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-envoy\") pod \"7e495264-e759-40ea-a0b1-37e5a69f836d\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") "
Sep 10 22:30:15.981551 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.981552    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-credential-socket\") pod \"7e495264-e759-40ea-a0b1-37e5a69f836d\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") "
Sep 10 22:30:15.981997 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.981573    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-token\") pod \"7e495264-e759-40ea-a0b1-37e5a69f836d\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") "
Sep 10 22:30:15.981997 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.981605    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-podinfo\") pod \"7e495264-e759-40ea-a0b1-37e5a69f836d\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") "
Sep 10 22:30:15.981997 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.981621    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-workload-certs\") pod \"7e495264-e759-40ea-a0b1-37e5a69f836d\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") "
Sep 10 22:30:15.981997 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.981641    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-workload-socket\") pod \"7e495264-e759-40ea-a0b1-37e5a69f836d\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") "
Sep 10 22:30:15.981997 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.981659    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gs7f7\" (UniqueName: \"kubernetes.io/projected/7e495264-e759-40ea-a0b1-37e5a69f836d-kube-api-access-gs7f7\") pod \"7e495264-e759-40ea-a0b1-37e5a69f836d\" (UID: \"7e495264-e759-40ea-a0b1-37e5a69f836d\") "
Sep 10 22:30:15.981997 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.981830    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-data" (OuterVolumeSpecName: "istio-data") pod "7e495264-e759-40ea-a0b1-37e5a69f836d" (UID: "7e495264-e759-40ea-a0b1-37e5a69f836d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:30:15.981997 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.981896    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7e495264-e759-40ea-a0b1-37e5a69f836d" (UID: "7e495264-e759-40ea-a0b1-37e5a69f836d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:30:15.981997 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.981980    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e495264-e759-40ea-a0b1-37e5a69f836d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7e495264-e759-40ea-a0b1-37e5a69f836d" (UID: "7e495264-e759-40ea-a0b1-37e5a69f836d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:30:15.982456 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.982005    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7e495264-e759-40ea-a0b1-37e5a69f836d" (UID: "7e495264-e759-40ea-a0b1-37e5a69f836d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:30:15.982456 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.982045    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-data\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:30:15.982456 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.982061    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-credential-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:30:15.982456 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.982281    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7e495264-e759-40ea-a0b1-37e5a69f836d" (UID: "7e495264-e759-40ea-a0b1-37e5a69f836d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:30:15.983985 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.983960    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7e495264-e759-40ea-a0b1-37e5a69f836d" (UID: "7e495264-e759-40ea-a0b1-37e5a69f836d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:30:15.984094 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.984007    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7e495264-e759-40ea-a0b1-37e5a69f836d" (UID: "7e495264-e759-40ea-a0b1-37e5a69f836d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:30:15.984094 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.984062    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-token" (OuterVolumeSpecName: "istio-token") pod "7e495264-e759-40ea-a0b1-37e5a69f836d" (UID: "7e495264-e759-40ea-a0b1-37e5a69f836d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:30:15.984164 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:15.984101    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e495264-e759-40ea-a0b1-37e5a69f836d-kube-api-access-gs7f7" (OuterVolumeSpecName: "kube-api-access-gs7f7") pod "7e495264-e759-40ea-a0b1-37e5a69f836d" (UID: "7e495264-e759-40ea-a0b1-37e5a69f836d"). InnerVolumeSpecName "kube-api-access-gs7f7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:30:16.083594 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:16.083556    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-token\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:30:16.083594 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:16.083596    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-podinfo\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:30:16.083594 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:16.083606    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-workload-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:30:16.083928 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:16.083614    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-workload-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:30:16.083928 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:16.083627    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gs7f7\" (UniqueName: \"kubernetes.io/projected/7e495264-e759-40ea-a0b1-37e5a69f836d-kube-api-access-gs7f7\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:30:16.083928 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:16.083642    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e495264-e759-40ea-a0b1-37e5a69f836d-istiod-ca-cert\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:30:16.083928 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:16.083654    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e495264-e759-40ea-a0b1-37e5a69f836d-istio-envoy\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:30:16.202594 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:16.202556    2577 generic.go:356] "Generic (PLEG): container finished" podID="7e495264-e759-40ea-a0b1-37e5a69f836d" containerID="2764ede9adc2966dd78165bf8f83225c23484893ba428b70f4c729092fc59fa5" exitCode=0
Sep 10 22:30:16.203084 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:16.202617    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"
Sep 10 22:30:16.203084 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:16.202648    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8" event={"ID":"7e495264-e759-40ea-a0b1-37e5a69f836d","Type":"ContainerDied","Data":"2764ede9adc2966dd78165bf8f83225c23484893ba428b70f4c729092fc59fa5"}
Sep 10 22:30:16.203084 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:16.202748    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8" event={"ID":"7e495264-e759-40ea-a0b1-37e5a69f836d","Type":"ContainerDied","Data":"656f808328f5c41d3cb24ec5c40c57d00e3402f3ea761c43a0f79a4537f6fbae"}
Sep 10 22:30:16.203084 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:16.202806    2577 scope.go:117] "RemoveContainer" containerID="2764ede9adc2966dd78165bf8f83225c23484893ba428b70f4c729092fc59fa5"
Sep 10 22:30:16.213220 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:16.213202    2577 scope.go:117] "RemoveContainer" containerID="04502c6099db8fcf2deb42ddac81ffa794eee8e68de2f7eb9a29c9f68ab6bfbb"
Sep 10 22:30:16.222167 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:16.222146    2577 scope.go:117] "RemoveContainer" containerID="2764ede9adc2966dd78165bf8f83225c23484893ba428b70f4c729092fc59fa5"
Sep 10 22:30:16.222473 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:30:16.222451    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2764ede9adc2966dd78165bf8f83225c23484893ba428b70f4c729092fc59fa5\": container with ID starting with 2764ede9adc2966dd78165bf8f83225c23484893ba428b70f4c729092fc59fa5 not found: ID does not exist" containerID="2764ede9adc2966dd78165bf8f83225c23484893ba428b70f4c729092fc59fa5"
Sep 10 22:30:16.222551 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:16.222482    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2764ede9adc2966dd78165bf8f83225c23484893ba428b70f4c729092fc59fa5"} err="failed to get container status \"2764ede9adc2966dd78165bf8f83225c23484893ba428b70f4c729092fc59fa5\": rpc error: code = NotFound desc = could not find container \"2764ede9adc2966dd78165bf8f83225c23484893ba428b70f4c729092fc59fa5\": container with ID starting with 2764ede9adc2966dd78165bf8f83225c23484893ba428b70f4c729092fc59fa5 not found: ID does not exist"
Sep 10 22:30:16.222551 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:16.222501    2577 scope.go:117] "RemoveContainer" containerID="04502c6099db8fcf2deb42ddac81ffa794eee8e68de2f7eb9a29c9f68ab6bfbb"
Sep 10 22:30:16.222764 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:30:16.222747    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04502c6099db8fcf2deb42ddac81ffa794eee8e68de2f7eb9a29c9f68ab6bfbb\": container with ID starting with 04502c6099db8fcf2deb42ddac81ffa794eee8e68de2f7eb9a29c9f68ab6bfbb not found: ID does not exist" containerID="04502c6099db8fcf2deb42ddac81ffa794eee8e68de2f7eb9a29c9f68ab6bfbb"
Sep 10 22:30:16.222862 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:16.222771    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04502c6099db8fcf2deb42ddac81ffa794eee8e68de2f7eb9a29c9f68ab6bfbb"} err="failed to get container status \"04502c6099db8fcf2deb42ddac81ffa794eee8e68de2f7eb9a29c9f68ab6bfbb\": rpc error: code = NotFound desc = could not find container \"04502c6099db8fcf2deb42ddac81ffa794eee8e68de2f7eb9a29c9f68ab6bfbb\": container with ID starting with 04502c6099db8fcf2deb42ddac81ffa794eee8e68de2f7eb9a29c9f68ab6bfbb not found: ID does not exist"
Sep 10 22:30:16.240496 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:16.240433    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"]
Sep 10 22:30:16.248166 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:16.248141    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-996d51-openshift-default-6bcc945d96-z7nb8"]
Sep 10 22:30:17.848751 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:17.848715    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e495264-e759-40ea-a0b1-37e5a69f836d" path="/var/lib/kubelet/pods/7e495264-e759-40ea-a0b1-37e5a69f836d/volumes"
Sep 10 22:30:27.764813 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:27.764758    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:30:29.966076 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:29.966042    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"]
Sep 10 22:30:29.966653 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:29.966274    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r" podUID="5f0d9286-c67a-4142-9baf-133b5a69e652" containerName="maas-api" containerID="cri-o://10415bf2f2d52b5c09b1b65cc3322f218d3bac8c13a034e6cb8a7ff39ea84bef" gracePeriod=30
Sep 10 22:30:30.239108 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:30.239079    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"
Sep 10 22:30:30.286525 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:30.286489    2577 generic.go:356] "Generic (PLEG): container finished" podID="5f0d9286-c67a-4142-9baf-133b5a69e652" containerID="10415bf2f2d52b5c09b1b65cc3322f218d3bac8c13a034e6cb8a7ff39ea84bef" exitCode=0
Sep 10 22:30:30.286721 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:30.286539    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"
Sep 10 22:30:30.286721 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:30.286569    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r" event={"ID":"5f0d9286-c67a-4142-9baf-133b5a69e652","Type":"ContainerDied","Data":"10415bf2f2d52b5c09b1b65cc3322f218d3bac8c13a034e6cb8a7ff39ea84bef"}
Sep 10 22:30:30.286721 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:30.286636    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r" event={"ID":"5f0d9286-c67a-4142-9baf-133b5a69e652","Type":"ContainerDied","Data":"1b6c2407b7679e3ea2f2ae76f352112b1b9553624a424e5bac298f3f3dc4f304"}
Sep 10 22:30:30.286721 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:30.286665    2577 scope.go:117] "RemoveContainer" containerID="10415bf2f2d52b5c09b1b65cc3322f218d3bac8c13a034e6cb8a7ff39ea84bef"
Sep 10 22:30:30.296192 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:30.296172    2577 scope.go:117] "RemoveContainer" containerID="10415bf2f2d52b5c09b1b65cc3322f218d3bac8c13a034e6cb8a7ff39ea84bef"
Sep 10 22:30:30.296513 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:30:30.296494    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10415bf2f2d52b5c09b1b65cc3322f218d3bac8c13a034e6cb8a7ff39ea84bef\": container with ID starting with 10415bf2f2d52b5c09b1b65cc3322f218d3bac8c13a034e6cb8a7ff39ea84bef not found: ID does not exist" containerID="10415bf2f2d52b5c09b1b65cc3322f218d3bac8c13a034e6cb8a7ff39ea84bef"
Sep 10 22:30:30.296571 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:30.296523    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10415bf2f2d52b5c09b1b65cc3322f218d3bac8c13a034e6cb8a7ff39ea84bef"} err="failed to get container status \"10415bf2f2d52b5c09b1b65cc3322f218d3bac8c13a034e6cb8a7ff39ea84bef\": rpc error: code = NotFound desc = could not find container \"10415bf2f2d52b5c09b1b65cc3322f218d3bac8c13a034e6cb8a7ff39ea84bef\": container with ID starting with 10415bf2f2d52b5c09b1b65cc3322f218d3bac8c13a034e6cb8a7ff39ea84bef not found: ID does not exist"
Sep 10 22:30:30.321462 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:30.321435    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwk59\" (UniqueName: \"kubernetes.io/projected/5f0d9286-c67a-4142-9baf-133b5a69e652-kube-api-access-mwk59\") pod \"5f0d9286-c67a-4142-9baf-133b5a69e652\" (UID: \"5f0d9286-c67a-4142-9baf-133b5a69e652\") "
Sep 10 22:30:30.321595 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:30.321501    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f0d9286-c67a-4142-9baf-133b5a69e652-maas-api-tls\") pod \"5f0d9286-c67a-4142-9baf-133b5a69e652\" (UID: \"5f0d9286-c67a-4142-9baf-133b5a69e652\") "
Sep 10 22:30:30.321595 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:30.321533    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f0d9286-c67a-4142-9baf-133b5a69e652-metrics-certs\") pod \"5f0d9286-c67a-4142-9baf-133b5a69e652\" (UID: \"5f0d9286-c67a-4142-9baf-133b5a69e652\") "
Sep 10 22:30:30.321595 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:30.321588    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f0d9286-c67a-4142-9baf-133b5a69e652-openshift-service-ca\") pod \"5f0d9286-c67a-4142-9baf-133b5a69e652\" (UID: \"5f0d9286-c67a-4142-9baf-133b5a69e652\") "
Sep 10 22:30:30.321989 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:30.321965    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f0d9286-c67a-4142-9baf-133b5a69e652-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5f0d9286-c67a-4142-9baf-133b5a69e652" (UID: "5f0d9286-c67a-4142-9baf-133b5a69e652"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:30:30.323727 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:30.323700    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f0d9286-c67a-4142-9baf-133b5a69e652-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5f0d9286-c67a-4142-9baf-133b5a69e652" (UID: "5f0d9286-c67a-4142-9baf-133b5a69e652"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:30:30.323877 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:30.323848    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f0d9286-c67a-4142-9baf-133b5a69e652-kube-api-access-mwk59" (OuterVolumeSpecName: "kube-api-access-mwk59") pod "5f0d9286-c67a-4142-9baf-133b5a69e652" (UID: "5f0d9286-c67a-4142-9baf-133b5a69e652"). InnerVolumeSpecName "kube-api-access-mwk59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:30:30.323877 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:30.323864    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f0d9286-c67a-4142-9baf-133b5a69e652-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5f0d9286-c67a-4142-9baf-133b5a69e652" (UID: "5f0d9286-c67a-4142-9baf-133b5a69e652"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:30:30.422265 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:30.422229    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f0d9286-c67a-4142-9baf-133b5a69e652-maas-api-tls\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:30:30.422265 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:30.422268    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f0d9286-c67a-4142-9baf-133b5a69e652-metrics-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:30:30.422481 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:30.422278    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f0d9286-c67a-4142-9baf-133b5a69e652-openshift-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:30:30.422481 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:30.422288    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwk59\" (UniqueName: \"kubernetes.io/projected/5f0d9286-c67a-4142-9baf-133b5a69e652-kube-api-access-mwk59\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:30:30.609064 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:30.609032    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"]
Sep 10 22:30:30.613029 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:30.612999    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a12859-6b9b476d75-r8x9r"]
Sep 10 22:30:31.847548 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:31.847518    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f0d9286-c67a-4142-9baf-133b5a69e652" path="/var/lib/kubelet/pods/5f0d9286-c67a-4142-9baf-133b5a69e652/volumes"
Sep 10 22:30:37.008892 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:30:37.008857    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:31:18.953384 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:18.953343    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"]
Sep 10 22:31:18.953974 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:18.953574    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w" podUID="098b6188-d967-4145-8ffb-886b358b3cca" containerName="istio-proxy" containerID="cri-o://636a1f3901af25f5f2b4aa2846a4207d488760173ebd994036233a25edf38db9" gracePeriod=30
Sep 10 22:31:24.236274 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.236244    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:31:24.327947 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.327914    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pnwx\" (UniqueName: \"kubernetes.io/projected/098b6188-d967-4145-8ffb-886b358b3cca-kube-api-access-5pnwx\") pod \"098b6188-d967-4145-8ffb-886b358b3cca\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") "
Sep 10 22:31:24.327947 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.327951    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/098b6188-d967-4145-8ffb-886b358b3cca-istio-podinfo\") pod \"098b6188-d967-4145-8ffb-886b358b3cca\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") "
Sep 10 22:31:24.328226 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.327996    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-workload-socket\") pod \"098b6188-d967-4145-8ffb-886b358b3cca\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") "
Sep 10 22:31:24.328226 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.328110    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/098b6188-d967-4145-8ffb-886b358b3cca-istiod-ca-cert\") pod \"098b6188-d967-4145-8ffb-886b358b3cca\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") "
Sep 10 22:31:24.328226 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.328156    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-istio-data\") pod \"098b6188-d967-4145-8ffb-886b358b3cca\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") "
Sep 10 22:31:24.328226 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.328188    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-workload-certs\") pod \"098b6188-d967-4145-8ffb-886b358b3cca\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") "
Sep 10 22:31:24.328226 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.328222    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-istio-envoy\") pod \"098b6188-d967-4145-8ffb-886b358b3cca\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") "
Sep 10 22:31:24.328503 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.328256    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/098b6188-d967-4145-8ffb-886b358b3cca-istio-token\") pod \"098b6188-d967-4145-8ffb-886b358b3cca\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") "
Sep 10 22:31:24.328503 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.328286    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-credential-socket\") pod \"098b6188-d967-4145-8ffb-886b358b3cca\" (UID: \"098b6188-d967-4145-8ffb-886b358b3cca\") "
Sep 10 22:31:24.328503 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.328293    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "098b6188-d967-4145-8ffb-886b358b3cca" (UID: "098b6188-d967-4145-8ffb-886b358b3cca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:31:24.328503 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.328457    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-istio-data" (OuterVolumeSpecName: "istio-data") pod "098b6188-d967-4145-8ffb-886b358b3cca" (UID: "098b6188-d967-4145-8ffb-886b358b3cca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:31:24.328707 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.328528    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/098b6188-d967-4145-8ffb-886b358b3cca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "098b6188-d967-4145-8ffb-886b358b3cca" (UID: "098b6188-d967-4145-8ffb-886b358b3cca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:31:24.328707 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.328671    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "098b6188-d967-4145-8ffb-886b358b3cca" (UID: "098b6188-d967-4145-8ffb-886b358b3cca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:31:24.329062 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.328694    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "098b6188-d967-4145-8ffb-886b358b3cca" (UID: "098b6188-d967-4145-8ffb-886b358b3cca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:31:24.329062 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.328827    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-workload-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:31:24.329062 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.328845    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/098b6188-d967-4145-8ffb-886b358b3cca-istiod-ca-cert\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:31:24.329062 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.328858    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-istio-data\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:31:24.329062 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.328871    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-workload-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:31:24.329062 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.328883    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-credential-socket\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:31:24.330646 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.330616    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/098b6188-d967-4145-8ffb-886b358b3cca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "098b6188-d967-4145-8ffb-886b358b3cca" (UID: "098b6188-d967-4145-8ffb-886b358b3cca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:31:24.330646 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.330624    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "098b6188-d967-4145-8ffb-886b358b3cca" (UID: "098b6188-d967-4145-8ffb-886b358b3cca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:31:24.331042 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.331017    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/098b6188-d967-4145-8ffb-886b358b3cca-istio-token" (OuterVolumeSpecName: "istio-token") pod "098b6188-d967-4145-8ffb-886b358b3cca" (UID: "098b6188-d967-4145-8ffb-886b358b3cca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:31:24.331042 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.331032    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/098b6188-d967-4145-8ffb-886b358b3cca-kube-api-access-5pnwx" (OuterVolumeSpecName: "kube-api-access-5pnwx") pod "098b6188-d967-4145-8ffb-886b358b3cca" (UID: "098b6188-d967-4145-8ffb-886b358b3cca"). InnerVolumeSpecName "kube-api-access-5pnwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:31:24.429369 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.429331    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/098b6188-d967-4145-8ffb-886b358b3cca-istio-envoy\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:31:24.429369 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.429364    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/098b6188-d967-4145-8ffb-886b358b3cca-istio-token\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:31:24.429369 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.429376    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pnwx\" (UniqueName: \"kubernetes.io/projected/098b6188-d967-4145-8ffb-886b358b3cca-kube-api-access-5pnwx\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:31:24.429620 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.429392    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/098b6188-d967-4145-8ffb-886b358b3cca-istio-podinfo\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:31:24.607578 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.607484    2577 generic.go:356] "Generic (PLEG): container finished" podID="098b6188-d967-4145-8ffb-886b358b3cca" containerID="636a1f3901af25f5f2b4aa2846a4207d488760173ebd994036233a25edf38db9" exitCode=0
Sep 10 22:31:24.607578 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.607541    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"
Sep 10 22:31:24.607578 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.607567    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w" event={"ID":"098b6188-d967-4145-8ffb-886b358b3cca","Type":"ContainerDied","Data":"636a1f3901af25f5f2b4aa2846a4207d488760173ebd994036233a25edf38db9"}
Sep 10 22:31:24.607818 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.607624    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w" event={"ID":"098b6188-d967-4145-8ffb-886b358b3cca","Type":"ContainerDied","Data":"1e401c097b75f38ed4f1bea7e26a53912e33bf6eef6c09a0e098c5c91f7cb62b"}
Sep 10 22:31:24.607818 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.607655    2577 scope.go:117] "RemoveContainer" containerID="636a1f3901af25f5f2b4aa2846a4207d488760173ebd994036233a25edf38db9"
Sep 10 22:31:24.618152 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.618133    2577 scope.go:117] "RemoveContainer" containerID="8b15302e8e4c7b1fb7d04b16f557b0bbb792ae2141c2e6feb26c20b23256f01e"
Sep 10 22:31:24.627683 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.627653    2577 scope.go:117] "RemoveContainer" containerID="636a1f3901af25f5f2b4aa2846a4207d488760173ebd994036233a25edf38db9"
Sep 10 22:31:24.628026 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:31:24.628003    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"636a1f3901af25f5f2b4aa2846a4207d488760173ebd994036233a25edf38db9\": container with ID starting with 636a1f3901af25f5f2b4aa2846a4207d488760173ebd994036233a25edf38db9 not found: ID does not exist" containerID="636a1f3901af25f5f2b4aa2846a4207d488760173ebd994036233a25edf38db9"
Sep 10 22:31:24.628082 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.628038    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"636a1f3901af25f5f2b4aa2846a4207d488760173ebd994036233a25edf38db9"} err="failed to get container status \"636a1f3901af25f5f2b4aa2846a4207d488760173ebd994036233a25edf38db9\": rpc error: code = NotFound desc = could not find container \"636a1f3901af25f5f2b4aa2846a4207d488760173ebd994036233a25edf38db9\": container with ID starting with 636a1f3901af25f5f2b4aa2846a4207d488760173ebd994036233a25edf38db9 not found: ID does not exist"
Sep 10 22:31:24.628082 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.628063    2577 scope.go:117] "RemoveContainer" containerID="8b15302e8e4c7b1fb7d04b16f557b0bbb792ae2141c2e6feb26c20b23256f01e"
Sep 10 22:31:24.628327 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:31:24.628306    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b15302e8e4c7b1fb7d04b16f557b0bbb792ae2141c2e6feb26c20b23256f01e\": container with ID starting with 8b15302e8e4c7b1fb7d04b16f557b0bbb792ae2141c2e6feb26c20b23256f01e not found: ID does not exist" containerID="8b15302e8e4c7b1fb7d04b16f557b0bbb792ae2141c2e6feb26c20b23256f01e"
Sep 10 22:31:24.628384 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.628337    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b15302e8e4c7b1fb7d04b16f557b0bbb792ae2141c2e6feb26c20b23256f01e"} err="failed to get container status \"8b15302e8e4c7b1fb7d04b16f557b0bbb792ae2141c2e6feb26c20b23256f01e\": rpc error: code = NotFound desc = could not find container \"8b15302e8e4c7b1fb7d04b16f557b0bbb792ae2141c2e6feb26c20b23256f01e\": container with ID starting with 8b15302e8e4c7b1fb7d04b16f557b0bbb792ae2141c2e6feb26c20b23256f01e not found: ID does not exist"
Sep 10 22:31:24.629603 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.629584    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"]
Sep 10 22:31:24.633694 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:24.633671    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-a12859-openshift-default-fc9cf6d58-qkk8w"]
Sep 10 22:31:25.849161 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:25.849127    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="098b6188-d967-4145-8ffb-886b358b3cca" path="/var/lib/kubelet/pods/098b6188-d967-4145-8ffb-886b358b3cca/volumes"
Sep 10 22:31:29.965048 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:29.964952    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"]
Sep 10 22:31:29.965479 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:29.965225    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6" podUID="90746daf-3304-4b96-9f24-f6ceeb167fc2" containerName="maas-api" containerID="cri-o://302411f1523bb6f3897f54a870655a184dcb03c507322d959c6d819378cc26b3" gracePeriod=30
Sep 10 22:31:30.224766 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:30.224699    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"
Sep 10 22:31:30.284489 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:30.284455    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90746daf-3304-4b96-9f24-f6ceeb167fc2-openshift-service-ca\") pod \"90746daf-3304-4b96-9f24-f6ceeb167fc2\" (UID: \"90746daf-3304-4b96-9f24-f6ceeb167fc2\") "
Sep 10 22:31:30.284673 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:30.284532    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pmh9\" (UniqueName: \"kubernetes.io/projected/90746daf-3304-4b96-9f24-f6ceeb167fc2-kube-api-access-2pmh9\") pod \"90746daf-3304-4b96-9f24-f6ceeb167fc2\" (UID: \"90746daf-3304-4b96-9f24-f6ceeb167fc2\") "
Sep 10 22:31:30.284673 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:30.284634    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90746daf-3304-4b96-9f24-f6ceeb167fc2-metrics-certs\") pod \"90746daf-3304-4b96-9f24-f6ceeb167fc2\" (UID: \"90746daf-3304-4b96-9f24-f6ceeb167fc2\") "
Sep 10 22:31:30.284673 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:30.284662    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90746daf-3304-4b96-9f24-f6ceeb167fc2-maas-api-tls\") pod \"90746daf-3304-4b96-9f24-f6ceeb167fc2\" (UID: \"90746daf-3304-4b96-9f24-f6ceeb167fc2\") "
Sep 10 22:31:30.284874 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:30.284836    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90746daf-3304-4b96-9f24-f6ceeb167fc2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "90746daf-3304-4b96-9f24-f6ceeb167fc2" (UID: "90746daf-3304-4b96-9f24-f6ceeb167fc2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:31:30.285009 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:30.284993    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90746daf-3304-4b96-9f24-f6ceeb167fc2-openshift-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:31:30.286959 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:30.286923    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90746daf-3304-4b96-9f24-f6ceeb167fc2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "90746daf-3304-4b96-9f24-f6ceeb167fc2" (UID: "90746daf-3304-4b96-9f24-f6ceeb167fc2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:31:30.286959 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:30.286932    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90746daf-3304-4b96-9f24-f6ceeb167fc2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "90746daf-3304-4b96-9f24-f6ceeb167fc2" (UID: "90746daf-3304-4b96-9f24-f6ceeb167fc2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:31:30.287121 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:30.286965    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90746daf-3304-4b96-9f24-f6ceeb167fc2-kube-api-access-2pmh9" (OuterVolumeSpecName: "kube-api-access-2pmh9") pod "90746daf-3304-4b96-9f24-f6ceeb167fc2" (UID: "90746daf-3304-4b96-9f24-f6ceeb167fc2"). InnerVolumeSpecName "kube-api-access-2pmh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:31:30.386372 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:30.386325    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pmh9\" (UniqueName: \"kubernetes.io/projected/90746daf-3304-4b96-9f24-f6ceeb167fc2-kube-api-access-2pmh9\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:31:30.386372 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:30.386370    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90746daf-3304-4b96-9f24-f6ceeb167fc2-metrics-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:31:30.386372 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:30.386382    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90746daf-3304-4b96-9f24-f6ceeb167fc2-maas-api-tls\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:31:30.645106 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:30.645073    2577 generic.go:356] "Generic (PLEG): container finished" podID="90746daf-3304-4b96-9f24-f6ceeb167fc2" containerID="302411f1523bb6f3897f54a870655a184dcb03c507322d959c6d819378cc26b3" exitCode=0
Sep 10 22:31:30.645285 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:30.645118    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"
Sep 10 22:31:30.645285 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:30.645148    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6" event={"ID":"90746daf-3304-4b96-9f24-f6ceeb167fc2","Type":"ContainerDied","Data":"302411f1523bb6f3897f54a870655a184dcb03c507322d959c6d819378cc26b3"}
Sep 10 22:31:30.645285 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:30.645207    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6" event={"ID":"90746daf-3304-4b96-9f24-f6ceeb167fc2","Type":"ContainerDied","Data":"7d40ec8d9528da1387e944a74fbdbf1dd34f469e611f61ecfc818213fbe697ec"}
Sep 10 22:31:30.645285 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:30.645232    2577 scope.go:117] "RemoveContainer" containerID="302411f1523bb6f3897f54a870655a184dcb03c507322d959c6d819378cc26b3"
Sep 10 22:31:30.655807 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:30.655767    2577 scope.go:117] "RemoveContainer" containerID="302411f1523bb6f3897f54a870655a184dcb03c507322d959c6d819378cc26b3"
Sep 10 22:31:30.656138 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:31:30.656120    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"302411f1523bb6f3897f54a870655a184dcb03c507322d959c6d819378cc26b3\": container with ID starting with 302411f1523bb6f3897f54a870655a184dcb03c507322d959c6d819378cc26b3 not found: ID does not exist" containerID="302411f1523bb6f3897f54a870655a184dcb03c507322d959c6d819378cc26b3"
Sep 10 22:31:30.656189 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:30.656147    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"302411f1523bb6f3897f54a870655a184dcb03c507322d959c6d819378cc26b3"} err="failed to get container status \"302411f1523bb6f3897f54a870655a184dcb03c507322d959c6d819378cc26b3\": rpc error: code = NotFound desc = could not find container \"302411f1523bb6f3897f54a870655a184dcb03c507322d959c6d819378cc26b3\": container with ID starting with 302411f1523bb6f3897f54a870655a184dcb03c507322d959c6d819378cc26b3 not found: ID does not exist"
Sep 10 22:31:30.667176 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:30.667143    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"]
Sep 10 22:31:30.671335 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:30.671311    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-79434a-7989d89f94-s2fc6"]
Sep 10 22:31:31.849065 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:31.849022    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90746daf-3304-4b96-9f24-f6ceeb167fc2" path="/var/lib/kubelet/pods/90746daf-3304-4b96-9f24-f6ceeb167fc2/volumes"
Sep 10 22:31:33.355078 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:33.355039    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:31:51.658980 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:31:51.658940    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:32:05.989900 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:05.989859    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"]
Sep 10 22:32:05.990357 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:05.990139    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5" podUID="56017827-0fbc-4ae8-b507-e572be309dad" containerName="maas-api" containerID="cri-o://8ba08ce7f79666b4c51155e25341911668b6e4aefeb1e0a3a2a5395a7a779d5c" gracePeriod=30
Sep 10 22:32:06.251685 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:06.251615    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"
Sep 10 22:32:06.309795 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:06.309749    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56017827-0fbc-4ae8-b507-e572be309dad-metrics-certs\") pod \"56017827-0fbc-4ae8-b507-e572be309dad\" (UID: \"56017827-0fbc-4ae8-b507-e572be309dad\") "
Sep 10 22:32:06.309981 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:06.309807    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56017827-0fbc-4ae8-b507-e572be309dad-openshift-service-ca\") pod \"56017827-0fbc-4ae8-b507-e572be309dad\" (UID: \"56017827-0fbc-4ae8-b507-e572be309dad\") "
Sep 10 22:32:06.309981 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:06.309840    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvb77\" (UniqueName: \"kubernetes.io/projected/56017827-0fbc-4ae8-b507-e572be309dad-kube-api-access-fvb77\") pod \"56017827-0fbc-4ae8-b507-e572be309dad\" (UID: \"56017827-0fbc-4ae8-b507-e572be309dad\") "
Sep 10 22:32:06.309981 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:06.309862    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56017827-0fbc-4ae8-b507-e572be309dad-maas-api-tls\") pod \"56017827-0fbc-4ae8-b507-e572be309dad\" (UID: \"56017827-0fbc-4ae8-b507-e572be309dad\") "
Sep 10 22:32:06.310259 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:06.310221    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56017827-0fbc-4ae8-b507-e572be309dad-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "56017827-0fbc-4ae8-b507-e572be309dad" (UID: "56017827-0fbc-4ae8-b507-e572be309dad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:32:06.312483 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:06.312454    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56017827-0fbc-4ae8-b507-e572be309dad-kube-api-access-fvb77" (OuterVolumeSpecName: "kube-api-access-fvb77") pod "56017827-0fbc-4ae8-b507-e572be309dad" (UID: "56017827-0fbc-4ae8-b507-e572be309dad"). InnerVolumeSpecName "kube-api-access-fvb77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:32:06.312627 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:06.312491    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56017827-0fbc-4ae8-b507-e572be309dad-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "56017827-0fbc-4ae8-b507-e572be309dad" (UID: "56017827-0fbc-4ae8-b507-e572be309dad"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:32:06.312627 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:06.312505    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56017827-0fbc-4ae8-b507-e572be309dad-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "56017827-0fbc-4ae8-b507-e572be309dad" (UID: "56017827-0fbc-4ae8-b507-e572be309dad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:32:06.411270 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:06.411238    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56017827-0fbc-4ae8-b507-e572be309dad-metrics-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:32:06.411270 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:06.411263    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56017827-0fbc-4ae8-b507-e572be309dad-openshift-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:32:06.411270 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:06.411275    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvb77\" (UniqueName: \"kubernetes.io/projected/56017827-0fbc-4ae8-b507-e572be309dad-kube-api-access-fvb77\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:32:06.411503 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:06.411290    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56017827-0fbc-4ae8-b507-e572be309dad-maas-api-tls\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:32:06.861720 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:06.861675    2577 generic.go:356] "Generic (PLEG): container finished" podID="56017827-0fbc-4ae8-b507-e572be309dad" containerID="8ba08ce7f79666b4c51155e25341911668b6e4aefeb1e0a3a2a5395a7a779d5c" exitCode=0
Sep 10 22:32:06.861953 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:06.861731    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"
Sep 10 22:32:06.861953 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:06.861770    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5" event={"ID":"56017827-0fbc-4ae8-b507-e572be309dad","Type":"ContainerDied","Data":"8ba08ce7f79666b4c51155e25341911668b6e4aefeb1e0a3a2a5395a7a779d5c"}
Sep 10 22:32:06.861953 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:06.861853    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5" event={"ID":"56017827-0fbc-4ae8-b507-e572be309dad","Type":"ContainerDied","Data":"4189b25a6edb1881f03e7ea41d88d58bc6af09b9d4fe28f4aea6db9f47eef003"}
Sep 10 22:32:06.861953 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:06.861876    2577 scope.go:117] "RemoveContainer" containerID="8ba08ce7f79666b4c51155e25341911668b6e4aefeb1e0a3a2a5395a7a779d5c"
Sep 10 22:32:06.874341 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:06.874318    2577 scope.go:117] "RemoveContainer" containerID="8ba08ce7f79666b4c51155e25341911668b6e4aefeb1e0a3a2a5395a7a779d5c"
Sep 10 22:32:06.874679 ip-10-0-130-67 kubenswrapper[2577]: E0910 22:32:06.874657    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ba08ce7f79666b4c51155e25341911668b6e4aefeb1e0a3a2a5395a7a779d5c\": container with ID starting with 8ba08ce7f79666b4c51155e25341911668b6e4aefeb1e0a3a2a5395a7a779d5c not found: ID does not exist" containerID="8ba08ce7f79666b4c51155e25341911668b6e4aefeb1e0a3a2a5395a7a779d5c"
Sep 10 22:32:06.874853 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:06.874691    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ba08ce7f79666b4c51155e25341911668b6e4aefeb1e0a3a2a5395a7a779d5c"} err="failed to get container status \"8ba08ce7f79666b4c51155e25341911668b6e4aefeb1e0a3a2a5395a7a779d5c\": rpc error: code = NotFound desc = could not find container \"8ba08ce7f79666b4c51155e25341911668b6e4aefeb1e0a3a2a5395a7a779d5c\": container with ID starting with 8ba08ce7f79666b4c51155e25341911668b6e4aefeb1e0a3a2a5395a7a779d5c not found: ID does not exist"
Sep 10 22:32:06.885417 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:06.885377    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"]
Sep 10 22:32:06.887618 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:06.887590    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ec6d47-7d98c6974b-2w2m5"]
Sep 10 22:32:07.847980 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:07.847950    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56017827-0fbc-4ae8-b507-e572be309dad" path="/var/lib/kubelet/pods/56017827-0fbc-4ae8-b507-e572be309dad/volumes"
Sep 10 22:32:08.857080 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:08.857040    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:32:18.155453 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:32:18.155402    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:33:41.356747 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:33:41.356708    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:34:07.055767 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:34:07.055725    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:34:15.064812 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:34:15.064759    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:34:23.459198 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:34:23.459160    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:34:40.969286 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:34:40.969246    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:34:54.767575 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:34:54.767540    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:36:25.157754 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:36:25.157710    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:36:30.960563 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:36:30.960526    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:36:54.862739 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:36:54.862700    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:37:13.063313 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:37:13.063274    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:37:48.475877 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:37:48.475841    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:37:58.672340 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:37:58.672299    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:38:06.335769 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.335732    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:38:06.501039 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501006    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"]
Sep 10 22:38:06.501393 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501381    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="098b6188-d967-4145-8ffb-886b358b3cca" containerName="istio-proxy"
Sep 10 22:38:06.501446 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501394    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="098b6188-d967-4145-8ffb-886b358b3cca" containerName="istio-proxy"
Sep 10 22:38:06.501446 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501409    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90746daf-3304-4b96-9f24-f6ceeb167fc2" containerName="maas-api"
Sep 10 22:38:06.501446 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501414    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="90746daf-3304-4b96-9f24-f6ceeb167fc2" containerName="maas-api"
Sep 10 22:38:06.501446 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501429    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56017827-0fbc-4ae8-b507-e572be309dad" containerName="maas-api"
Sep 10 22:38:06.501446 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501434    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="56017827-0fbc-4ae8-b507-e572be309dad" containerName="maas-api"
Sep 10 22:38:06.501446 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501441    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f84c10b-c6fc-4776-aa6d-146948e663bf" containerName="maas-api"
Sep 10 22:38:06.501446 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501445    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f84c10b-c6fc-4776-aa6d-146948e663bf" containerName="maas-api"
Sep 10 22:38:06.501657 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501454    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="098b6188-d967-4145-8ffb-886b358b3cca" containerName="istio-proxy"
Sep 10 22:38:06.501657 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501459    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="098b6188-d967-4145-8ffb-886b358b3cca" containerName="istio-proxy"
Sep 10 22:38:06.501657 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501468    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f0d9286-c67a-4142-9baf-133b5a69e652" containerName="maas-api"
Sep 10 22:38:06.501657 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501472    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f0d9286-c67a-4142-9baf-133b5a69e652" containerName="maas-api"
Sep 10 22:38:06.501657 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501479    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e495264-e759-40ea-a0b1-37e5a69f836d" containerName="istio-proxy"
Sep 10 22:38:06.501657 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501484    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e495264-e759-40ea-a0b1-37e5a69f836d" containerName="istio-proxy"
Sep 10 22:38:06.501657 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501490    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e495264-e759-40ea-a0b1-37e5a69f836d" containerName="istio-proxy"
Sep 10 22:38:06.501657 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501495    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e495264-e759-40ea-a0b1-37e5a69f836d" containerName="istio-proxy"
Sep 10 22:38:06.501657 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501551    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="098b6188-d967-4145-8ffb-886b358b3cca" containerName="istio-proxy"
Sep 10 22:38:06.501657 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501559    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="56017827-0fbc-4ae8-b507-e572be309dad" containerName="maas-api"
Sep 10 22:38:06.501657 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501564    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="90746daf-3304-4b96-9f24-f6ceeb167fc2" containerName="maas-api"
Sep 10 22:38:06.501657 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501571    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f0d9286-c67a-4142-9baf-133b5a69e652" containerName="maas-api"
Sep 10 22:38:06.501657 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501577    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f84c10b-c6fc-4776-aa6d-146948e663bf" containerName="maas-api"
Sep 10 22:38:06.501657 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501582    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e495264-e759-40ea-a0b1-37e5a69f836d" containerName="istio-proxy"
Sep 10 22:38:06.501657 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.501589    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e495264-e759-40ea-a0b1-37e5a69f836d" containerName="istio-proxy"
Sep 10 22:38:06.504749 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.504735    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"
Sep 10 22:38:06.518055 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.518036    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 22:38:06.519906 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.519892    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 22:38:06.519980 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.519963    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-spztp\""
Sep 10 22:38:06.525566 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.525545    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"]
Sep 10 22:38:06.590583 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.590493    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-metrics-certs\") pod \"maas-api-7f7f8945f9-hlp4l\" (UID: \"51d2ecb4-5fd6-48df-81df-6a010f2f2a46\") " pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"
Sep 10 22:38:06.590583 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.590551    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wh22\" (UniqueName: \"kubernetes.io/projected/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-kube-api-access-2wh22\") pod \"maas-api-7f7f8945f9-hlp4l\" (UID: \"51d2ecb4-5fd6-48df-81df-6a010f2f2a46\") " pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"
Sep 10 22:38:06.590841 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.590669    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-openshift-service-ca\") pod \"maas-api-7f7f8945f9-hlp4l\" (UID: \"51d2ecb4-5fd6-48df-81df-6a010f2f2a46\") " pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"
Sep 10 22:38:06.590841 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.590716    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-maas-api-tls\") pod \"maas-api-7f7f8945f9-hlp4l\" (UID: \"51d2ecb4-5fd6-48df-81df-6a010f2f2a46\") " pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"
Sep 10 22:38:06.692072 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.692031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-openshift-service-ca\") pod \"maas-api-7f7f8945f9-hlp4l\" (UID: \"51d2ecb4-5fd6-48df-81df-6a010f2f2a46\") " pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"
Sep 10 22:38:06.692072 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.692079    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-maas-api-tls\") pod \"maas-api-7f7f8945f9-hlp4l\" (UID: \"51d2ecb4-5fd6-48df-81df-6a010f2f2a46\") " pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"
Sep 10 22:38:06.692326 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.692107    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-metrics-certs\") pod \"maas-api-7f7f8945f9-hlp4l\" (UID: \"51d2ecb4-5fd6-48df-81df-6a010f2f2a46\") " pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"
Sep 10 22:38:06.692326 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.692277    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wh22\" (UniqueName: \"kubernetes.io/projected/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-kube-api-access-2wh22\") pod \"maas-api-7f7f8945f9-hlp4l\" (UID: \"51d2ecb4-5fd6-48df-81df-6a010f2f2a46\") " pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"
Sep 10 22:38:06.692713 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.692683    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-openshift-service-ca\") pod \"maas-api-7f7f8945f9-hlp4l\" (UID: \"51d2ecb4-5fd6-48df-81df-6a010f2f2a46\") " pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"
Sep 10 22:38:06.694727 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.694706    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-metrics-certs\") pod \"maas-api-7f7f8945f9-hlp4l\" (UID: \"51d2ecb4-5fd6-48df-81df-6a010f2f2a46\") " pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"
Sep 10 22:38:06.694841 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.694750    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-maas-api-tls\") pod \"maas-api-7f7f8945f9-hlp4l\" (UID: \"51d2ecb4-5fd6-48df-81df-6a010f2f2a46\") " pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"
Sep 10 22:38:06.700838 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.700818    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wh22\" (UniqueName: \"kubernetes.io/projected/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-kube-api-access-2wh22\") pod \"maas-api-7f7f8945f9-hlp4l\" (UID: \"51d2ecb4-5fd6-48df-81df-6a010f2f2a46\") " pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"
Sep 10 22:38:06.815646 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:06.815605    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"
Sep 10 22:38:07.107592 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:07.107565    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"]
Sep 10 22:38:07.109962 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:38:07.109936    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51d2ecb4_5fd6_48df_81df_6a010f2f2a46.slice/crio-e6ed2640977dd929194c4127b0ac852ac22652e45977deb603b31a78a2bba1c3 WatchSource:0}: Error finding container e6ed2640977dd929194c4127b0ac852ac22652e45977deb603b31a78a2bba1c3: Status 404 returned error can't find the container with id e6ed2640977dd929194c4127b0ac852ac22652e45977deb603b31a78a2bba1c3
Sep 10 22:38:07.111661 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:07.111643    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 22:38:07.932788 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:07.932751    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l" event={"ID":"51d2ecb4-5fd6-48df-81df-6a010f2f2a46","Type":"ContainerStarted","Data":"30af1f2c57abba3f8513263b1eb708ad032a4ee307bb659b9734825b9569367a"}
Sep 10 22:38:07.933215 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:07.932831    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l" event={"ID":"51d2ecb4-5fd6-48df-81df-6a010f2f2a46","Type":"ContainerStarted","Data":"e6ed2640977dd929194c4127b0ac852ac22652e45977deb603b31a78a2bba1c3"}
Sep 10 22:38:07.933215 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:07.932935    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"
Sep 10 22:38:07.949188 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:07.949140    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l" podStartSLOduration=1.518209101 podStartE2EDuration="1.949125799s" totalImagesPullingTime="430.916698ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:38:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:38:07.947423431 +0000 UTC m=+2192.619521352" watchObservedRunningTime="2026-09-10 22:38:07.949125799 +0000 UTC m=+2192.621223758"
Sep 10 22:38:13.742498 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:13.742461    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"]
Sep 10 22:38:13.743284 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:13.742760    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l" podUID="51d2ecb4-5fd6-48df-81df-6a010f2f2a46" containerName="maas-api" containerID="cri-o://30af1f2c57abba3f8513263b1eb708ad032a4ee307bb659b9734825b9569367a" gracePeriod=30
Sep 10 22:38:13.748436 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:13.748413    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"
Sep 10 22:38:13.967904 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:13.967873    2577 generic.go:356] "Generic (PLEG): container finished" podID="51d2ecb4-5fd6-48df-81df-6a010f2f2a46" containerID="30af1f2c57abba3f8513263b1eb708ad032a4ee307bb659b9734825b9569367a" exitCode=0
Sep 10 22:38:13.968063 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:13.967960    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l" event={"ID":"51d2ecb4-5fd6-48df-81df-6a010f2f2a46","Type":"ContainerDied","Data":"30af1f2c57abba3f8513263b1eb708ad032a4ee307bb659b9734825b9569367a"}
Sep 10 22:38:13.997657 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:13.997583    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"
Sep 10 22:38:14.060170 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:14.060134    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-openshift-service-ca\") pod \"51d2ecb4-5fd6-48df-81df-6a010f2f2a46\" (UID: \"51d2ecb4-5fd6-48df-81df-6a010f2f2a46\") "
Sep 10 22:38:14.060330 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:14.060181    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-maas-api-tls\") pod \"51d2ecb4-5fd6-48df-81df-6a010f2f2a46\" (UID: \"51d2ecb4-5fd6-48df-81df-6a010f2f2a46\") "
Sep 10 22:38:14.060330 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:14.060242    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-metrics-certs\") pod \"51d2ecb4-5fd6-48df-81df-6a010f2f2a46\" (UID: \"51d2ecb4-5fd6-48df-81df-6a010f2f2a46\") "
Sep 10 22:38:14.060330 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:14.060292    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wh22\" (UniqueName: \"kubernetes.io/projected/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-kube-api-access-2wh22\") pod \"51d2ecb4-5fd6-48df-81df-6a010f2f2a46\" (UID: \"51d2ecb4-5fd6-48df-81df-6a010f2f2a46\") "
Sep 10 22:38:14.060585 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:14.060551    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "51d2ecb4-5fd6-48df-81df-6a010f2f2a46" (UID: "51d2ecb4-5fd6-48df-81df-6a010f2f2a46"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:38:14.062613 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:14.062586    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "51d2ecb4-5fd6-48df-81df-6a010f2f2a46" (UID: "51d2ecb4-5fd6-48df-81df-6a010f2f2a46"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:38:14.062735 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:14.062621    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-kube-api-access-2wh22" (OuterVolumeSpecName: "kube-api-access-2wh22") pod "51d2ecb4-5fd6-48df-81df-6a010f2f2a46" (UID: "51d2ecb4-5fd6-48df-81df-6a010f2f2a46"). InnerVolumeSpecName "kube-api-access-2wh22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:38:14.062899 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:14.062883    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "51d2ecb4-5fd6-48df-81df-6a010f2f2a46" (UID: "51d2ecb4-5fd6-48df-81df-6a010f2f2a46"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:38:14.063023 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:14.063004    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:38:14.161475 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:14.161438    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-openshift-service-ca\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:38:14.161475 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:14.161467    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-maas-api-tls\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:38:14.161475 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:14.161475    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-metrics-certs\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:38:14.161475 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:14.161483    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wh22\" (UniqueName: \"kubernetes.io/projected/51d2ecb4-5fd6-48df-81df-6a010f2f2a46-kube-api-access-2wh22\") on node \"ip-10-0-130-67.ec2.internal\" DevicePath \"\""
Sep 10 22:38:14.977820 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:14.977791    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"
Sep 10 22:38:14.978270 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:14.977818    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l" event={"ID":"51d2ecb4-5fd6-48df-81df-6a010f2f2a46","Type":"ContainerDied","Data":"e6ed2640977dd929194c4127b0ac852ac22652e45977deb603b31a78a2bba1c3"}
Sep 10 22:38:14.978270 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:14.977902    2577 scope.go:117] "RemoveContainer" containerID="30af1f2c57abba3f8513263b1eb708ad032a4ee307bb659b9734825b9569367a"
Sep 10 22:38:15.012306 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:15.012277    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"]
Sep 10 22:38:15.017190 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:15.017165    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f7f8945f9-hlp4l"]
Sep 10 22:38:15.854579 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:15.854549    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51d2ecb4-5fd6-48df-81df-6a010f2f2a46" path="/var/lib/kubelet/pods/51d2ecb4-5fd6-48df-81df-6a010f2f2a46/volumes"
Sep 10 22:38:21.267834 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:21.267795    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:38:29.463550 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:29.463512    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:38:34.660707 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:34.660673    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vxx6n"]
Sep 10 22:38:42.813979 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:42.813890    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rrr7z_e8e6ac4f-459f-4139-8feb-85795da91b07/manager/0.log"
Sep 10 22:38:42.938336 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:42.938310    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-l6xkk_e45c2274-fc79-486b-a9a1-02867a157683/manager/0.log"
Sep 10 22:38:43.445152 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:43.445127    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76d44b6d5b-8k7wc_5781a3c3-0e6d-4b74-b015-e7d9e74b295d/copy-manifests/0.log"
Sep 10 22:38:43.458180 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:43.458157    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76d44b6d5b-8k7wc_5781a3c3-0e6d-4b74-b015-e7d9e74b295d/manager/0.log"
Sep 10 22:38:44.297297 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:44.297265    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29817975-tfpfh_de38d686-856c-4809-b288-5bf47b6fb3b4/cleanup/0.log"
Sep 10 22:38:44.517193 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:44.517167    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-chr5b_c3572c7c-e6c1-4011-9af8-d94139b1607b/postgres/0.log"
Sep 10 22:38:45.464995 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:45.464963    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-hqtr4_0c3e9139-151c-435b-89ea-cbd91c8c0b95/manager/0.log"
Sep 10 22:38:45.581822 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:45.581769    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-2dknf_1d948980-c7bc-4da7-9003-6987475c56f0/manager/0.log"
Sep 10 22:38:45.694177 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:45.694149    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-8nsf6_600c6543-db1d-4afe-8cb0-c41896db136c/kuadrant-console-plugin/0.log"
Sep 10 22:38:45.936097 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:45.936073    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-vxx6n_ef7c8d31-2395-45a6-9cd8-18adcb87031a/limitador/0.log"
Sep 10 22:38:46.052117 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:46.052085    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-qrcxh_d3b39857-1f29-4db0-98e0-ad1bf97ad8c1/manager/0.log"
Sep 10 22:38:46.654046 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:46.654017    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69ccfddbf-hhltp_406fc6d2-bd67-4933-bbd2-2d083a618df4/kube-auth-proxy/0.log"
Sep 10 22:38:46.908865 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:46.908766    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4vbvh_2f711997-b4cd-4393-8740-96bb17ec3834/istio-proxy/1.log"
Sep 10 22:38:47.178096 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:47.178014    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-6dszf_c832a3f5-34f9-4b44-bb0e-329861d77d1d/payload-processing/0.log"
Sep 10 22:38:47.634908 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:47.634882    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-crpzl_0e9d6e42-715c-41bb-9388-7e07f035ec4b/main/0.log"
Sep 10 22:38:48.079822 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:48.079710    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fx5t56_ca1df9dd-7d58-40aa-bb72-1981089218f2/main/0.log"
Sep 10 22:38:54.196837 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:54.196804    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8dpvh/must-gather-b9tkp"]
Sep 10 22:38:54.197373 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:54.197227    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51d2ecb4-5fd6-48df-81df-6a010f2f2a46" containerName="maas-api"
Sep 10 22:38:54.197373 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:54.197238    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="51d2ecb4-5fd6-48df-81df-6a010f2f2a46" containerName="maas-api"
Sep 10 22:38:54.197373 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:54.197302    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="098b6188-d967-4145-8ffb-886b358b3cca" containerName="istio-proxy"
Sep 10 22:38:54.197373 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:54.197314    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="51d2ecb4-5fd6-48df-81df-6a010f2f2a46" containerName="maas-api"
Sep 10 22:38:54.201889 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:54.201868    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dpvh/must-gather-b9tkp"
Sep 10 22:38:54.204390 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:54.204367    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8dpvh\"/\"default-dockercfg-6cqgb\""
Sep 10 22:38:54.204390 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:54.204383    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8dpvh\"/\"kube-root-ca.crt\""
Sep 10 22:38:54.204644 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:54.204631    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8dpvh\"/\"openshift-service-ca.crt\""
Sep 10 22:38:54.209457 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:54.209426    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f2fa0b58-52a8-44fb-987b-d39c588bc2db-must-gather-output\") pod \"must-gather-b9tkp\" (UID: \"f2fa0b58-52a8-44fb-987b-d39c588bc2db\") " pod="openshift-must-gather-8dpvh/must-gather-b9tkp"
Sep 10 22:38:54.209570 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:54.209478    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfpvb\" (UniqueName: \"kubernetes.io/projected/f2fa0b58-52a8-44fb-987b-d39c588bc2db-kube-api-access-vfpvb\") pod \"must-gather-b9tkp\" (UID: \"f2fa0b58-52a8-44fb-987b-d39c588bc2db\") " pod="openshift-must-gather-8dpvh/must-gather-b9tkp"
Sep 10 22:38:54.212277 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:54.212252    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dpvh/must-gather-b9tkp"]
Sep 10 22:38:54.310952 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:54.310915    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f2fa0b58-52a8-44fb-987b-d39c588bc2db-must-gather-output\") pod \"must-gather-b9tkp\" (UID: \"f2fa0b58-52a8-44fb-987b-d39c588bc2db\") " pod="openshift-must-gather-8dpvh/must-gather-b9tkp"
Sep 10 22:38:54.310952 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:54.310955    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfpvb\" (UniqueName: \"kubernetes.io/projected/f2fa0b58-52a8-44fb-987b-d39c588bc2db-kube-api-access-vfpvb\") pod \"must-gather-b9tkp\" (UID: \"f2fa0b58-52a8-44fb-987b-d39c588bc2db\") " pod="openshift-must-gather-8dpvh/must-gather-b9tkp"
Sep 10 22:38:54.311279 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:54.311259    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f2fa0b58-52a8-44fb-987b-d39c588bc2db-must-gather-output\") pod \"must-gather-b9tkp\" (UID: \"f2fa0b58-52a8-44fb-987b-d39c588bc2db\") " pod="openshift-must-gather-8dpvh/must-gather-b9tkp"
Sep 10 22:38:54.319666 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:54.319642    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfpvb\" (UniqueName: \"kubernetes.io/projected/f2fa0b58-52a8-44fb-987b-d39c588bc2db-kube-api-access-vfpvb\") pod \"must-gather-b9tkp\" (UID: \"f2fa0b58-52a8-44fb-987b-d39c588bc2db\") " pod="openshift-must-gather-8dpvh/must-gather-b9tkp"
Sep 10 22:38:54.512050 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:54.511956    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dpvh/must-gather-b9tkp"
Sep 10 22:38:54.788079 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:54.788054    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dpvh/must-gather-b9tkp"]
Sep 10 22:38:54.790186 ip-10-0-130-67 kubenswrapper[2577]: W0910 22:38:54.790161    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2fa0b58_52a8_44fb_987b_d39c588bc2db.slice/crio-0101873d84b8f2596508b94a0b99267a185b10603b29beafccf2631fab3fb7eb WatchSource:0}: Error finding container 0101873d84b8f2596508b94a0b99267a185b10603b29beafccf2631fab3fb7eb: Status 404 returned error can't find the container with id 0101873d84b8f2596508b94a0b99267a185b10603b29beafccf2631fab3fb7eb
Sep 10 22:38:55.204535 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:55.204503    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dpvh/must-gather-b9tkp" event={"ID":"f2fa0b58-52a8-44fb-987b-d39c588bc2db","Type":"ContainerStarted","Data":"0101873d84b8f2596508b94a0b99267a185b10603b29beafccf2631fab3fb7eb"}
Sep 10 22:38:56.215853 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:56.215817    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dpvh/must-gather-b9tkp" event={"ID":"f2fa0b58-52a8-44fb-987b-d39c588bc2db","Type":"ContainerStarted","Data":"dc8633eb34d0b3d4b05ec8e17f3159e26d2c394ff695c563c9866e9cdd87e45d"}
Sep 10 22:38:56.215853 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:56.215866    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dpvh/must-gather-b9tkp" event={"ID":"f2fa0b58-52a8-44fb-987b-d39c588bc2db","Type":"ContainerStarted","Data":"3552e4eeea0eac9fb494acdcda07df213905cad78d94341791a104d4560d9a38"}
Sep 10 22:38:56.230697 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:56.230633    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8dpvh/must-gather-b9tkp" podStartSLOduration=1.416941977 podStartE2EDuration="2.230609377s" totalImagesPullingTime="813.6674ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:38:56.230234999 +0000 UTC m=+2240.902332904" watchObservedRunningTime="2026-09-10 22:38:56.230609377 +0000 UTC m=+2240.902707299"
Sep 10 22:38:57.387402 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:57.387364    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hv697_950dcdf3-d64c-49e2-8e8b-8c8060fa7069/global-pull-secret-syncer/0.log"
Sep 10 22:38:57.569133 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:57.569096    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lnjgx_8cd40637-7020-4903-8bf4-71fb2be9ac48/konnectivity-agent/0.log"
Sep 10 22:38:57.596166 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:38:57.596134    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-67.ec2.internal_30837abf95c6ef4eb29dd502c80f9ab0/haproxy/0.log"
Sep 10 22:39:02.598150 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:02.598112    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-hqtr4_0c3e9139-151c-435b-89ea-cbd91c8c0b95/manager/0.log"
Sep 10 22:39:02.688960 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:02.688925    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-2dknf_1d948980-c7bc-4da7-9003-6987475c56f0/manager/0.log"
Sep 10 22:39:02.794175 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:02.794142    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-8nsf6_600c6543-db1d-4afe-8cb0-c41896db136c/kuadrant-console-plugin/0.log"
Sep 10 22:39:03.098870 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:03.098755    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-vxx6n_ef7c8d31-2395-45a6-9cd8-18adcb87031a/limitador/0.log"
Sep 10 22:39:03.244177 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:03.244146    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-qrcxh_d3b39857-1f29-4db0-98e0-ad1bf97ad8c1/manager/0.log"
Sep 10 22:39:05.299729 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:05.299696    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-58cc978fcd-wvt2b_70e756be-8861-466d-9789-4ac95a6d9cab/metrics-server/0.log"
Sep 10 22:39:05.557553 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:05.557440    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llljk_05d401e4-4129-44ca-8346-782b7dbb297b/node-exporter/0.log"
Sep 10 22:39:05.590683 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:05.590648    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llljk_05d401e4-4129-44ca-8346-782b7dbb297b/kube-rbac-proxy/0.log"
Sep 10 22:39:05.617750 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:05.617637    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llljk_05d401e4-4129-44ca-8346-782b7dbb297b/init-textfile/0.log"
Sep 10 22:39:05.768902 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:05.768852    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-c4x46_ac48f7ae-2068-4609-9f35-a40dc76666df/kube-rbac-proxy-main/0.log"
Sep 10 22:39:05.794271 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:05.794245    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-c4x46_ac48f7ae-2068-4609-9f35-a40dc76666df/kube-rbac-proxy-self/0.log"
Sep 10 22:39:05.821271 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:05.821182    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-c4x46_ac48f7ae-2068-4609-9f35-a40dc76666df/openshift-state-metrics/0.log"
Sep 10 22:39:06.238422 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:06.238370    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75cf558f89-v4s46_019b3300-6658-4cda-928a-32ff41d65d63/thanos-query/0.log"
Sep 10 22:39:06.261463 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:06.261406    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75cf558f89-v4s46_019b3300-6658-4cda-928a-32ff41d65d63/kube-rbac-proxy-web/0.log"
Sep 10 22:39:06.285632 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:06.285601    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75cf558f89-v4s46_019b3300-6658-4cda-928a-32ff41d65d63/kube-rbac-proxy/0.log"
Sep 10 22:39:06.311637 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:06.311607    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75cf558f89-v4s46_019b3300-6658-4cda-928a-32ff41d65d63/prom-label-proxy/0.log"
Sep 10 22:39:06.337972 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:06.337937    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75cf558f89-v4s46_019b3300-6658-4cda-928a-32ff41d65d63/kube-rbac-proxy-rules/0.log"
Sep 10 22:39:06.363509 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:06.363478    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75cf558f89-v4s46_019b3300-6658-4cda-928a-32ff41d65d63/kube-rbac-proxy-metrics/0.log"
Sep 10 22:39:07.007649 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:07.007613    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt"]
Sep 10 22:39:07.019362 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:07.019329    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt"
Sep 10 22:39:07.022286 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:07.022249    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt"]
Sep 10 22:39:07.151563 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:07.151522    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/867f9e0f-eca5-4b16-9616-a67e451bc036-podres\") pod \"perf-node-gather-daemonset-9spwt\" (UID: \"867f9e0f-eca5-4b16-9616-a67e451bc036\") " pod="openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt"
Sep 10 22:39:07.151756 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:07.151611    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/867f9e0f-eca5-4b16-9616-a67e451bc036-lib-modules\") pod \"perf-node-gather-daemonset-9spwt\" (UID: \"867f9e0f-eca5-4b16-9616-a67e451bc036\") " pod="openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt"
Sep 10 22:39:07.151756 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:07.151697    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgs6f\" (UniqueName: \"kubernetes.io/projected/867f9e0f-eca5-4b16-9616-a67e451bc036-kube-api-access-cgs6f\") pod \"perf-node-gather-daemonset-9spwt\" (UID: \"867f9e0f-eca5-4b16-9616-a67e451bc036\") " pod="openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt"
Sep 10 22:39:07.151756 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:07.151748    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/867f9e0f-eca5-4b16-9616-a67e451bc036-sys\") pod \"perf-node-gather-daemonset-9spwt\" (UID: \"867f9e0f-eca5-4b16-9616-a67e451bc036\") " pod="openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt"
Sep 10 22:39:07.151938 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:07.151835    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/867f9e0f-eca5-4b16-9616-a67e451bc036-proc\") pod \"perf-node-gather-daemonset-9spwt\" (UID: \"867f9e0f-eca5-4b16-9616-a67e451bc036\") " pod="openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt"
Sep 10 22:39:07.252946 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:07.252906    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/867f9e0f-eca5-4b16-9616-a67e451bc036-podres\") pod \"perf-node-gather-daemonset-9spwt\" (UID: \"867f9e0f-eca5-4b16-9616-a67e451bc036\") " pod="openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt"
Sep 10 22:39:07.253144 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:07.252970    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/867f9e0f-eca5-4b16-9616-a67e451bc036-lib-modules\") pod \"perf-node-gather-daemonset-9spwt\" (UID: \"867f9e0f-eca5-4b16-9616-a67e451bc036\") " pod="openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt"
Sep 10 22:39:07.253144 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:07.253012    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgs6f\" (UniqueName: \"kubernetes.io/projected/867f9e0f-eca5-4b16-9616-a67e451bc036-kube-api-access-cgs6f\") pod \"perf-node-gather-daemonset-9spwt\" (UID: \"867f9e0f-eca5-4b16-9616-a67e451bc036\") " pod="openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt"
Sep 10 22:39:07.253144 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:07.253044    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/867f9e0f-eca5-4b16-9616-a67e451bc036-sys\") pod \"perf-node-gather-daemonset-9spwt\" (UID: \"867f9e0f-eca5-4b16-9616-a67e451bc036\") " pod="openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt"
Sep 10 22:39:07.253144 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:07.253076    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/867f9e0f-eca5-4b16-9616-a67e451bc036-proc\") pod \"perf-node-gather-daemonset-9spwt\" (UID: \"867f9e0f-eca5-4b16-9616-a67e451bc036\") " pod="openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt"
Sep 10 22:39:07.253320 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:07.253184    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/867f9e0f-eca5-4b16-9616-a67e451bc036-proc\") pod \"perf-node-gather-daemonset-9spwt\" (UID: \"867f9e0f-eca5-4b16-9616-a67e451bc036\") " pod="openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt"
Sep 10 22:39:07.253320 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:07.253188    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/867f9e0f-eca5-4b16-9616-a67e451bc036-sys\") pod \"perf-node-gather-daemonset-9spwt\" (UID: \"867f9e0f-eca5-4b16-9616-a67e451bc036\") " pod="openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt"
Sep 10 22:39:07.253320 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:07.253254    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/867f9e0f-eca5-4b16-9616-a67e451bc036-lib-modules\") pod \"perf-node-gather-daemonset-9spwt\" (UID: \"867f9e0f-eca5-4b16-9616-a67e451bc036\") " pod="openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt"
Sep 10 22:39:07.253499 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:07.253478    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/867f9e0f-eca5-4b16-9616-a67e451bc036-podres\") pod \"perf-node-gather-daemonset-9spwt\" (UID: \"867f9e0f-eca5-4b16-9616-a67e451bc036\") " pod="openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt"
Sep 10 22:39:07.261763 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:07.261685    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgs6f\" (UniqueName: \"kubernetes.io/projected/867f9e0f-eca5-4b16-9616-a67e451bc036-kube-api-access-cgs6f\") pod \"perf-node-gather-daemonset-9spwt\" (UID: \"867f9e0f-eca5-4b16-9616-a67e451bc036\") " pod="openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt"
Sep 10 22:39:07.334757 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:07.334720    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt"
Sep 10 22:39:07.616867 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:07.616757    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-cxmwk_8b02aba2-8d9a-430e-84ea-f4d2aa4a37e5/networking-console-plugin/0.log"
Sep 10 22:39:07.641495 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:07.641462    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt"]
Sep 10 22:39:08.322317 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:08.322274    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt" event={"ID":"867f9e0f-eca5-4b16-9616-a67e451bc036","Type":"ContainerStarted","Data":"6317ba136b3b19d900c9ad39000d3da623e0c24856f60f1b9f2594c3184fd3e9"}
Sep 10 22:39:08.322530 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:08.322342    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt" event={"ID":"867f9e0f-eca5-4b16-9616-a67e451bc036","Type":"ContainerStarted","Data":"28c37aaeff788aaec8dd7e284ba0ee4a2e5860f3a949e50ff2d9f1908729d361"}
Sep 10 22:39:08.323112 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:08.323082    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt"
Sep 10 22:39:08.343026 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:08.342961    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt" podStartSLOduration=2.342939059 podStartE2EDuration="2.342939059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:39:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:39:08.340077603 +0000 UTC m=+2253.012175525" watchObservedRunningTime="2026-09-10 22:39:08.342939059 +0000 UTC m=+2253.015036981"
Sep 10 22:39:08.761323 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:08.761268    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b65d6f984-hh95x_d3937a68-45f8-4372-95aa-9092b209dfe6/console/0.log"
Sep 10 22:39:08.801327 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:08.801293    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-q8rmz_455cfb34-8878-4260-84bd-320ec5bffb0c/download-server/0.log"
Sep 10 22:39:10.468669 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:10.468642    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w524p_271823ee-f2c9-4afa-bd8b-66f666095c92/dns/0.log"
Sep 10 22:39:10.490726 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:10.490695    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w524p_271823ee-f2c9-4afa-bd8b-66f666095c92/kube-rbac-proxy/0.log"
Sep 10 22:39:10.618349 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:10.618321    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jg6p2_324b3113-046f-4aa4-92cc-daca32755467/dns-node-resolver/0.log"
Sep 10 22:39:11.250844 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:11.250810    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-788d5df44-gfpnm_daee20da-5700-4c53-bbd9-73b7740c2af3/registry/0.log"
Sep 10 22:39:11.289819 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:11.289773    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4jw9j_ccb0482f-9c3a-4f1f-92c3-41816631091b/node-ca/0.log"
Sep 10 22:39:12.734795 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:12.734752    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69ccfddbf-hhltp_406fc6d2-bd67-4933-bbd2-2d083a618df4/kube-auth-proxy/0.log"
Sep 10 22:39:12.793831 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:12.793790    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4vbvh_2f711997-b4cd-4393-8740-96bb17ec3834/istio-proxy/0.log"
Sep 10 22:39:12.807401 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:12.807371    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4vbvh_2f711997-b4cd-4393-8740-96bb17ec3834/istio-proxy/1.log"
Sep 10 22:39:12.887316 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:12.887283    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-6dszf_c832a3f5-34f9-4b44-bb0e-329861d77d1d/payload-processing/0.log"
Sep 10 22:39:13.845591 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:13.845561    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4jtgl_a3693b69-6ebd-4065-895c-328d90290ce8/serve-healthcheck-canary/0.log"
Sep 10 22:39:14.497245 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:14.497218    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h8cb2_1bef2d5e-a670-4780-8433-9526446d099e/kube-rbac-proxy/0.log"
Sep 10 22:39:14.522519 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:14.522492    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h8cb2_1bef2d5e-a670-4780-8433-9526446d099e/exporter/0.log"
Sep 10 22:39:14.545479 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:14.545446    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h8cb2_1bef2d5e-a670-4780-8433-9526446d099e/extractor/0.log"
Sep 10 22:39:15.349405 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:15.349368    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8dpvh/perf-node-gather-daemonset-9spwt"
Sep 10 22:39:16.829465 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:16.829432    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rrr7z_e8e6ac4f-459f-4139-8feb-85795da91b07/manager/0.log"
Sep 10 22:39:17.063357 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:17.063242    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-l6xkk_e45c2274-fc79-486b-a9a1-02867a157683/manager/0.log"
Sep 10 22:39:17.374085 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:17.374012    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76d44b6d5b-8k7wc_5781a3c3-0e6d-4b74-b015-e7d9e74b295d/manager/0.log"
Sep 10 22:39:17.399960 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:17.399931    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76d44b6d5b-8k7wc_5781a3c3-0e6d-4b74-b015-e7d9e74b295d/copy-manifests/0.log"
Sep 10 22:39:18.925738 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:18.925706    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69ccfddbf-hhltp_406fc6d2-bd67-4933-bbd2-2d083a618df4/kube-auth-proxy/0.log"
Sep 10 22:39:18.963749 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:18.963714    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4vbvh_2f711997-b4cd-4393-8740-96bb17ec3834/istio-proxy/0.log"
Sep 10 22:39:18.975337 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:18.975306    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4vbvh_2f711997-b4cd-4393-8740-96bb17ec3834/istio-proxy/1.log"
Sep 10 22:39:19.036430 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:19.036394    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-6dszf_c832a3f5-34f9-4b44-bb0e-329861d77d1d/payload-processing/0.log"
Sep 10 22:39:20.815660 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:20.815583    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69ccfddbf-hhltp_406fc6d2-bd67-4933-bbd2-2d083a618df4/kube-auth-proxy/0.log"
Sep 10 22:39:20.845837 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:20.845801    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4vbvh_2f711997-b4cd-4393-8740-96bb17ec3834/istio-proxy/0.log"
Sep 10 22:39:20.856164 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:20.856133    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4vbvh_2f711997-b4cd-4393-8740-96bb17ec3834/istio-proxy/1.log"
Sep 10 22:39:20.921127 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:20.921092    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-6dszf_c832a3f5-34f9-4b44-bb0e-329861d77d1d/payload-processing/0.log"
Sep 10 22:39:25.666796 ip-10-0-130-67 kubenswrapper[2577]: I0910 22:39:25.666730    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5htbc_c92ce384-f37d-4421-a15e-52632b1ae1ba/kube-multus/0.log"