Sep 19 15:12:05.012308 ip-10-0-136-237 systemd[1]: Starting Kubernetes Kubelet...
Sep 19 15:12:05.407155 ip-10-0-136-237 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 15:12:05.407155 ip-10-0-136-237 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 19 15:12:05.407155 ip-10-0-136-237 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 15:12:05.407155 ip-10-0-136-237 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 19 15:12:05.407155 ip-10-0-136-237 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 15:12:05.408315 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.408232    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 19 15:12:05.415264 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415248    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 15:12:05.415264 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415264    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 15:12:05.415325 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415268    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 15:12:05.415325 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415273    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 15:12:05.415325 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415276    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 15:12:05.415325 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415279    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 15:12:05.415325 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415282    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 15:12:05.415325 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415285    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 15:12:05.415325 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415287    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 15:12:05.415325 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415290    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 15:12:05.415325 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415294    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 15:12:05.415325 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415298    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 15:12:05.415325 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415301    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 15:12:05.415325 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415305    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 15:12:05.415325 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415308    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 15:12:05.415325 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415311    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 15:12:05.415325 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415315    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 15:12:05.415325 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415317    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 15:12:05.415325 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415320    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 15:12:05.415325 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415323    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 15:12:05.415325 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415325    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 15:12:05.415800 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415328    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 15:12:05.415800 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415331    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 15:12:05.415800 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415334    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 15:12:05.415800 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415339    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 15:12:05.415800 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415343    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 15:12:05.415800 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415345    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 15:12:05.415800 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415348    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 15:12:05.415800 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415351    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 15:12:05.415800 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415353    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 15:12:05.415800 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415355    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 15:12:05.415800 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415358    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 15:12:05.415800 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415362    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 15:12:05.415800 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415365    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 15:12:05.415800 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415368    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 15:12:05.415800 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415371    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 15:12:05.415800 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415374    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 15:12:05.415800 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415377    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 15:12:05.415800 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415380    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 15:12:05.415800 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415383    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 15:12:05.416276 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415385    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 15:12:05.416276 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415388    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 15:12:05.416276 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415391    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 15:12:05.416276 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415393    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 15:12:05.416276 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415396    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 15:12:05.416276 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415399    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 15:12:05.416276 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415401    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 15:12:05.416276 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415403    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 15:12:05.416276 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415407    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 15:12:05.416276 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415409    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 15:12:05.416276 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415411    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 15:12:05.416276 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415414    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 15:12:05.416276 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415417    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 15:12:05.416276 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415420    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 15:12:05.416276 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415422    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 15:12:05.416276 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415425    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 15:12:05.416276 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415428    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 15:12:05.416276 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415430    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 15:12:05.416276 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415433    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 15:12:05.416276 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415435    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 15:12:05.416763 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415438    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 15:12:05.416763 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415440    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 15:12:05.416763 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415443    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 15:12:05.416763 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415445    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 15:12:05.416763 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415448    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 15:12:05.416763 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415450    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 15:12:05.416763 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415452    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 15:12:05.416763 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415455    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 15:12:05.416763 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415457    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 15:12:05.416763 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415460    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 15:12:05.416763 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415462    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 15:12:05.416763 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415465    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 15:12:05.416763 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415467    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 15:12:05.416763 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415470    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 15:12:05.416763 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415473    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 15:12:05.416763 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415475    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 15:12:05.416763 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415477    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 15:12:05.416763 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415480    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 15:12:05.416763 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415482    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 15:12:05.416763 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415484    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 15:12:05.416763 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415487    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 15:12:05.417281 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415489    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 15:12:05.417281 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415492    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 15:12:05.417281 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415494    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 15:12:05.417281 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415498    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 15:12:05.417281 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415500    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 15:12:05.417281 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415503    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 15:12:05.417281 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415506    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 15:12:05.417281 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415508    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 15:12:05.417281 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415511    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 15:12:05.417281 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415513    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 15:12:05.417281 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415515    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 15:12:05.417281 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415518    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 15:12:05.417281 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415520    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 15:12:05.417281 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415523    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 15:12:05.417281 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415525    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 15:12:05.417281 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415528    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 15:12:05.417281 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415530    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 15:12:05.417281 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.415532    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 15:12:05.417281 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416274    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 15:12:05.417281 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416282    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 15:12:05.417758 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416286    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 15:12:05.417758 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416289    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 15:12:05.417758 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416292    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 15:12:05.417758 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416296    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 15:12:05.417758 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416299    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 15:12:05.417758 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416302    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 15:12:05.417758 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416304    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 15:12:05.417758 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416307    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 15:12:05.417758 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416309    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 15:12:05.417758 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416312    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 15:12:05.417758 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416314    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 15:12:05.417758 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416316    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 15:12:05.417758 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416319    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 15:12:05.417758 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416322    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 15:12:05.417758 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416324    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 15:12:05.417758 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416327    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 15:12:05.417758 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416329    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 15:12:05.417758 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416333    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 15:12:05.417758 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416336    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 15:12:05.418231 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416338    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 15:12:05.418231 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416341    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 15:12:05.418231 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416344    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 15:12:05.418231 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416346    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 15:12:05.418231 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416349    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 15:12:05.418231 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416351    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 15:12:05.418231 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416354    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 15:12:05.418231 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416356    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 15:12:05.418231 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416361    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 15:12:05.418231 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416364    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 15:12:05.418231 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416367    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 15:12:05.418231 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416370    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 15:12:05.418231 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416373    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 15:12:05.418231 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416375    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 15:12:05.418231 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416377    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 15:12:05.418231 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416380    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 15:12:05.418231 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416383    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 15:12:05.418231 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416386    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 15:12:05.418231 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416388    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 15:12:05.418231 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416391    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 15:12:05.418707 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416393    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 15:12:05.418707 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416396    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 15:12:05.418707 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416398    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 15:12:05.418707 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416402    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 15:12:05.418707 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416404    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 15:12:05.418707 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416407    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 15:12:05.418707 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416409    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 15:12:05.418707 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416412    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 15:12:05.418707 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416415    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 15:12:05.418707 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416418    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 15:12:05.418707 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416422    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 15:12:05.418707 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416425    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 15:12:05.418707 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416427    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 15:12:05.418707 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416430    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 15:12:05.418707 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416432    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 15:12:05.418707 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416435    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 15:12:05.418707 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416437    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 15:12:05.418707 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416440    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 15:12:05.418707 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416442    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 15:12:05.418707 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416445    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 15:12:05.419219 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416447    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 15:12:05.419219 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416449    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 15:12:05.419219 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416452    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 15:12:05.419219 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416454    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 15:12:05.419219 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416456    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 15:12:05.419219 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416459    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 15:12:05.419219 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416463    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 15:12:05.419219 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416466    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 15:12:05.419219 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416469    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 15:12:05.419219 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416472    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 15:12:05.419219 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416480    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 15:12:05.419219 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416483    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 15:12:05.419219 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416486    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 15:12:05.419219 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416488    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 15:12:05.419219 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416491    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 15:12:05.419219 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416493    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 15:12:05.419219 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416496    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 15:12:05.419219 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416498    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 15:12:05.419219 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416501    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 15:12:05.419219 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416503    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 15:12:05.419696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416506    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 15:12:05.419696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416509    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 15:12:05.419696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416511    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 15:12:05.419696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416515    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 15:12:05.419696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416518    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 15:12:05.419696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416521    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 15:12:05.419696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416524    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 15:12:05.419696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416526    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 15:12:05.419696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416529    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 15:12:05.419696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416531    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 15:12:05.419696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416534    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 15:12:05.419696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416536    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 15:12:05.419696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416538    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 15:12:05.419696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416540    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 15:12:05.419696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416543    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 15:12:05.419696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416545    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 15:12:05.419696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416548    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 15:12:05.419696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416550    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 15:12:05.419696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416977    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 15:12:05.420182 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416982    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 15:12:05.420182 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416993    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 15:12:05.420182 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.416996    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 15:12:05.420182 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417001    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 15:12:05.420182 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417003    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 15:12:05.420182 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417006    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 15:12:05.420182 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417008    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 15:12:05.420182 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417011    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 15:12:05.420182 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417014    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 15:12:05.420182 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417016    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 15:12:05.420182 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417019    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 15:12:05.420182 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417026    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 15:12:05.420182 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417029    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 15:12:05.420182 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417031    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 15:12:05.420182 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417034    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 15:12:05.420182 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417036    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 15:12:05.420182 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417039    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 15:12:05.420182 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417041    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 15:12:05.420182 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417044    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 15:12:05.420182 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417047    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 15:12:05.420696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417049    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 15:12:05.420696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417054    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 15:12:05.420696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417057    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 15:12:05.420696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417060    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 15:12:05.420696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417063    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 15:12:05.420696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417066    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 15:12:05.420696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417068    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 15:12:05.420696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417071    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 15:12:05.420696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417074    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 15:12:05.420696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417076    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 15:12:05.420696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417080    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 15:12:05.420696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417083    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 15:12:05.420696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417086    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 15:12:05.420696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417089    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 15:12:05.420696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417092    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 15:12:05.420696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417094    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 15:12:05.420696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417097    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 15:12:05.420696 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417099    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 15:12:05.421244 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417102    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 15:12:05.421244 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417104    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 15:12:05.421244 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417106    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 15:12:05.421244 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417110    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 15:12:05.421244 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417112    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 15:12:05.421244 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417117    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 15:12:05.421244 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417120    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 15:12:05.421244 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417122    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 15:12:05.421244 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417125    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 15:12:05.421244 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417127    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 15:12:05.421244 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417130    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 15:12:05.421244 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417132    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 15:12:05.421244 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417135    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 15:12:05.421244 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417137    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 15:12:05.421244 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417139    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 15:12:05.421244 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417142    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 15:12:05.421244 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417145    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 15:12:05.421244 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417147    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 15:12:05.421244 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417150    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 15:12:05.421244 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417152    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 15:12:05.421725 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417155    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 15:12:05.421725 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417157    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 15:12:05.421725 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417160    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 15:12:05.421725 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417162    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 15:12:05.421725 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417164    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 15:12:05.421725 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417167    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 15:12:05.421725 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417169    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 15:12:05.421725 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417171    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 15:12:05.421725 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417174    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 15:12:05.421725 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417176    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 15:12:05.421725 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417179    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 15:12:05.421725 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417181    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 15:12:05.421725 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417184    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 15:12:05.421725 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417187    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 15:12:05.421725 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417189    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 15:12:05.421725 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417191    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 15:12:05.421725 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417194    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 15:12:05.421725 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417199    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 15:12:05.421725 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417201    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 15:12:05.421725 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417204    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 15:12:05.422221 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417207    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 15:12:05.422221 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417209    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 15:12:05.422221 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417212    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 15:12:05.422221 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417214    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 15:12:05.422221 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417217    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 15:12:05.422221 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417220    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 15:12:05.422221 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417222    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 15:12:05.422221 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417224    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 15:12:05.422221 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417227    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 15:12:05.422221 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417229    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 15:12:05.422221 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417232    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 15:12:05.422221 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417235    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 15:12:05.422221 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417238    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 15:12:05.422221 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417242    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 15:12:05.422221 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417244    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 15:12:05.422221 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417247    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 15:12:05.422221 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417249    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 15:12:05.422221 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417252    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 15:12:05.422221 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417254    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 15:12:05.422221 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417256    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417324    2563 flags.go:64] FLAG: --address="0.0.0.0"
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417371    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417377    2563 flags.go:64] FLAG: --anonymous-auth="true"
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417382    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417387    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417390    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417395    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417399    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417402    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417406    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417409    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417412    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417415    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417417    2563 flags.go:64] FLAG: --cgroup-root=""
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417420    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417423    2563 flags.go:64] FLAG: --client-ca-file=""
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417426    2563 flags.go:64] FLAG: --cloud-provider="external"
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417428    2563 flags.go:64] FLAG: --cluster-dns="[]"
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417438    2563 flags.go:64] FLAG: --cluster-domain=""
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417441    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417444    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417447    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417450    2563 flags.go:64] FLAG: --container-log-max-files="5"
Sep 19 15:12:05.422693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417454    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417457    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417460    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417462    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417465    2563 flags.go:64] FLAG: --contention-profiling="false"
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417468    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417473    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417476    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417479    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417483    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417486    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417489    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417491    2563 flags.go:64] FLAG: --enable-load-reader="false"
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417494    2563 flags.go:64] FLAG: --enable-server="true"
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417497    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417502    2563 flags.go:64] FLAG: --event-burst="100"
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417505    2563 flags.go:64] FLAG: --event-qps="50"
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417508    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417511    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417513    2563 flags.go:64] FLAG: --eviction-hard=""
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417517    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417520    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417523    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417526    2563 flags.go:64] FLAG: --eviction-soft=""
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417529    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 19 15:12:05.423263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417531    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417534    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417537    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417540    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417542    2563 flags.go:64] FLAG: --fail-swap-on="true"
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417545    2563 flags.go:64] FLAG: --feature-gates=""
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417549    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417552    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417555    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417558    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417561    2563 flags.go:64] FLAG: --healthz-port="10248"
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417564    2563 flags.go:64] FLAG: --help="false"
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417566    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-136-237.ec2.internal"
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417571    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417574    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417576    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417579    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417583    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417585    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417588    2563 flags.go:64] FLAG: --image-service-endpoint=""
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417591    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417593    2563 flags.go:64] FLAG: --kube-api-burst="100"
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417597    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417600    2563 flags.go:64] FLAG: --kube-api-qps="50"
Sep 19 15:12:05.423916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417603    2563 flags.go:64] FLAG: --kube-reserved=""
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417606    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417609    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417612    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417615    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417617    2563 flags.go:64] FLAG: --lock-file=""
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417620    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417623    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417626    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417631    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417634    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417636    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417639    2563 flags.go:64] FLAG: --logging-format="text"
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417642    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417645    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417647    2563 flags.go:64] FLAG: --manifest-url=""
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417650    2563 flags.go:64] FLAG: --manifest-url-header=""
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417654    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417657    2563 flags.go:64] FLAG: --max-open-files="1000000"
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417661    2563 flags.go:64] FLAG: --max-pods="110"
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417664    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417668    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417671    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417674    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417677    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 19 15:12:05.424505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417680    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417682    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417689    2563 flags.go:64] FLAG: --node-status-max-images="50"
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417692    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417695    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417698    2563 flags.go:64] FLAG: --pod-cidr=""
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417701    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417706    2563 flags.go:64] FLAG: --pod-manifest-path=""
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417709    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417712    2563 flags.go:64] FLAG: --pods-per-core="0"
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417715    2563 flags.go:64] FLAG: --port="10250"
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417718    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417721    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c2957660fcb9b253"
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417724    2563 flags.go:64] FLAG: --qos-reserved=""
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417726    2563 flags.go:64] FLAG: --read-only-port="10255"
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417729    2563 flags.go:64] FLAG: --register-node="true"
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417732    2563 flags.go:64] FLAG: --register-with-taints=""
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417735    2563 flags.go:64] FLAG: --registry-burst="10"
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417738    2563 flags.go:64] FLAG: --registry-qps="5"
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417740    2563 flags.go:64] FLAG: --reserved-cpus=""
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417743    2563 flags.go:64] FLAG: --reserved-memory=""
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417747    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417749    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417752    2563 flags.go:64] FLAG: --rotate-certificates="false"
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417755    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 19 15:12:05.425136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417758    2563 flags.go:64] FLAG: --runonce="false"
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417761    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417763    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417769    2563 flags.go:64] FLAG: --seccomp-default="false"
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417772    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417775    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417778    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417781    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417784    2563 flags.go:64] FLAG: --storage-driver-password="root"
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417787    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417789    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417792    2563 flags.go:64] FLAG: --storage-driver-user="root"
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417795    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417798    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417802    2563 flags.go:64] FLAG: --system-cgroups=""
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417805    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417810    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417813    2563 flags.go:64] FLAG: --tls-cert-file=""
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417816    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417820    2563 flags.go:64] FLAG: --tls-min-version=""
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417823    2563 flags.go:64] FLAG: --tls-private-key-file=""
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417826    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417829    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417832    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417835    2563 flags.go:64] FLAG: --v="2"
Sep 19 15:12:05.425766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417838    2563 flags.go:64] FLAG: --version="false"
Sep 19 15:12:05.426398 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417842    2563 flags.go:64] FLAG: --vmodule=""
Sep 19 15:12:05.426398 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417845    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 19 15:12:05.426398 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.417849    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 19 15:12:05.426398 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417989    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 15:12:05.426398 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417993    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 15:12:05.426398 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.417997    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 15:12:05.426398 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418000    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 15:12:05.426398 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418003    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 15:12:05.426398 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418005    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 15:12:05.426398 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418009    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 15:12:05.426398 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418012    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 15:12:05.426398 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418015    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 15:12:05.426398 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418017    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 15:12:05.426398 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418020    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 15:12:05.426398 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418022    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 15:12:05.426398 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418025    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 15:12:05.426398 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418027    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 15:12:05.426398 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418030    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 15:12:05.426398 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418032    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 15:12:05.426398 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418035    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 15:12:05.426879 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418039    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 15:12:05.426879 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418042    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 15:12:05.426879 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418044    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 15:12:05.426879 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418047    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 15:12:05.426879 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418049    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 15:12:05.426879 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418052    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 15:12:05.426879 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418054    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 15:12:05.426879 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418057    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 15:12:05.426879 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418059    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 15:12:05.426879 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418062    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 15:12:05.426879 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418064    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 15:12:05.426879 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418067    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 15:12:05.426879 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418069    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 15:12:05.426879 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418072    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 15:12:05.426879 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418074    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 15:12:05.426879 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418077    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 15:12:05.426879 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418079    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 15:12:05.426879 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418082    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 15:12:05.426879 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418084    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 15:12:05.426879 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418087    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 15:12:05.427386 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418089    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 15:12:05.427386 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418093    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 15:12:05.427386 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418096    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 15:12:05.427386 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418098    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 15:12:05.427386 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418101    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 15:12:05.427386 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418103    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 15:12:05.427386 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418106    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 15:12:05.427386 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418108    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 15:12:05.427386 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418111    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 15:12:05.427386 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418113    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 15:12:05.427386 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418115    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 15:12:05.427386 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418119    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 15:12:05.427386 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418125    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 15:12:05.427386 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418128    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 15:12:05.427386 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418131    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 15:12:05.427386 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418134    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 15:12:05.427386 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418137    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 15:12:05.427386 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418140    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 15:12:05.427386 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418142    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 15:12:05.427846 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418145    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 15:12:05.427846 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418147    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 15:12:05.427846 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418150    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 15:12:05.427846 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418152    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 15:12:05.427846 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418154    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 15:12:05.427846 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418158    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 15:12:05.427846 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418161    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 15:12:05.427846 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418164    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 15:12:05.427846 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418167    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 15:12:05.427846 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418169    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 15:12:05.427846 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418172    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 15:12:05.427846 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418174    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 15:12:05.427846 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418176    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 15:12:05.427846 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418179    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 15:12:05.427846 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418182    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 15:12:05.427846 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418185    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 15:12:05.427846 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418187    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 15:12:05.427846 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418190    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 15:12:05.427846 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418193    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 15:12:05.427846 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418195    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 15:12:05.428323 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418199    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 15:12:05.428323 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418202    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 15:12:05.428323 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418205    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 15:12:05.428323 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418208    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 15:12:05.428323 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418211    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 15:12:05.428323 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418214    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 15:12:05.428323 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418217    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 15:12:05.428323 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418219    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 15:12:05.428323 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418222    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 15:12:05.428323 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418225    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 15:12:05.428323 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418227    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 15:12:05.428323 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418230    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 15:12:05.428323 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418232    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 15:12:05.428323 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418235    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 15:12:05.428323 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418239    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 15:12:05.428323 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418243    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 15:12:05.428323 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418247    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 15:12:05.428323 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418250    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 15:12:05.428323 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418254    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 15:12:05.428778 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418256    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 15:12:05.428778 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418259    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 15:12:05.428778 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418262    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 15:12:05.428778 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.418264    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 15:12:05.428778 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.418995    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 15:12:05.428778 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.426881    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 19 15:12:05.428778 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.427025    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 19 15:12:05.428778 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.427949    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 19 15:12:05.428778 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.427957    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 19 15:12:05.428778 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428015    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 15:12:05.428778 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428020    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 15:12:05.428778 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428023    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 15:12:05.428778 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428026    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 15:12:05.428778 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428029    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 15:12:05.428778 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428032    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 15:12:05.429185 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428035    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 15:12:05.429185 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428038    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 15:12:05.429185 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428040    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 15:12:05.429185 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428043    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 15:12:05.429185 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428046    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 15:12:05.429185 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428048    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 15:12:05.429185 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428051    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 15:12:05.429185 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428054    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 15:12:05.429185 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428056    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 15:12:05.429185 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428060    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 15:12:05.429185 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428062    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 15:12:05.429185 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428065    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 15:12:05.429185 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428068    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 15:12:05.429185 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428072    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 15:12:05.429185 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428075    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 15:12:05.429185 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428078    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 15:12:05.429185 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428081    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 15:12:05.429185 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428084    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 15:12:05.429185 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428086    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 15:12:05.429639 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428089    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 15:12:05.429639 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428092    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 15:12:05.429639 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428094    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 15:12:05.429639 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428097    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 15:12:05.429639 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428101    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 15:12:05.429639 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428104    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 15:12:05.429639 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428107    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 15:12:05.429639 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428110    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 15:12:05.429639 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428113    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 15:12:05.429639 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428115    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 15:12:05.429639 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428118    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 15:12:05.429639 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428121    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 15:12:05.429639 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428123    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 15:12:05.429639 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428126    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 15:12:05.429639 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428128    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 15:12:05.429639 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428130    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 15:12:05.429639 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428133    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 15:12:05.429639 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428135    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 15:12:05.429639 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428138    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 15:12:05.429639 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428140    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 15:12:05.430144 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428143    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 15:12:05.430144 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428145    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 15:12:05.430144 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428148    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 15:12:05.430144 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428150    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 15:12:05.430144 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428153    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 15:12:05.430144 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428155    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 15:12:05.430144 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428158    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 15:12:05.430144 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428160    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 15:12:05.430144 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428162    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 15:12:05.430144 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428165    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 15:12:05.430144 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428167    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 15:12:05.430144 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428170    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 15:12:05.430144 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428172    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 15:12:05.430144 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428175    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 15:12:05.430144 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428177    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 15:12:05.430144 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428180    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 15:12:05.430144 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428183    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 15:12:05.430144 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428186    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 15:12:05.430144 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428188    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 15:12:05.430144 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428191    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 15:12:05.430635 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428193    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 15:12:05.430635 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428196    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 15:12:05.430635 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428198    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 15:12:05.430635 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428201    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 15:12:05.430635 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428203    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 15:12:05.430635 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428206    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 15:12:05.430635 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428208    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 15:12:05.430635 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428211    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 15:12:05.430635 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428213    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 15:12:05.430635 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428216    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 15:12:05.430635 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428219    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 15:12:05.430635 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428221    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 15:12:05.430635 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428224    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 15:12:05.430635 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428227    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 15:12:05.430635 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428229    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 15:12:05.430635 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428231    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 15:12:05.430635 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428234    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 15:12:05.430635 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428236    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 15:12:05.430635 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428239    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 15:12:05.430635 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428241    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 15:12:05.431129 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428245    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 15:12:05.431129 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428249    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 15:12:05.431129 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428252    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 15:12:05.431129 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428255    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 15:12:05.431129 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428257    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 15:12:05.431129 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428260    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 15:12:05.431129 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428263    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 15:12:05.431129 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428266    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 15:12:05.431129 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428270    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 15:12:05.431129 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428274    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 15:12:05.431129 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428278    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 15:12:05.431129 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428281    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 15:12:05.431129 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428284    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 15:12:05.431129 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428286    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 15:12:05.431518 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.428291    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 15:12:05.431518 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428405    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 15:12:05.431518 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428410    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 15:12:05.431518 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428413    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 15:12:05.431518 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428416    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 15:12:05.431518 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428418    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 15:12:05.431518 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428421    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 15:12:05.431518 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428424    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 15:12:05.431518 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428427    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 15:12:05.431518 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428430    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 15:12:05.431518 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428432    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 15:12:05.431518 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428435    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 15:12:05.431518 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428439    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 15:12:05.431518 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428443    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 15:12:05.431518 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428445    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 15:12:05.431919 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428448    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 15:12:05.431919 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428451    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 15:12:05.431919 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428454    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 15:12:05.431919 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428456    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 15:12:05.431919 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428459    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 15:12:05.431919 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428461    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 15:12:05.431919 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428464    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 15:12:05.431919 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428466    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 15:12:05.431919 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428469    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 15:12:05.431919 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428471    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 15:12:05.431919 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428474    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 15:12:05.431919 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428476    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 15:12:05.431919 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428480    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 15:12:05.431919 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428482    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 15:12:05.431919 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428485    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 15:12:05.431919 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428488    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 15:12:05.431919 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428491    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 15:12:05.431919 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428493    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 15:12:05.431919 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428496    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 15:12:05.432403 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428498    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 15:12:05.432403 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428501    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 15:12:05.432403 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428503    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 15:12:05.432403 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428507    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 15:12:05.432403 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428510    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 15:12:05.432403 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428512    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 15:12:05.432403 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428515    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 15:12:05.432403 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428517    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 15:12:05.432403 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428520    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 15:12:05.432403 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428522    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 15:12:05.432403 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428524    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 15:12:05.432403 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428527    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 15:12:05.432403 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428529    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 15:12:05.432403 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428532    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 15:12:05.432403 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428534    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 15:12:05.432403 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428536    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 15:12:05.432403 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428539    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 15:12:05.432403 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428541    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 15:12:05.432403 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428543    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 15:12:05.432403 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428546    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 15:12:05.432902 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428548    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 15:12:05.432902 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428551    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 15:12:05.432902 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428553    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 15:12:05.432902 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428556    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 15:12:05.432902 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428559    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 15:12:05.432902 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428562    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 15:12:05.432902 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428564    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 15:12:05.432902 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428567    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 15:12:05.432902 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428570    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 15:12:05.432902 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428573    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 15:12:05.432902 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428575    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 15:12:05.432902 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428578    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 15:12:05.432902 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428580    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 15:12:05.432902 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428582    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 15:12:05.432902 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428585    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 15:12:05.432902 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428587    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 15:12:05.432902 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428590    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 15:12:05.432902 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428592    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 15:12:05.432902 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428594    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 15:12:05.432902 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428598    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 15:12:05.433421 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428602    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 15:12:05.433421 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428604    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 15:12:05.433421 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428607    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 15:12:05.433421 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428610    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 15:12:05.433421 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428612    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 15:12:05.433421 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428615    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 15:12:05.433421 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428617    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 15:12:05.433421 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428619    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 15:12:05.433421 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428622    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 15:12:05.433421 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428624    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 15:12:05.433421 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428627    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 15:12:05.433421 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428629    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 15:12:05.433421 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428632    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 15:12:05.433421 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428635    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 15:12:05.433421 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428638    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 15:12:05.433421 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428640    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 15:12:05.433421 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428643    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 15:12:05.433421 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428645    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 15:12:05.433421 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428648    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 15:12:05.433421 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428650    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 15:12:05.433904 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428652    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 15:12:05.433904 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428655    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 15:12:05.433904 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428658    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 15:12:05.433904 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428660    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 15:12:05.433904 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428663    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 15:12:05.433904 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:05.428665    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 15:12:05.433904 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.428670    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 15:12:05.433904 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.428766    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 19 15:12:05.433904 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.431144    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 19 15:12:05.433904 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.432194    2563 server.go:1019] "Starting client certificate rotation"
Sep 19 15:12:05.433904 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.432302    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 19 15:12:05.433904 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.432741    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 19 15:12:05.435312 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.435295    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 19 15:12:05.439853 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.439834    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 19 15:12:05.449812 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.449794    2563 log.go:25] "Validated CRI v1 runtime API"
Sep 19 15:12:05.451698 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.451684    2563 log.go:25] "Validated CRI v1 image API"
Sep 19 15:12:05.452596 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.452579    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 19 15:12:05.458744 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.458718    2563 fs.go:135] Filesystem UUIDs: map[68c36daf-28e4-43b1-a42a-4ac095b30529:/dev/nvme0n1p3 6d31df96-f128-4649-bd3f-8a1069a22762:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 19 15:12:05.458810 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.458743    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 19 15:12:05.464072 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.463955    2563 manager.go:216] Machine: {Timestamp:2026-09-19 15:12:05.462617223 +0000 UTC m=+0.351816926 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110851 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b21718f37d80d0b6ea355c3fc796d SystemUUID:ec2b2171-8f37-d80d-0b6e-a355c3fc796d BootID:4140b328-2f99-4737-944f-63cb1d8d196d Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:fc:f5:2d:8f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:fc:f5:2d:8f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:c5:ec:ef:3a:15 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 19 15:12:05.464072 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.464065    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 19 15:12:05.464194 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.464183    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 19 15:12:05.466427 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.466397    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 19 15:12:05.466583 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.466431    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-237.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 19 15:12:05.467350 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.467337    2563 topology_manager.go:138] "Creating topology manager with none policy"
Sep 19 15:12:05.467405 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.467354    2563 container_manager_linux.go:309] "Creating device plugin manager"
Sep 19 15:12:05.467405 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.467362    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 19 15:12:05.468310 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.468298    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 19 15:12:05.468390 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.468381    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 19 15:12:05.469518 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.469503    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 19 15:12:05.474028 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.474014    2563 state_mem.go:36] "Initialized new in-memory state store"
Sep 19 15:12:05.474157 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.474148    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 19 15:12:05.474195 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.474179    2563 kubelet.go:486] "Attempting to sync node with API server"
Sep 19 15:12:05.474195 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.474193    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 19 15:12:05.474248 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.474208    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 19 15:12:05.474248 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.474223    2563 kubelet.go:398] "Adding apiserver pod source"
Sep 19 15:12:05.474248 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.474238    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 19 15:12:05.474669 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.474657    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 19 15:12:05.474719 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.474678    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 19 15:12:05.477127 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.477113    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 19 15:12:05.480130 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.480116    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 19 15:12:05.480173 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.480147    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 19 15:12:05.481621 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.481610    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 19 15:12:05.481693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.481625    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 19 15:12:05.481693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.481631    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 19 15:12:05.481693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.481636    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 19 15:12:05.481693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.481645    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 19 15:12:05.481693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.481650    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 19 15:12:05.481693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.481664    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 19 15:12:05.481693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.481669    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 19 15:12:05.481693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.481675    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 19 15:12:05.481693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.481681    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 19 15:12:05.481693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.481690    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 19 15:12:05.481693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.481695    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 19 15:12:05.483610 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.483583    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 19 15:12:05.483666 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.483617    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 19 15:12:05.489596 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.489565    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-237.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 19 15:12:05.489664 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:05.489602    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-237.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 19 15:12:05.489847 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:05.489612    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 19 15:12:05.492732 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.492717    2563 server.go:1268] "Started kubelet"
Sep 19 15:12:05.492804 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.492773    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 19 15:12:05.492881 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.492804    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 19 15:12:05.492958 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.492917    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 19 15:12:05.493600 ip-10-0-136-237 systemd[1]: Started Kubernetes Kubelet.
Sep 19 15:12:05.494488 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.494472    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 19 15:12:05.495143 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.495130    2563 server.go:310] "Adding debug handlers to kubelet server"
Sep 19 15:12:05.497105 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:05.497087    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 19 15:12:05.498934 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:05.497810    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-237.ec2.internal.18d6c18fd9122b79  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-237.ec2.internal,UID:ip-10-0-136-237.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-237.ec2.internal,},FirstTimestamp:2026-09-19 15:12:05.492681593 +0000 UTC m=+0.381881296,LastTimestamp:2026-09-19 15:12:05.492681593 +0000 UTC m=+0.381881296,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-237.ec2.internal,}"
Sep 19 15:12:05.502725 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.502712    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 19 15:12:05.503440 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.503421    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 19 15:12:05.503755 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:05.503631    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-237.ec2.internal\" not found"
Sep 19 15:12:05.504220 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.504202    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 19 15:12:05.504303 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.504238    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 19 15:12:05.504369 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.504230    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 19 15:12:05.504369 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.504326    2563 reconstruct.go:97] "Volume reconstruction finished"
Sep 19 15:12:05.504442 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.504373    2563 reconciler.go:29] "Reconciler: start to sync state"
Sep 19 15:12:05.504533 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.504518    2563 factory.go:55] Registering systemd factory
Sep 19 15:12:05.504584 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.504563    2563 factory.go:223] Registration of the systemd container factory successfully
Sep 19 15:12:05.504792 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.504776    2563 factory.go:153] Registering CRI-O factory
Sep 19 15:12:05.504792 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.504793    2563 factory.go:223] Registration of the crio container factory successfully
Sep 19 15:12:05.504942 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.504837    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 19 15:12:05.504942 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.504854    2563 factory.go:103] Registering Raw factory
Sep 19 15:12:05.504942 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.504864    2563 manager.go:1196] Started watching for new ooms in manager
Sep 19 15:12:05.505235 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.505219    2563 manager.go:349] Starting recovery of all containers
Sep 19 15:12:05.507131 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.507105    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-27c7r"
Sep 19 15:12:05.513585 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.513560    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-27c7r"
Sep 19 15:12:05.514362 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:05.514339    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-237.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 19 15:12:05.514452 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:05.514427    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 19 15:12:05.517757 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.517739    2563 manager.go:354] Recovery completed
Sep 19 15:12:05.523341 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.523326    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 15:12:05.525112 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.525095    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-237.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 15:12:05.525194 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.525126    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-237.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 15:12:05.525194 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.525140    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-237.ec2.internal" event="NodeHasSufficientPID"
Sep 19 15:12:05.525724 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.525707    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 19 15:12:05.525724 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.525718    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 15:12:05.525724 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.525723    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 19 15:12:05.525856 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.525740    2563 state_mem.go:36] "Initialized new in-memory state store"
Sep 19 15:12:05.526379 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.526365    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-237.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 15:12:05.526441 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.526387    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-237.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 15:12:05.526441 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.526396    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-237.ec2.internal" event="NodeHasSufficientPID"
Sep 19 15:12:05.527933 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.527921    2563 policy_none.go:49] "None policy: Start"
Sep 19 15:12:05.528566 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.528558    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 19 15:12:05.528602 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.528571    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 19 15:12:05.530511 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.530501    2563 policy_none.go:47] "Start"
Sep 19 15:12:05.579170 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.572182    2563 manager.go:337] "Starting Device Plugin manager"
Sep 19 15:12:05.579170 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:05.572215    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 19 15:12:05.579170 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.572228    2563 server.go:87] "Starting device plugin registration server"
Sep 19 15:12:05.579170 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.572490    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 19 15:12:05.579170 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.572500    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 19 15:12:05.579170 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.572602    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 19 15:12:05.579170 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.572678    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 19 15:12:05.579170 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.572685    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 19 15:12:05.579170 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:05.573202    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 19 15:12:05.579170 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:05.573259    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-237.ec2.internal\" not found"
Sep 19 15:12:05.632721 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.632681    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 19 15:12:05.634045 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.634029    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 19 15:12:05.634113 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.634079    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 19 15:12:05.634113 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.634105    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 19 15:12:05.634210 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:05.634141    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 19 15:12:05.636427 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.636407    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 15:12:05.673377 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.673288    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 15:12:05.674251 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.674233    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-237.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 15:12:05.674354 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.674267    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-237.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 15:12:05.674354 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.674281    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-237.ec2.internal" event="NodeHasSufficientPID"
Sep 19 15:12:05.674354 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.674310    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-237.ec2.internal"
Sep 19 15:12:05.680885 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.680869    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-237.ec2.internal"
Sep 19 15:12:05.680961 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:05.680905    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-237.ec2.internal\": node \"ip-10-0-136-237.ec2.internal\" not found"
Sep 19 15:12:05.701736 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:05.701710    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-237.ec2.internal\" not found"
Sep 19 15:12:05.735282 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.735255    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-237.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-237.ec2.internal"]
Sep 19 15:12:05.735382 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.735312    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 15:12:05.738214 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.738199    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-237.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 15:12:05.738296 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.738232    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-237.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 15:12:05.738296 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.738245    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-237.ec2.internal" event="NodeHasSufficientPID"
Sep 19 15:12:05.740555 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.740543    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 15:12:05.740676 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.740659    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-237.ec2.internal"
Sep 19 15:12:05.740716 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.740690    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 15:12:05.741333 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.741318    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-237.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 15:12:05.741423 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.741342    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-237.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 15:12:05.741423 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.741366    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-237.ec2.internal" event="NodeHasSufficientPID"
Sep 19 15:12:05.741423 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.741389    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-237.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 15:12:05.741423 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.741414    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-237.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 15:12:05.741596 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.741430    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-237.ec2.internal" event="NodeHasSufficientPID"
Sep 19 15:12:05.745310 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.745296    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-237.ec2.internal"
Sep 19 15:12:05.745381 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.745322    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 15:12:05.746793 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.746777    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-237.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 15:12:05.746875 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.746808    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-237.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 15:12:05.746875 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.746822    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-237.ec2.internal" event="NodeHasSufficientPID"
Sep 19 15:12:05.766461 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:05.766436    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-237.ec2.internal\" not found" node="ip-10-0-136-237.ec2.internal"
Sep 19 15:12:05.771831 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:05.771817    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-237.ec2.internal\" not found" node="ip-10-0-136-237.ec2.internal"
Sep 19 15:12:05.802654 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:05.802627    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-237.ec2.internal\" not found"
Sep 19 15:12:05.805953 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.805936    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fac8ce90b3987ed9cce92ba26e925a49-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-237.ec2.internal\" (UID: \"fac8ce90b3987ed9cce92ba26e925a49\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-237.ec2.internal"
Sep 19 15:12:05.806023 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.805960    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4704ab0c7c799113b04cd82d197e4ed2-config\") pod \"kube-apiserver-proxy-ip-10-0-136-237.ec2.internal\" (UID: \"4704ab0c7c799113b04cd82d197e4ed2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-237.ec2.internal"
Sep 19 15:12:05.806023 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.805978    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fac8ce90b3987ed9cce92ba26e925a49-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-237.ec2.internal\" (UID: \"fac8ce90b3987ed9cce92ba26e925a49\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-237.ec2.internal"
Sep 19 15:12:05.903629 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:05.903597    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-237.ec2.internal\" not found"
Sep 19 15:12:05.906865 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.906848    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4704ab0c7c799113b04cd82d197e4ed2-config\") pod \"kube-apiserver-proxy-ip-10-0-136-237.ec2.internal\" (UID: \"4704ab0c7c799113b04cd82d197e4ed2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-237.ec2.internal"
Sep 19 15:12:05.906938 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.906875    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fac8ce90b3987ed9cce92ba26e925a49-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-237.ec2.internal\" (UID: \"fac8ce90b3987ed9cce92ba26e925a49\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-237.ec2.internal"
Sep 19 15:12:05.906938 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.906905    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fac8ce90b3987ed9cce92ba26e925a49-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-237.ec2.internal\" (UID: \"fac8ce90b3987ed9cce92ba26e925a49\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-237.ec2.internal"
Sep 19 15:12:05.907033 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.906970    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4704ab0c7c799113b04cd82d197e4ed2-config\") pod \"kube-apiserver-proxy-ip-10-0-136-237.ec2.internal\" (UID: \"4704ab0c7c799113b04cd82d197e4ed2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-237.ec2.internal"
Sep 19 15:12:05.907033 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.906983    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fac8ce90b3987ed9cce92ba26e925a49-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-237.ec2.internal\" (UID: \"fac8ce90b3987ed9cce92ba26e925a49\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-237.ec2.internal"
Sep 19 15:12:05.907033 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:05.906999    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fac8ce90b3987ed9cce92ba26e925a49-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-237.ec2.internal\" (UID: \"fac8ce90b3987ed9cce92ba26e925a49\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-237.ec2.internal"
Sep 19 15:12:06.004322 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:06.004281    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-237.ec2.internal\" not found"
Sep 19 15:12:06.069737 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:06.069701    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-237.ec2.internal"
Sep 19 15:12:06.075951 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:06.075932    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-237.ec2.internal"
Sep 19 15:12:06.104382 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:06.104353    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-237.ec2.internal\" not found"
Sep 19 15:12:06.204841 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:06.204808    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-237.ec2.internal\" not found"
Sep 19 15:12:06.305306 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:06.305247    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-237.ec2.internal\" not found"
Sep 19 15:12:06.405742 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:06.405711    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-237.ec2.internal\" not found"
Sep 19 15:12:06.432031 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:06.432003    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 19 15:12:06.432457 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:06.432161    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 19 15:12:06.506328 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:06.506296    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-237.ec2.internal\" not found"
Sep 19 15:12:06.521362 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:06.521298    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-18 15:07:06 +0000 UTC" deadline="2028-05-22 16:25:55.112432855 +0000 UTC"
Sep 19 15:12:06.521362 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:06.521357    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14665h13m48.591079232s"
Sep 19 15:12:06.562159 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:06.562095    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 15:12:06.603920 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:06.603877    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-237.ec2.internal"
Sep 19 15:12:06.614004 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:06.613987    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 19 15:12:06.615377 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:06.615363    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-237.ec2.internal"
Sep 19 15:12:06.625173 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:06.625155    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 19 15:12:06.750638 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:06.750611    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 15:12:06.772497 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:06.772323    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4704ab0c7c799113b04cd82d197e4ed2.slice/crio-9158e657749806e7ce878609d43f913ca5e3e354a122090e241743f7573feee1 WatchSource:0}: Error finding container 9158e657749806e7ce878609d43f913ca5e3e354a122090e241743f7573feee1: Status 404 returned error can't find the container with id 9158e657749806e7ce878609d43f913ca5e3e354a122090e241743f7573feee1
Sep 19 15:12:06.772830 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:06.772811    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfac8ce90b3987ed9cce92ba26e925a49.slice/crio-0ef852dd3a9b336bb65675ac408efc4d14c0b5f62153c4fc99cfc79f9e6a3a87 WatchSource:0}: Error finding container 0ef852dd3a9b336bb65675ac408efc4d14c0b5f62153c4fc99cfc79f9e6a3a87: Status 404 returned error can't find the container with id 0ef852dd3a9b336bb65675ac408efc4d14c0b5f62153c4fc99cfc79f9e6a3a87
Sep 19 15:12:06.778597 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:06.778579    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 15:12:06.809329 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:06.809298    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 15:12:07.244771 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.244734    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 15:12:07.475962 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.475925    2563 apiserver.go:52] "Watching apiserver"
Sep 19 15:12:07.481876 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.481850    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 19 15:12:07.483291 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.483255    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-8x2gb","openshift-multus/multus-additional-cni-plugins-s88xt","openshift-network-operator/iptables-alerter-m4fj6","openshift-ovn-kubernetes/ovnkube-node-t8k78","kube-system/global-pull-secret-syncer-c44rt","kube-system/konnectivity-agent-86pbw","kube-system/kube-apiserver-proxy-ip-10-0-136-237.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm","openshift-dns/node-resolver-kpxxp","openshift-image-registry/node-ca-sxpzd","openshift-multus/network-metrics-daemon-ctzjp","openshift-network-diagnostics/network-check-target-rqqg5","openshift-cluster-node-tuning-operator/tuned-l9jfs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-237.ec2.internal"]
Sep 19 15:12:07.485862 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.485835    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sxpzd"
Sep 19 15:12:07.488117 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.488095    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 19 15:12:07.488478 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.488455    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 19 15:12:07.488579 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.488501    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.492028 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.488507    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nl87t\""
Sep 19 15:12:07.492028 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.488454    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 19 15:12:07.492028 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.490653    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m4fj6"
Sep 19 15:12:07.492028 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.491171    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 19 15:12:07.492028 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.491189    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9jc4h\""
Sep 19 15:12:07.492028 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.491278    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 19 15:12:07.492613 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.492590    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 19 15:12:07.493114 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.493072    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 19 15:12:07.493506 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.493484    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 19 15:12:07.493587 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.493531    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lm6wq\""
Sep 19 15:12:07.493729 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.493712    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.496587 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.495654    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 19 15:12:07.496587 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.495692    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 19 15:12:07.496587 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.496018    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 19 15:12:07.496587 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.496111    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 19 15:12:07.496587 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.496197    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 19 15:12:07.496587 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.496336    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:07.496587 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.496438    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 19 15:12:07.496587 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:07.496441    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c44rt" podUID="825442d3-29e0-41cb-82ef-99f7b9cf9529"
Sep 19 15:12:07.497210 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.496738    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vvp9d\""
Sep 19 15:12:07.498701 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.498673    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-86pbw"
Sep 19 15:12:07.500755 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.500698    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 19 15:12:07.501183 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.501162    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-x27p5\""
Sep 19 15:12:07.501183 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.501169    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 19 15:12:07.501427 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.501412    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kpxxp"
Sep 19 15:12:07.502946 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.502907    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 19 15:12:07.503299 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.503275    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 19 15:12:07.503406 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.503374    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-92tjb\""
Sep 19 15:12:07.503671 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.503640    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 19 15:12:07.504093 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.504073    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.506650 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.506624    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 19 15:12:07.506868 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.506853    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 19 15:12:07.507252 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.507227    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vtsv4\""
Sep 19 15:12:07.507695 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.507679    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.507781 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.507769    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 19 15:12:07.510194 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.510159    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 19 15:12:07.510365 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.510344    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nz4tp\""
Sep 19 15:12:07.510468 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.510454    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 19 15:12:07.510538 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.510497    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 19 15:12:07.511006 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.510986    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 19 15:12:07.511006 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.511000    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 19 15:12:07.512661 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.512030    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.512661 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.512299    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 19 15:12:07.513841 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.513820    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 19 15:12:07.514104 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.514087    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4zs8l\""
Sep 19 15:12:07.516283 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.515995    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:07.516283 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:07.516066    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctzjp" podUID="fc07702b-1393-4278-9027-3b4592ee57d4"
Sep 19 15:12:07.517612 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.517349    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-run\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.517612 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.517386    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-host-run-netns\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.517612 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.517396    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:07.517612 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.517416    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2644a7eb-ab01-4ccd-89bb-bc63eb5d6766-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x5hwm\" (UID: \"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.517612 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.517441    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2644a7eb-ab01-4ccd-89bb-bc63eb5d6766-sys-fs\") pod \"aws-ebs-csi-driver-node-x5hwm\" (UID: \"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.517612 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.517467    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-856wl\" (UniqueName: \"kubernetes.io/projected/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-kube-api-access-856wl\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.517612 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.517492    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-var-lib-kubelet\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.517612 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:07.517499    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rqqg5" podUID="d53e44ab-657f-4d2a-b85b-d04a1b632d50"
Sep 19 15:12:07.517612 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.517515    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fad92208-d2d8-4b9d-bb3b-8b7b4bef3220-tmp-dir\") pod \"node-resolver-kpxxp\" (UID: \"fad92208-d2d8-4b9d-bb3b-8b7b4bef3220\") " pod="openshift-dns/node-resolver-kpxxp"
Sep 19 15:12:07.517612 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.517586    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7dfc2b45-4bf9-4ca1-80ca-83e1dc131492-system-cni-dir\") pod \"multus-additional-cni-plugins-s88xt\" (UID: \"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492\") " pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.518187 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.517625    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-host-slash\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.518187 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.517704    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-host-cni-netd\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.518187 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.517729    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pff5\" (UniqueName: \"kubernetes.io/projected/e65a97c2-377b-4d21-9454-1a98ceab6cbd-kube-api-access-6pff5\") pod \"iptables-alerter-m4fj6\" (UID: \"e65a97c2-377b-4d21-9454-1a98ceab6cbd\") " pod="openshift-network-operator/iptables-alerter-m4fj6"
Sep 19 15:12:07.518187 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.517769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-var-lib-openvswitch\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.518187 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.517793    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-host-run-ovn-kubernetes\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.518187 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.517859    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-ovn-node-metrics-cert\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.518187 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.517885    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/421a4ada-19fe-4af6-a892-b5531c5d1928-konnectivity-ca\") pod \"konnectivity-agent-86pbw\" (UID: \"421a4ada-19fe-4af6-a892-b5531c5d1928\") " pod="kube-system/konnectivity-agent-86pbw"
Sep 19 15:12:07.518187 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.517948    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2644a7eb-ab01-4ccd-89bb-bc63eb5d6766-registration-dir\") pod \"aws-ebs-csi-driver-node-x5hwm\" (UID: \"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.518187 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.517999    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-etc-sysctl-d\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.518187 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518033    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-host-kubelet\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.518187 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518059    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-run-ovn\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.518187 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518083    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-etc-sysconfig\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.518187 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518107    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-etc-kubernetes\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.518187 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518131    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7dfc2b45-4bf9-4ca1-80ca-83e1dc131492-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s88xt\" (UID: \"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492\") " pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.518187 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518190    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-ovnkube-script-lib\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.518914 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518217    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7dfc2b45-4bf9-4ca1-80ca-83e1dc131492-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s88xt\" (UID: \"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492\") " pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.518914 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518242    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-etc-openvswitch\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.518914 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518267    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5057e7a5-e158-4b18-acad-f53613c707c0-serviceca\") pod \"node-ca-sxpzd\" (UID: \"5057e7a5-e158-4b18-acad-f53613c707c0\") " pod="openshift-image-registry/node-ca-sxpzd"
Sep 19 15:12:07.518914 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518291    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d885d9bd-cf28-4e9c-a899-af4adf533267-etc-tuned\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.518914 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518317    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e65a97c2-377b-4d21-9454-1a98ceab6cbd-host-slash\") pod \"iptables-alerter-m4fj6\" (UID: \"e65a97c2-377b-4d21-9454-1a98ceab6cbd\") " pod="openshift-network-operator/iptables-alerter-m4fj6"
Sep 19 15:12:07.518914 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518341    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/421a4ada-19fe-4af6-a892-b5531c5d1928-agent-certs\") pod \"konnectivity-agent-86pbw\" (UID: \"421a4ada-19fe-4af6-a892-b5531c5d1928\") " pod="kube-system/konnectivity-agent-86pbw"
Sep 19 15:12:07.518914 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518365    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-956wc\" (UniqueName: \"kubernetes.io/projected/2644a7eb-ab01-4ccd-89bb-bc63eb5d6766-kube-api-access-956wc\") pod \"aws-ebs-csi-driver-node-x5hwm\" (UID: \"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.518914 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518391    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-lib-modules\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.518914 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518422    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-host\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.518914 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518445    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-log-socket\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.518914 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-env-overrides\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.518914 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518492    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret\") pod \"global-pull-secret-syncer-c44rt\" (UID: \"825442d3-29e0-41cb-82ef-99f7b9cf9529\") " pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:07.518914 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518516    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2644a7eb-ab01-4ccd-89bb-bc63eb5d6766-socket-dir\") pod \"aws-ebs-csi-driver-node-x5hwm\" (UID: \"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.518914 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518540    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-ovnkube-config\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.518914 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518564    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/825442d3-29e0-41cb-82ef-99f7b9cf9529-kubelet-config\") pod \"global-pull-secret-syncer-c44rt\" (UID: \"825442d3-29e0-41cb-82ef-99f7b9cf9529\") " pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:07.518914 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518588    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-etc-systemd\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.519762 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518613    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fad92208-d2d8-4b9d-bb3b-8b7b4bef3220-hosts-file\") pod \"node-resolver-kpxxp\" (UID: \"fad92208-d2d8-4b9d-bb3b-8b7b4bef3220\") " pod="openshift-dns/node-resolver-kpxxp"
Sep 19 15:12:07.519762 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518638    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.519762 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518662    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-sys\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.519762 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518684    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d885d9bd-cf28-4e9c-a899-af4adf533267-tmp\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.519762 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518709    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57jhk\" (UniqueName: \"kubernetes.io/projected/d885d9bd-cf28-4e9c-a899-af4adf533267-kube-api-access-57jhk\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.519762 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518731    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlxjd\" (UniqueName: \"kubernetes.io/projected/fad92208-d2d8-4b9d-bb3b-8b7b4bef3220-kube-api-access-xlxjd\") pod \"node-resolver-kpxxp\" (UID: \"fad92208-d2d8-4b9d-bb3b-8b7b4bef3220\") " pod="openshift-dns/node-resolver-kpxxp"
Sep 19 15:12:07.519762 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-etc-sysctl-conf\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.519762 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518770    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7dfc2b45-4bf9-4ca1-80ca-83e1dc131492-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s88xt\" (UID: \"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492\") " pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.519762 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518787    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqr6k\" (UniqueName: \"kubernetes.io/projected/7dfc2b45-4bf9-4ca1-80ca-83e1dc131492-kube-api-access-hqr6k\") pod \"multus-additional-cni-plugins-s88xt\" (UID: \"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492\") " pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.519762 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518807    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e65a97c2-377b-4d21-9454-1a98ceab6cbd-iptables-alerter-script\") pod \"iptables-alerter-m4fj6\" (UID: \"e65a97c2-377b-4d21-9454-1a98ceab6cbd\") " pod="openshift-network-operator/iptables-alerter-m4fj6"
Sep 19 15:12:07.519762 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518828    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7dfc2b45-4bf9-4ca1-80ca-83e1dc131492-cnibin\") pod \"multus-additional-cni-plugins-s88xt\" (UID: \"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492\") " pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.519762 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518843    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-run-systemd\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.519762 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518857    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-node-log\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.519762 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518884    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/825442d3-29e0-41cb-82ef-99f7b9cf9529-dbus\") pod \"global-pull-secret-syncer-c44rt\" (UID: \"825442d3-29e0-41cb-82ef-99f7b9cf9529\") " pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:07.519762 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2644a7eb-ab01-4ccd-89bb-bc63eb5d6766-etc-selinux\") pod \"aws-ebs-csi-driver-node-x5hwm\" (UID: \"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.519762 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.518955    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnv55\" (UniqueName: \"kubernetes.io/projected/5057e7a5-e158-4b18-acad-f53613c707c0-kube-api-access-rnv55\") pod \"node-ca-sxpzd\" (UID: \"5057e7a5-e158-4b18-acad-f53613c707c0\") " pod="openshift-image-registry/node-ca-sxpzd"
Sep 19 15:12:07.520587 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.519086    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-etc-modprobe-d\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.520587 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.519116    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7dfc2b45-4bf9-4ca1-80ca-83e1dc131492-cni-binary-copy\") pod \"multus-additional-cni-plugins-s88xt\" (UID: \"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492\") " pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.520587 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.519142    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-run-openvswitch\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.520587 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.519204    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-host-cni-bin\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.520587 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.519243    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2644a7eb-ab01-4ccd-89bb-bc63eb5d6766-device-dir\") pod \"aws-ebs-csi-driver-node-x5hwm\" (UID: \"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.520587 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.519283    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5057e7a5-e158-4b18-acad-f53613c707c0-host\") pod \"node-ca-sxpzd\" (UID: \"5057e7a5-e158-4b18-acad-f53613c707c0\") " pod="openshift-image-registry/node-ca-sxpzd"
Sep 19 15:12:07.520587 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.519319    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-systemd-units\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.535053 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.535028    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dqskx"
Sep 19 15:12:07.543442 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.543070    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dqskx"
Sep 19 15:12:07.606396 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.606320    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 19 15:12:07.620408 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620352    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9clmf\" (UniqueName: \"kubernetes.io/projected/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-kube-api-access-9clmf\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.620570 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620415    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6669\" (UniqueName: \"kubernetes.io/projected/fc07702b-1393-4278-9027-3b4592ee57d4-kube-api-access-l6669\") pod \"network-metrics-daemon-ctzjp\" (UID: \"fc07702b-1393-4278-9027-3b4592ee57d4\") " pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:07.620570 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620442    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5057e7a5-e158-4b18-acad-f53613c707c0-serviceca\") pod \"node-ca-sxpzd\" (UID: \"5057e7a5-e158-4b18-acad-f53613c707c0\") " pod="openshift-image-registry/node-ca-sxpzd"
Sep 19 15:12:07.620570 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620463    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d885d9bd-cf28-4e9c-a899-af4adf533267-etc-tuned\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.620570 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e65a97c2-377b-4d21-9454-1a98ceab6cbd-host-slash\") pod \"iptables-alerter-m4fj6\" (UID: \"e65a97c2-377b-4d21-9454-1a98ceab6cbd\") " pod="openshift-network-operator/iptables-alerter-m4fj6"
Sep 19 15:12:07.620570 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/421a4ada-19fe-4af6-a892-b5531c5d1928-agent-certs\") pod \"konnectivity-agent-86pbw\" (UID: \"421a4ada-19fe-4af6-a892-b5531c5d1928\") " pod="kube-system/konnectivity-agent-86pbw"
Sep 19 15:12:07.620570 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620530    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-956wc\" (UniqueName: \"kubernetes.io/projected/2644a7eb-ab01-4ccd-89bb-bc63eb5d6766-kube-api-access-956wc\") pod \"aws-ebs-csi-driver-node-x5hwm\" (UID: \"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.620570 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620551    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-host-var-lib-cni-bin\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.620570 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620568    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-lib-modules\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.621029 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620584    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-host\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.621029 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620606    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-log-socket\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.621029 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620622    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-env-overrides\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.621029 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620638    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret\") pod \"global-pull-secret-syncer-c44rt\" (UID: \"825442d3-29e0-41cb-82ef-99f7b9cf9529\") " pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:07.621029 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2644a7eb-ab01-4ccd-89bb-bc63eb5d6766-socket-dir\") pod \"aws-ebs-csi-driver-node-x5hwm\" (UID: \"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.621029 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620685    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-ovnkube-config\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.621029 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620707    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/825442d3-29e0-41cb-82ef-99f7b9cf9529-kubelet-config\") pod \"global-pull-secret-syncer-c44rt\" (UID: \"825442d3-29e0-41cb-82ef-99f7b9cf9529\") " pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:07.621029 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620724    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-etc-systemd\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.621029 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620740    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fad92208-d2d8-4b9d-bb3b-8b7b4bef3220-hosts-file\") pod \"node-resolver-kpxxp\" (UID: \"fad92208-d2d8-4b9d-bb3b-8b7b4bef3220\") " pod="openshift-dns/node-resolver-kpxxp"
Sep 19 15:12:07.621029 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620769    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.621029 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620789    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-sys\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.621029 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620806    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d885d9bd-cf28-4e9c-a899-af4adf533267-tmp\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.621029 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57jhk\" (UniqueName: \"kubernetes.io/projected/d885d9bd-cf28-4e9c-a899-af4adf533267-kube-api-access-57jhk\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.621029 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620876    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlxjd\" (UniqueName: \"kubernetes.io/projected/fad92208-d2d8-4b9d-bb3b-8b7b4bef3220-kube-api-access-xlxjd\") pod \"node-resolver-kpxxp\" (UID: \"fad92208-d2d8-4b9d-bb3b-8b7b4bef3220\") " pod="openshift-dns/node-resolver-kpxxp"
Sep 19 15:12:07.621029 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620893    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-hostroot\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.621029 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620908    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-etc-kubernetes\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.621029 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620930    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs\") pod \"network-metrics-daemon-ctzjp\" (UID: \"fc07702b-1393-4278-9027-3b4592ee57d4\") " pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:07.621896 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.620973    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-etc-sysctl-conf\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.621896 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621000    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7dfc2b45-4bf9-4ca1-80ca-83e1dc131492-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s88xt\" (UID: \"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492\") " pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.621896 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621018    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqr6k\" (UniqueName: \"kubernetes.io/projected/7dfc2b45-4bf9-4ca1-80ca-83e1dc131492-kube-api-access-hqr6k\") pod \"multus-additional-cni-plugins-s88xt\" (UID: \"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492\") " pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.621896 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621041    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkmbr\" (UniqueName: \"kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr\") pod \"network-check-target-rqqg5\" (UID: \"d53e44ab-657f-4d2a-b85b-d04a1b632d50\") " pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:07.621896 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621061    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-multus-socket-dir-parent\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.621896 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621077    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e65a97c2-377b-4d21-9454-1a98ceab6cbd-iptables-alerter-script\") pod \"iptables-alerter-m4fj6\" (UID: \"e65a97c2-377b-4d21-9454-1a98ceab6cbd\") " pod="openshift-network-operator/iptables-alerter-m4fj6"
Sep 19 15:12:07.621896 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621093    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7dfc2b45-4bf9-4ca1-80ca-83e1dc131492-cnibin\") pod \"multus-additional-cni-plugins-s88xt\" (UID: \"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492\") " pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.621896 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621109    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-run-systemd\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.621896 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621132    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-node-log\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.621896 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621157    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/825442d3-29e0-41cb-82ef-99f7b9cf9529-dbus\") pod \"global-pull-secret-syncer-c44rt\" (UID: \"825442d3-29e0-41cb-82ef-99f7b9cf9529\") " pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:07.621896 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621180    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2644a7eb-ab01-4ccd-89bb-bc63eb5d6766-etc-selinux\") pod \"aws-ebs-csi-driver-node-x5hwm\" (UID: \"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.621896 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621199    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-multus-daemon-config\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.621896 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621234    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnv55\" (UniqueName: \"kubernetes.io/projected/5057e7a5-e158-4b18-acad-f53613c707c0-kube-api-access-rnv55\") pod \"node-ca-sxpzd\" (UID: \"5057e7a5-e158-4b18-acad-f53613c707c0\") " pod="openshift-image-registry/node-ca-sxpzd"
Sep 19 15:12:07.621896 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621252    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-etc-modprobe-d\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.621896 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621267    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7dfc2b45-4bf9-4ca1-80ca-83e1dc131492-cni-binary-copy\") pod \"multus-additional-cni-plugins-s88xt\" (UID: \"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492\") " pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.621896 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-run-openvswitch\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.621896 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621314    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-host-cni-bin\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.622802 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621340    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2644a7eb-ab01-4ccd-89bb-bc63eb5d6766-device-dir\") pod \"aws-ebs-csi-driver-node-x5hwm\" (UID: \"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.622802 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621364    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5057e7a5-e158-4b18-acad-f53613c707c0-host\") pod \"node-ca-sxpzd\" (UID: \"5057e7a5-e158-4b18-acad-f53613c707c0\") " pod="openshift-image-registry/node-ca-sxpzd"
Sep 19 15:12:07.622802 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621388    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-systemd-units\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.622802 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621413    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-cni-binary-copy\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.622802 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621437    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-host-run-k8s-cni-cncf-io\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.622802 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621463    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-cnibin\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.622802 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621487    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-host-run-netns\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.622802 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621509    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-multus-conf-dir\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.622802 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621531    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-run\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.622802 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621564    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-host-run-netns\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.622802 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621588    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2644a7eb-ab01-4ccd-89bb-bc63eb5d6766-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x5hwm\" (UID: \"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.622802 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2644a7eb-ab01-4ccd-89bb-bc63eb5d6766-sys-fs\") pod \"aws-ebs-csi-driver-node-x5hwm\" (UID: \"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.622802 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621623    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-host-var-lib-kubelet\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.622802 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-856wl\" (UniqueName: \"kubernetes.io/projected/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-kube-api-access-856wl\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.622802 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621673    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-var-lib-kubelet\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.622802 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621690    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fad92208-d2d8-4b9d-bb3b-8b7b4bef3220-tmp-dir\") pod \"node-resolver-kpxxp\" (UID: \"fad92208-d2d8-4b9d-bb3b-8b7b4bef3220\") " pod="openshift-dns/node-resolver-kpxxp"
Sep 19 15:12:07.622802 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621709    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7dfc2b45-4bf9-4ca1-80ca-83e1dc131492-system-cni-dir\") pod \"multus-additional-cni-plugins-s88xt\" (UID: \"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492\") " pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.623465 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621726    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-host-slash\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.623465 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621744    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-host-cni-netd\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.623465 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621760    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-host-var-lib-cni-multus\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.623465 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621777    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-host-run-multus-certs\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.623465 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621798    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pff5\" (UniqueName: \"kubernetes.io/projected/e65a97c2-377b-4d21-9454-1a98ceab6cbd-kube-api-access-6pff5\") pod \"iptables-alerter-m4fj6\" (UID: \"e65a97c2-377b-4d21-9454-1a98ceab6cbd\") " pod="openshift-network-operator/iptables-alerter-m4fj6"
Sep 19 15:12:07.623465 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621827    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-var-lib-openvswitch\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.623465 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621847    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-host-run-ovn-kubernetes\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.623465 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621864    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-ovn-node-metrics-cert\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.623465 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621884    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/421a4ada-19fe-4af6-a892-b5531c5d1928-konnectivity-ca\") pod \"konnectivity-agent-86pbw\" (UID: \"421a4ada-19fe-4af6-a892-b5531c5d1928\") " pod="kube-system/konnectivity-agent-86pbw"
Sep 19 15:12:07.623465 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621901    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2644a7eb-ab01-4ccd-89bb-bc63eb5d6766-registration-dir\") pod \"aws-ebs-csi-driver-node-x5hwm\" (UID: \"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.623465 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621917    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-system-cni-dir\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.623465 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621940    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-etc-sysctl-d\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.623465 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.621984    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-host-kubelet\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.623465 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.622013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-run-ovn\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.623465 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.622031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-multus-cni-dir\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.623465 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.622047    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-etc-sysconfig\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.623465 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.622065    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-etc-kubernetes\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.624109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.622083    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7dfc2b45-4bf9-4ca1-80ca-83e1dc131492-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s88xt\" (UID: \"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492\") " pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.624109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.622113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-ovnkube-script-lib\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.624109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.622140    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7dfc2b45-4bf9-4ca1-80ca-83e1dc131492-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s88xt\" (UID: \"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492\") " pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.624109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.622169    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-etc-openvswitch\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.624109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.622259    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-etc-openvswitch\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.624109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.622756    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5057e7a5-e158-4b18-acad-f53613c707c0-serviceca\") pod \"node-ca-sxpzd\" (UID: \"5057e7a5-e158-4b18-acad-f53613c707c0\") " pod="openshift-image-registry/node-ca-sxpzd"
Sep 19 15:12:07.624109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.622978    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-run-openvswitch\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.624109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.623129    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-host-cni-bin\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.624109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.623147    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-etc-sysctl-conf\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.624109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.623230    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2644a7eb-ab01-4ccd-89bb-bc63eb5d6766-device-dir\") pod \"aws-ebs-csi-driver-node-x5hwm\" (UID: \"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.624109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.623230    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e65a97c2-377b-4d21-9454-1a98ceab6cbd-host-slash\") pod \"iptables-alerter-m4fj6\" (UID: \"e65a97c2-377b-4d21-9454-1a98ceab6cbd\") " pod="openshift-network-operator/iptables-alerter-m4fj6"
Sep 19 15:12:07.624109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.623284    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5057e7a5-e158-4b18-acad-f53613c707c0-host\") pod \"node-ca-sxpzd\" (UID: \"5057e7a5-e158-4b18-acad-f53613c707c0\") " pod="openshift-image-registry/node-ca-sxpzd"
Sep 19 15:12:07.624109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.623329    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-systemd-units\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.624109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.623450    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 19 15:12:07.624109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.623500    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-run\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.624109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.623546    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-host-run-netns\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.624109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.623598    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2644a7eb-ab01-4ccd-89bb-bc63eb5d6766-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x5hwm\" (UID: \"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.624109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.623645    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7dfc2b45-4bf9-4ca1-80ca-83e1dc131492-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s88xt\" (UID: \"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492\") " pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.624835 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.623652    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2644a7eb-ab01-4ccd-89bb-bc63eb5d6766-sys-fs\") pod \"aws-ebs-csi-driver-node-x5hwm\" (UID: \"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.624835 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.623755    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-lib-modules\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.624835 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.623805    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-host\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.624835 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.623830    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-log-socket\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.624835 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.623993    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-var-lib-openvswitch\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.624835 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.624007    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-node-log\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.624835 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.624019    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fad92208-d2d8-4b9d-bb3b-8b7b4bef3220-hosts-file\") pod \"node-resolver-kpxxp\" (UID: \"fad92208-d2d8-4b9d-bb3b-8b7b4bef3220\") " pod="openshift-dns/node-resolver-kpxxp"
Sep 19 15:12:07.624835 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.624048    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-run-systemd\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.624835 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.624055    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7dfc2b45-4bf9-4ca1-80ca-83e1dc131492-cnibin\") pod \"multus-additional-cni-plugins-s88xt\" (UID: \"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492\") " pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.624835 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.624078    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-etc-modprobe-d\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.624835 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.624088    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-etc-kubernetes\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.624835 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.624107    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-var-lib-kubelet\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.624835 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.624125    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-host-slash\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.624835 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.624131    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-etc-systemd\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.624835 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.624143    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2644a7eb-ab01-4ccd-89bb-bc63eb5d6766-socket-dir\") pod \"aws-ebs-csi-driver-node-x5hwm\" (UID: \"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.624835 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.624169    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.624835 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.624212    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-sys\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.624835 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.624237    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7dfc2b45-4bf9-4ca1-80ca-83e1dc131492-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s88xt\" (UID: \"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492\") " pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.625907 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.624261    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/825442d3-29e0-41cb-82ef-99f7b9cf9529-dbus\") pod \"global-pull-secret-syncer-c44rt\" (UID: \"825442d3-29e0-41cb-82ef-99f7b9cf9529\") " pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:07.625907 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.624343    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-host-run-ovn-kubernetes\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.625907 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.624429    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/421a4ada-19fe-4af6-a892-b5531c5d1928-konnectivity-ca\") pod \"konnectivity-agent-86pbw\" (UID: \"421a4ada-19fe-4af6-a892-b5531c5d1928\") " pod="kube-system/konnectivity-agent-86pbw"
Sep 19 15:12:07.625907 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.624655    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2644a7eb-ab01-4ccd-89bb-bc63eb5d6766-etc-selinux\") pod \"aws-ebs-csi-driver-node-x5hwm\" (UID: \"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.625907 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.625323    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-etc-sysconfig\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.625907 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.625326    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-env-overrides\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.625907 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.625384    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-run-ovn\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.625907 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.625385    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-host-cni-netd\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.625907 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.625406    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-ovnkube-config\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.625907 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.625423    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-host-kubelet\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.625907 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.625454    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/825442d3-29e0-41cb-82ef-99f7b9cf9529-kubelet-config\") pod \"global-pull-secret-syncer-c44rt\" (UID: \"825442d3-29e0-41cb-82ef-99f7b9cf9529\") " pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:07.625907 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:07.625576    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:07.625907 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:07.625657    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret podName:825442d3-29e0-41cb-82ef-99f7b9cf9529 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:08.125636863 +0000 UTC m=+3.014836581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret") pod "global-pull-secret-syncer-c44rt" (UID: "825442d3-29e0-41cb-82ef-99f7b9cf9529") : object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:07.625907 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.625659    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2644a7eb-ab01-4ccd-89bb-bc63eb5d6766-registration-dir\") pod \"aws-ebs-csi-driver-node-x5hwm\" (UID: \"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.625907 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.625758    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d885d9bd-cf28-4e9c-a899-af4adf533267-etc-sysctl-d\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.625907 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.625863    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7dfc2b45-4bf9-4ca1-80ca-83e1dc131492-system-cni-dir\") pod \"multus-additional-cni-plugins-s88xt\" (UID: \"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492\") " pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.626730 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.626108    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e65a97c2-377b-4d21-9454-1a98ceab6cbd-iptables-alerter-script\") pod \"iptables-alerter-m4fj6\" (UID: \"e65a97c2-377b-4d21-9454-1a98ceab6cbd\") " pod="openshift-network-operator/iptables-alerter-m4fj6"
Sep 19 15:12:07.626730 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.626151    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7dfc2b45-4bf9-4ca1-80ca-83e1dc131492-cni-binary-copy\") pod \"multus-additional-cni-plugins-s88xt\" (UID: \"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492\") " pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.626730 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.626192    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fad92208-d2d8-4b9d-bb3b-8b7b4bef3220-tmp-dir\") pod \"node-resolver-kpxxp\" (UID: \"fad92208-d2d8-4b9d-bb3b-8b7b4bef3220\") " pod="openshift-dns/node-resolver-kpxxp"
Sep 19 15:12:07.626730 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.626349    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-ovnkube-script-lib\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.626730 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.626359    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7dfc2b45-4bf9-4ca1-80ca-83e1dc131492-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s88xt\" (UID: \"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492\") " pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.628751 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.628718    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d885d9bd-cf28-4e9c-a899-af4adf533267-etc-tuned\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.629279 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.629251    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-ovn-node-metrics-cert\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.630800 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.630749    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/421a4ada-19fe-4af6-a892-b5531c5d1928-agent-certs\") pod \"konnectivity-agent-86pbw\" (UID: \"421a4ada-19fe-4af6-a892-b5531c5d1928\") " pod="kube-system/konnectivity-agent-86pbw"
Sep 19 15:12:07.636497 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.636465    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d885d9bd-cf28-4e9c-a899-af4adf533267-tmp\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.639687 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.639655    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqr6k\" (UniqueName: \"kubernetes.io/projected/7dfc2b45-4bf9-4ca1-80ca-83e1dc131492-kube-api-access-hqr6k\") pod \"multus-additional-cni-plugins-s88xt\" (UID: \"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492\") " pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.639813 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.639774    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57jhk\" (UniqueName: \"kubernetes.io/projected/d885d9bd-cf28-4e9c-a899-af4adf533267-kube-api-access-57jhk\") pod \"tuned-l9jfs\" (UID: \"d885d9bd-cf28-4e9c-a899-af4adf533267\") " pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.640446 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.640420    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-956wc\" (UniqueName: \"kubernetes.io/projected/2644a7eb-ab01-4ccd-89bb-bc63eb5d6766-kube-api-access-956wc\") pod \"aws-ebs-csi-driver-node-x5hwm\" (UID: \"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.641055 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.641023    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlxjd\" (UniqueName: \"kubernetes.io/projected/fad92208-d2d8-4b9d-bb3b-8b7b4bef3220-kube-api-access-xlxjd\") pod \"node-resolver-kpxxp\" (UID: \"fad92208-d2d8-4b9d-bb3b-8b7b4bef3220\") " pod="openshift-dns/node-resolver-kpxxp"
Sep 19 15:12:07.641477 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.641456    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pff5\" (UniqueName: \"kubernetes.io/projected/e65a97c2-377b-4d21-9454-1a98ceab6cbd-kube-api-access-6pff5\") pod \"iptables-alerter-m4fj6\" (UID: \"e65a97c2-377b-4d21-9454-1a98ceab6cbd\") " pod="openshift-network-operator/iptables-alerter-m4fj6"
Sep 19 15:12:07.642104 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.642082    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-856wl\" (UniqueName: \"kubernetes.io/projected/7bfa1a78-818c-4473-938c-b1e9e95d8b5c-kube-api-access-856wl\") pod \"ovnkube-node-t8k78\" (UID: \"7bfa1a78-818c-4473-938c-b1e9e95d8b5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.642203 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.642136    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnv55\" (UniqueName: \"kubernetes.io/projected/5057e7a5-e158-4b18-acad-f53613c707c0-kube-api-access-rnv55\") pod \"node-ca-sxpzd\" (UID: \"5057e7a5-e158-4b18-acad-f53613c707c0\") " pod="openshift-image-registry/node-ca-sxpzd"
Sep 19 15:12:07.645007 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.644874    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-237.ec2.internal" event={"ID":"4704ab0c7c799113b04cd82d197e4ed2","Type":"ContainerStarted","Data":"9158e657749806e7ce878609d43f913ca5e3e354a122090e241743f7573feee1"}
Sep 19 15:12:07.646340 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.646315    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-237.ec2.internal" event={"ID":"fac8ce90b3987ed9cce92ba26e925a49","Type":"ContainerStarted","Data":"0ef852dd3a9b336bb65675ac408efc4d14c0b5f62153c4fc99cfc79f9e6a3a87"}
Sep 19 15:12:07.722815 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.722775    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9clmf\" (UniqueName: \"kubernetes.io/projected/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-kube-api-access-9clmf\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.723028 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.722825    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6669\" (UniqueName: \"kubernetes.io/projected/fc07702b-1393-4278-9027-3b4592ee57d4-kube-api-access-l6669\") pod \"network-metrics-daemon-ctzjp\" (UID: \"fc07702b-1393-4278-9027-3b4592ee57d4\") " pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:07.723028 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.722964    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-host-var-lib-cni-bin\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.723125 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723052    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-hostroot\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.723125 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723082    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-etc-kubernetes\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.723125 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723108    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs\") pod \"network-metrics-daemon-ctzjp\" (UID: \"fc07702b-1393-4278-9027-3b4592ee57d4\") " pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:07.723220 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723139    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkmbr\" (UniqueName: \"kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr\") pod \"network-check-target-rqqg5\" (UID: \"d53e44ab-657f-4d2a-b85b-d04a1b632d50\") " pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:07.723220 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723160    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-hostroot\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.723220 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723215    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-etc-kubernetes\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.723326 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723224    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-multus-socket-dir-parent\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.723326 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723270    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-host-var-lib-cni-bin\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.723326 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723164    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-multus-socket-dir-parent\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.723326 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723321    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-multus-daemon-config\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.723515 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:07.723322    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:07.723515 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-cni-binary-copy\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.723515 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723403    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-host-run-k8s-cni-cncf-io\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.723515 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:07.723436    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs podName:fc07702b-1393-4278-9027-3b4592ee57d4 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:08.223414802 +0000 UTC m=+3.112614498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs") pod "network-metrics-daemon-ctzjp" (UID: "fc07702b-1393-4278-9027-3b4592ee57d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:07.723515 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723447    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-host-run-k8s-cni-cncf-io\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.723515 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-cnibin\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.723515 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723511    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-cnibin\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.723882 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723684    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-host-run-netns\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.723882 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723713    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-multus-conf-dir\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.723882 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723747    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-host-var-lib-kubelet\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.723882 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723779    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-host-var-lib-cni-multus\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.723882 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-host-run-multus-certs\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.723882 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723828    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-multus-daemon-config\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.723882 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723839    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-system-cni-dir\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.723882 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723879    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-multus-cni-dir\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.724317 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723893    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-system-cni-dir\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.724317 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723979    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-cni-binary-copy\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.724317 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.723959    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-host-run-multus-certs\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.724317 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.724020    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-host-run-netns\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.724317 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.724066    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-multus-cni-dir\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.724317 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.724095    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-multus-conf-dir\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.724317 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.724155    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-host-var-lib-kubelet\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.724317 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.724197    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-host-var-lib-cni-multus\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.729165 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:07.729141    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 15:12:07.729165 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:07.729170    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 15:12:07.729356 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:07.729187    2563 projected.go:196] Error preparing data for projected volume kube-api-access-lkmbr for pod openshift-network-diagnostics/network-check-target-rqqg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:07.729356 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:07.729260    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr podName:d53e44ab-657f-4d2a-b85b-d04a1b632d50 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:08.229240634 +0000 UTC m=+3.118440331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lkmbr" (UniqueName: "kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr") pod "network-check-target-rqqg5" (UID: "d53e44ab-657f-4d2a-b85b-d04a1b632d50") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:07.732170 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.732120    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9clmf\" (UniqueName: \"kubernetes.io/projected/5096ad14-e350-4fbc-bf9b-e35c1e0d4014-kube-api-access-9clmf\") pod \"multus-8x2gb\" (UID: \"5096ad14-e350-4fbc-bf9b-e35c1e0d4014\") " pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:07.732556 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.732529    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6669\" (UniqueName: \"kubernetes.io/projected/fc07702b-1393-4278-9027-3b4592ee57d4-kube-api-access-l6669\") pod \"network-metrics-daemon-ctzjp\" (UID: \"fc07702b-1393-4278-9027-3b4592ee57d4\") " pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:07.801548 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.801455    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sxpzd"
Sep 19 15:12:07.813629 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.813500    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l9jfs"
Sep 19 15:12:07.821991 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.821958    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m4fj6"
Sep 19 15:12:07.828409 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.828233    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:07.838246 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.838212    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-86pbw"
Sep 19 15:12:07.846184 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.846161    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kpxxp"
Sep 19 15:12:07.854393 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.854370    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm"
Sep 19 15:12:07.863447 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.863261    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s88xt"
Sep 19 15:12:07.870160 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:07.870141    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8x2gb"
Sep 19 15:12:08.127173 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:08.127077    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret\") pod \"global-pull-secret-syncer-c44rt\" (UID: \"825442d3-29e0-41cb-82ef-99f7b9cf9529\") " pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:08.127332 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:08.127236    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:08.127332 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:08.127319    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret podName:825442d3-29e0-41cb-82ef-99f7b9cf9529 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:09.127299737 +0000 UTC m=+4.016499430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret") pod "global-pull-secret-syncer-c44rt" (UID: "825442d3-29e0-41cb-82ef-99f7b9cf9529") : object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:08.228281 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:08.228240    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs\") pod \"network-metrics-daemon-ctzjp\" (UID: \"fc07702b-1393-4278-9027-3b4592ee57d4\") " pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:08.228466 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:08.228445    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:08.228544 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:08.228536    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs podName:fc07702b-1393-4278-9027-3b4592ee57d4 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:09.228514022 +0000 UTC m=+4.117713718 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs") pod "network-metrics-daemon-ctzjp" (UID: "fc07702b-1393-4278-9027-3b4592ee57d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:08.328660 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:08.328621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkmbr\" (UniqueName: \"kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr\") pod \"network-check-target-rqqg5\" (UID: \"d53e44ab-657f-4d2a-b85b-d04a1b632d50\") " pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:08.328879 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:08.328827    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 15:12:08.328879 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:08.328857    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 15:12:08.328879 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:08.328873    2563 projected.go:196] Error preparing data for projected volume kube-api-access-lkmbr for pod openshift-network-diagnostics/network-check-target-rqqg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:08.329052 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:08.328955    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr podName:d53e44ab-657f-4d2a-b85b-d04a1b632d50 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:09.328934345 +0000 UTC m=+4.218134059 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lkmbr" (UniqueName: "kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr") pod "network-check-target-rqqg5" (UID: "d53e44ab-657f-4d2a-b85b-d04a1b632d50") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:08.547229 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:08.547185    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 15:07:08 +0000 UTC" deadline="2028-06-22 08:26:24.124238792 +0000 UTC"
Sep 19 15:12:08.547229 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:08.547217    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15401h14m15.577024946s"
Sep 19 15:12:08.777765 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:08.777728    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod421a4ada_19fe_4af6_a892_b5531c5d1928.slice/crio-137a7c7a345b7077d132568b9b4a1f239d5258b7c9e774057b64aadae18ef133 WatchSource:0}: Error finding container 137a7c7a345b7077d132568b9b4a1f239d5258b7c9e774057b64aadae18ef133: Status 404 returned error can't find the container with id 137a7c7a345b7077d132568b9b4a1f239d5258b7c9e774057b64aadae18ef133
Sep 19 15:12:08.782595 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:08.782568    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5057e7a5_e158_4b18_acad_f53613c707c0.slice/crio-3886f92cf1a377d52d8ca90969f582f8977c54fb9386babde0dbe12dd4eef7b3 WatchSource:0}: Error finding container 3886f92cf1a377d52d8ca90969f582f8977c54fb9386babde0dbe12dd4eef7b3: Status 404 returned error can't find the container with id 3886f92cf1a377d52d8ca90969f582f8977c54fb9386babde0dbe12dd4eef7b3
Sep 19 15:12:08.789874 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:08.789851    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode65a97c2_377b_4d21_9454_1a98ceab6cbd.slice/crio-8070f0b7804e244b404dab3d9ba0ef432b18574ec10d48357d0139416817e051 WatchSource:0}: Error finding container 8070f0b7804e244b404dab3d9ba0ef432b18574ec10d48357d0139416817e051: Status 404 returned error can't find the container with id 8070f0b7804e244b404dab3d9ba0ef432b18574ec10d48357d0139416817e051
Sep 19 15:12:09.137956 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:09.137898    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret\") pod \"global-pull-secret-syncer-c44rt\" (UID: \"825442d3-29e0-41cb-82ef-99f7b9cf9529\") " pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:09.138111 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:09.138089    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:09.138167 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:09.138162    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret podName:825442d3-29e0-41cb-82ef-99f7b9cf9529 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:11.138147092 +0000 UTC m=+6.027346785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret") pod "global-pull-secret-syncer-c44rt" (UID: "825442d3-29e0-41cb-82ef-99f7b9cf9529") : object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:09.238610 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:09.238573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs\") pod \"network-metrics-daemon-ctzjp\" (UID: \"fc07702b-1393-4278-9027-3b4592ee57d4\") " pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:09.238786 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:09.238764    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:09.238868 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:09.238855    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs podName:fc07702b-1393-4278-9027-3b4592ee57d4 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:11.238834022 +0000 UTC m=+6.128033736 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs") pod "network-metrics-daemon-ctzjp" (UID: "fc07702b-1393-4278-9027-3b4592ee57d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:09.340790 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:09.340036    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkmbr\" (UniqueName: \"kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr\") pod \"network-check-target-rqqg5\" (UID: \"d53e44ab-657f-4d2a-b85b-d04a1b632d50\") " pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:09.340790 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:09.340212    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 15:12:09.340790 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:09.340245    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 15:12:09.340790 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:09.340261    2563 projected.go:196] Error preparing data for projected volume kube-api-access-lkmbr for pod openshift-network-diagnostics/network-check-target-rqqg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:09.340790 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:09.340335    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr podName:d53e44ab-657f-4d2a-b85b-d04a1b632d50 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:11.340316606 +0000 UTC m=+6.229516304 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lkmbr" (UniqueName: "kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr") pod "network-check-target-rqqg5" (UID: "d53e44ab-657f-4d2a-b85b-d04a1b632d50") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:09.549369 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:09.549320    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 15:07:08 +0000 UTC" deadline="2028-04-21 02:20:53.284541807 +0000 UTC"
Sep 19 15:12:09.549369 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:09.549368    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13907h8m43.735179033s"
Sep 19 15:12:09.642126 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:09.640870    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:09.642126 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:09.641038    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rqqg5" podUID="d53e44ab-657f-4d2a-b85b-d04a1b632d50"
Sep 19 15:12:09.642126 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:09.641141    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:09.642126 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:09.641222    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c44rt" podUID="825442d3-29e0-41cb-82ef-99f7b9cf9529"
Sep 19 15:12:09.642126 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:09.641283    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:09.642126 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:09.641366    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctzjp" podUID="fc07702b-1393-4278-9027-3b4592ee57d4"
Sep 19 15:12:09.662714 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:09.662672    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l9jfs" event={"ID":"d885d9bd-cf28-4e9c-a899-af4adf533267","Type":"ContainerStarted","Data":"f99b7d01fc6d088a117564225bd022fa9d2873089e515a1f6c00af6d61b74d8f"}
Sep 19 15:12:09.665067 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:09.664975    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8x2gb" event={"ID":"5096ad14-e350-4fbc-bf9b-e35c1e0d4014","Type":"ContainerStarted","Data":"8965469a62c048c2c542a2d7ffb2796b756bc6fa1e0f9a39d37f6075a08dcf50"}
Sep 19 15:12:09.671120 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:09.671010    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m4fj6" event={"ID":"e65a97c2-377b-4d21-9454-1a98ceab6cbd","Type":"ContainerStarted","Data":"8070f0b7804e244b404dab3d9ba0ef432b18574ec10d48357d0139416817e051"}
Sep 19 15:12:09.674519 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:09.674441    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kpxxp" event={"ID":"fad92208-d2d8-4b9d-bb3b-8b7b4bef3220","Type":"ContainerStarted","Data":"efb3b9bd8d270513a26d3dd48894b7cb4054e9d5651b7f185c5ae781867f8282"}
Sep 19 15:12:09.681521 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:09.681473    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s88xt" event={"ID":"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492","Type":"ContainerStarted","Data":"06abab93bcf36f899aab01a55c89f3aceff0928fecf7447cc80671969678164c"}
Sep 19 15:12:09.686340 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:09.686315    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-86pbw" event={"ID":"421a4ada-19fe-4af6-a892-b5531c5d1928","Type":"ContainerStarted","Data":"137a7c7a345b7077d132568b9b4a1f239d5258b7c9e774057b64aadae18ef133"}
Sep 19 15:12:09.693311 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:09.693085    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-237.ec2.internal" event={"ID":"4704ab0c7c799113b04cd82d197e4ed2","Type":"ContainerStarted","Data":"9515ccb1744ca40902660aae58e163c5e5bd70802f64958311952a641d34e33d"}
Sep 19 15:12:09.697638 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:09.697611    2563 generic.go:356] "Generic (PLEG): container finished" podID="fac8ce90b3987ed9cce92ba26e925a49" containerID="137e36a0fdfd711187fbd87effb30aeeec04ed454ad665019fd7122df1b8785d" exitCode=0
Sep 19 15:12:09.697778 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:09.697702    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-237.ec2.internal" event={"ID":"fac8ce90b3987ed9cce92ba26e925a49","Type":"ContainerDied","Data":"137e36a0fdfd711187fbd87effb30aeeec04ed454ad665019fd7122df1b8785d"}
Sep 19 15:12:09.706256 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:09.705865    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t8k78" event={"ID":"7bfa1a78-818c-4473-938c-b1e9e95d8b5c","Type":"ContainerStarted","Data":"99630f72fc0a88a1db9088341f05d5fa6db328d94e1552b64d8978b3bea4fa6b"}
Sep 19 15:12:09.706357 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:09.706243    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-237.ec2.internal" podStartSLOduration=2.70620374 podStartE2EDuration="2.70620374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:12:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:09.706097988 +0000 UTC m=+4.595297705" watchObservedRunningTime="2026-09-19 15:12:09.70620374 +0000 UTC m=+4.595403457"
Sep 19 15:12:09.719427 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:09.719393    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm" event={"ID":"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766","Type":"ContainerStarted","Data":"cbb0374dbfb8539e43a91d0b02d82a21f1392f89da692ee20072377c2b2503c4"}
Sep 19 15:12:09.748000 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:09.747908    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sxpzd" event={"ID":"5057e7a5-e158-4b18-acad-f53613c707c0","Type":"ContainerStarted","Data":"3886f92cf1a377d52d8ca90969f582f8977c54fb9386babde0dbe12dd4eef7b3"}
Sep 19 15:12:10.769287 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:10.769015    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-237.ec2.internal" event={"ID":"fac8ce90b3987ed9cce92ba26e925a49","Type":"ContainerStarted","Data":"9ca61fb962d5145c5b59f2c339bfda7251fa2f8753ff850e537d6c278e8c86a5"}
Sep 19 15:12:10.784854 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:10.784763    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-237.ec2.internal" podStartSLOduration=3.784741033 podStartE2EDuration="3.784741033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:12:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:10.784196289 +0000 UTC m=+5.673396007" watchObservedRunningTime="2026-09-19 15:12:10.784741033 +0000 UTC m=+5.673940753"
Sep 19 15:12:11.155422 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:11.155299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret\") pod \"global-pull-secret-syncer-c44rt\" (UID: \"825442d3-29e0-41cb-82ef-99f7b9cf9529\") " pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:11.155600 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:11.155531    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:11.155600 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:11.155598    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret podName:825442d3-29e0-41cb-82ef-99f7b9cf9529 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:15.155579877 +0000 UTC m=+10.044779589 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret") pod "global-pull-secret-syncer-c44rt" (UID: "825442d3-29e0-41cb-82ef-99f7b9cf9529") : object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:11.256634 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:11.256593    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs\") pod \"network-metrics-daemon-ctzjp\" (UID: \"fc07702b-1393-4278-9027-3b4592ee57d4\") " pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:11.256826 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:11.256790    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:11.256890 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:11.256853    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs podName:fc07702b-1393-4278-9027-3b4592ee57d4 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:15.256833408 +0000 UTC m=+10.146033107 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs") pod "network-metrics-daemon-ctzjp" (UID: "fc07702b-1393-4278-9027-3b4592ee57d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:11.358095 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:11.358046    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkmbr\" (UniqueName: \"kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr\") pod \"network-check-target-rqqg5\" (UID: \"d53e44ab-657f-4d2a-b85b-d04a1b632d50\") " pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:11.358303 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:11.358239    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 15:12:11.358303 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:11.358270    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 15:12:11.358303 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:11.358284    2563 projected.go:196] Error preparing data for projected volume kube-api-access-lkmbr for pod openshift-network-diagnostics/network-check-target-rqqg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:11.358490 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:11.358345    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr podName:d53e44ab-657f-4d2a-b85b-d04a1b632d50 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:15.358326836 +0000 UTC m=+10.247526533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lkmbr" (UniqueName: "kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr") pod "network-check-target-rqqg5" (UID: "d53e44ab-657f-4d2a-b85b-d04a1b632d50") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:11.636172 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:11.636132    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:11.636362 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:11.636296    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctzjp" podUID="fc07702b-1393-4278-9027-3b4592ee57d4"
Sep 19 15:12:11.636671 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:11.636144    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:11.636792 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:11.636769    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rqqg5" podUID="d53e44ab-657f-4d2a-b85b-d04a1b632d50"
Sep 19 15:12:11.636873 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:11.636854    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:11.636963 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:11.636944    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c44rt" podUID="825442d3-29e0-41cb-82ef-99f7b9cf9529"
Sep 19 15:12:13.635767 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:13.635099    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:13.635767 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:13.635203    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c44rt" podUID="825442d3-29e0-41cb-82ef-99f7b9cf9529"
Sep 19 15:12:13.635767 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:13.635546    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:13.635767 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:13.635626    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctzjp" podUID="fc07702b-1393-4278-9027-3b4592ee57d4"
Sep 19 15:12:13.635767 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:13.635675    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:13.635767 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:13.635733    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rqqg5" podUID="d53e44ab-657f-4d2a-b85b-d04a1b632d50"
Sep 19 15:12:15.190990 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:15.190345    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret\") pod \"global-pull-secret-syncer-c44rt\" (UID: \"825442d3-29e0-41cb-82ef-99f7b9cf9529\") " pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:15.190990 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:15.190537    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:15.190990 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:15.190604    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret podName:825442d3-29e0-41cb-82ef-99f7b9cf9529 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:23.19058308 +0000 UTC m=+18.079782791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret") pod "global-pull-secret-syncer-c44rt" (UID: "825442d3-29e0-41cb-82ef-99f7b9cf9529") : object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:15.291330 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:15.291291    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs\") pod \"network-metrics-daemon-ctzjp\" (UID: \"fc07702b-1393-4278-9027-3b4592ee57d4\") " pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:15.291542 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:15.291449    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:15.291542 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:15.291518    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs podName:fc07702b-1393-4278-9027-3b4592ee57d4 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:23.29149649 +0000 UTC m=+18.180696208 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs") pod "network-metrics-daemon-ctzjp" (UID: "fc07702b-1393-4278-9027-3b4592ee57d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:15.392429 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:15.392358    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkmbr\" (UniqueName: \"kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr\") pod \"network-check-target-rqqg5\" (UID: \"d53e44ab-657f-4d2a-b85b-d04a1b632d50\") " pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:15.392624 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:15.392545    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 15:12:15.392624 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:15.392567    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 15:12:15.392624 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:15.392581    2563 projected.go:196] Error preparing data for projected volume kube-api-access-lkmbr for pod openshift-network-diagnostics/network-check-target-rqqg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:15.392814 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:15.392640    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr podName:d53e44ab-657f-4d2a-b85b-d04a1b632d50 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:23.39262031 +0000 UTC m=+18.281820018 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lkmbr" (UniqueName: "kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr") pod "network-check-target-rqqg5" (UID: "d53e44ab-657f-4d2a-b85b-d04a1b632d50") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:15.635617 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:15.635535    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:15.635758 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:15.635640    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c44rt" podUID="825442d3-29e0-41cb-82ef-99f7b9cf9529"
Sep 19 15:12:15.636048 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:15.635861    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:15.636048 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:15.635990    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctzjp" podUID="fc07702b-1393-4278-9027-3b4592ee57d4"
Sep 19 15:12:15.636048 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:15.636006    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:15.636273 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:15.636083    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rqqg5" podUID="d53e44ab-657f-4d2a-b85b-d04a1b632d50"
Sep 19 15:12:17.635175 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:17.634578    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:17.635175 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:17.634693    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c44rt" podUID="825442d3-29e0-41cb-82ef-99f7b9cf9529"
Sep 19 15:12:17.635175 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:17.634930    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:17.635175 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:17.635036    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctzjp" podUID="fc07702b-1393-4278-9027-3b4592ee57d4"
Sep 19 15:12:17.635175 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:17.635070    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:17.635175 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:17.635143    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rqqg5" podUID="d53e44ab-657f-4d2a-b85b-d04a1b632d50"
Sep 19 15:12:19.634673 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:19.634634    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:19.634673 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:19.634667    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:19.635212 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:19.634638    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:19.635212 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:19.634784    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c44rt" podUID="825442d3-29e0-41cb-82ef-99f7b9cf9529"
Sep 19 15:12:19.635212 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:19.634857    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctzjp" podUID="fc07702b-1393-4278-9027-3b4592ee57d4"
Sep 19 15:12:19.635212 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:19.634960    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rqqg5" podUID="d53e44ab-657f-4d2a-b85b-d04a1b632d50"
Sep 19 15:12:21.634537 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:21.634498    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:21.635146 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:21.634496    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:21.635146 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:21.634618    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c44rt" podUID="825442d3-29e0-41cb-82ef-99f7b9cf9529"
Sep 19 15:12:21.635146 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:21.634686    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rqqg5" podUID="d53e44ab-657f-4d2a-b85b-d04a1b632d50"
Sep 19 15:12:21.635146 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:21.634504    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:21.635146 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:21.634852    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctzjp" podUID="fc07702b-1393-4278-9027-3b4592ee57d4"
Sep 19 15:12:23.248642 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:23.248600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret\") pod \"global-pull-secret-syncer-c44rt\" (UID: \"825442d3-29e0-41cb-82ef-99f7b9cf9529\") " pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:23.249219 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:23.248758    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:23.249219 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:23.248829    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret podName:825442d3-29e0-41cb-82ef-99f7b9cf9529 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:39.248810191 +0000 UTC m=+34.138009906 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret") pod "global-pull-secret-syncer-c44rt" (UID: "825442d3-29e0-41cb-82ef-99f7b9cf9529") : object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:23.349410 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:23.349378    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs\") pod \"network-metrics-daemon-ctzjp\" (UID: \"fc07702b-1393-4278-9027-3b4592ee57d4\") " pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:23.349589 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:23.349548    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:23.349647 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:23.349631    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs podName:fc07702b-1393-4278-9027-3b4592ee57d4 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:39.34960962 +0000 UTC m=+34.238809328 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs") pod "network-metrics-daemon-ctzjp" (UID: "fc07702b-1393-4278-9027-3b4592ee57d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:23.449949 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:23.449910    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkmbr\" (UniqueName: \"kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr\") pod \"network-check-target-rqqg5\" (UID: \"d53e44ab-657f-4d2a-b85b-d04a1b632d50\") " pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:23.450158 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:23.450023    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 15:12:23.450158 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:23.450047    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 15:12:23.450158 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:23.450060    2563 projected.go:196] Error preparing data for projected volume kube-api-access-lkmbr for pod openshift-network-diagnostics/network-check-target-rqqg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:23.450158 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:23.450115    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr podName:d53e44ab-657f-4d2a-b85b-d04a1b632d50 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:39.450097271 +0000 UTC m=+34.339296962 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lkmbr" (UniqueName: "kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr") pod "network-check-target-rqqg5" (UID: "d53e44ab-657f-4d2a-b85b-d04a1b632d50") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:23.634980 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:23.634910    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:23.635152 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:23.634910    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:23.635152 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:23.635018    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c44rt" podUID="825442d3-29e0-41cb-82ef-99f7b9cf9529"
Sep 19 15:12:23.635152 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:23.635113    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctzjp" podUID="fc07702b-1393-4278-9027-3b4592ee57d4"
Sep 19 15:12:23.635152 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:23.634910    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:23.635315 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:23.635201    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rqqg5" podUID="d53e44ab-657f-4d2a-b85b-d04a1b632d50"
Sep 19 15:12:25.635251 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:25.635219    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:25.635738 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:25.635339    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctzjp" podUID="fc07702b-1393-4278-9027-3b4592ee57d4"
Sep 19 15:12:25.635738 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:25.635433    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:25.635738 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:25.635522    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rqqg5" podUID="d53e44ab-657f-4d2a-b85b-d04a1b632d50"
Sep 19 15:12:25.635738 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:25.635576    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:25.635738 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:25.635654    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c44rt" podUID="825442d3-29e0-41cb-82ef-99f7b9cf9529"
Sep 19 15:12:27.637369 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:27.637338    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:27.637726 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:27.637473    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c44rt" podUID="825442d3-29e0-41cb-82ef-99f7b9cf9529"
Sep 19 15:12:27.637885 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:27.637863    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:27.638015 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:27.637993    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctzjp" podUID="fc07702b-1393-4278-9027-3b4592ee57d4"
Sep 19 15:12:27.638074 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:27.638062    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:27.638146 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:27.638127    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rqqg5" podUID="d53e44ab-657f-4d2a-b85b-d04a1b632d50"
Sep 19 15:12:27.811346 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:27.811105    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l9jfs" event={"ID":"d885d9bd-cf28-4e9c-a899-af4adf533267","Type":"ContainerStarted","Data":"697ee4adddb5437b3420dd0423d457f62e09d0b4729885941e1735ed61c6be1a"}
Sep 19 15:12:27.812874 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:27.812844    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8x2gb" event={"ID":"5096ad14-e350-4fbc-bf9b-e35c1e0d4014","Type":"ContainerStarted","Data":"ca3fd09850a609dc6be989f7b3d44d42f63ca7cca7aad48f74ae31bf70fa0955"}
Sep 19 15:12:27.815263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:27.815211    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kpxxp" event={"ID":"fad92208-d2d8-4b9d-bb3b-8b7b4bef3220","Type":"ContainerStarted","Data":"114bf40bc4b384c47fd1bf2cf90cd0c4c9ed42cb9b353f0fc849fabda8bf1a03"}
Sep 19 15:12:27.817087 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:27.817055    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s88xt" event={"ID":"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492","Type":"ContainerStarted","Data":"b2c6de84036757aebc98ff8768f221772edf9e6a939f2cc5ae8210e723833f42"}
Sep 19 15:12:27.818826 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:27.818804    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-86pbw" event={"ID":"421a4ada-19fe-4af6-a892-b5531c5d1928","Type":"ContainerStarted","Data":"f6233ee94891cecce81ca3a929c890d38142d6dbff091405597491a1e541f6a7"}
Sep 19 15:12:27.823140 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:27.823105    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t8k78" event={"ID":"7bfa1a78-818c-4473-938c-b1e9e95d8b5c","Type":"ContainerStarted","Data":"aaaea98da3a35e79dd01490ec0bdd23f533c5cb99c49f9f7cbd7b3a5cc4ea7ab"}
Sep 19 15:12:27.823227 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:27.823192    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t8k78" event={"ID":"7bfa1a78-818c-4473-938c-b1e9e95d8b5c","Type":"ContainerStarted","Data":"53be5c2f8676896b9ff7f4a05894b0e03bebc6b662e09e087fc6a7e6316199b6"}
Sep 19 15:12:27.825112 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:27.825089    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm" event={"ID":"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766","Type":"ContainerStarted","Data":"4d07a1db9f7fe1b8c78990cc31da42dc6de3c4e666f82447429d1057b12b8e39"}
Sep 19 15:12:27.827349 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:27.827289    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sxpzd" event={"ID":"5057e7a5-e158-4b18-acad-f53613c707c0","Type":"ContainerStarted","Data":"e8be7e170056f63101e4971d0969de190691dc32d705d8b421838a9eafcf12df"}
Sep 19 15:12:27.830019 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:27.829973    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-l9jfs" podStartSLOduration=3.068798984 podStartE2EDuration="21.829885176s" totalImagesPullingTime="18.761086192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:27.829444785 +0000 UTC m=+22.718644498" watchObservedRunningTime="2026-09-19 15:12:27.829885176 +0000 UTC m=+22.719084894"
Sep 19 15:12:27.861294 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:27.861237    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-86pbw" podStartSLOduration=3.138416088 podStartE2EDuration="21.861219502s" totalImagesPullingTime="18.722803414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:27.841463163 +0000 UTC m=+22.730662876" watchObservedRunningTime="2026-09-19 15:12:27.861219502 +0000 UTC m=+22.750419216"
Sep 19 15:12:27.861454 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:27.861433    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kpxxp" podStartSLOduration=3.147099145 podStartE2EDuration="21.861427068s" totalImagesPullingTime="18.714327923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:27.861210094 +0000 UTC m=+22.750409808" watchObservedRunningTime="2026-09-19 15:12:27.861427068 +0000 UTC m=+22.750626780"
Sep 19 15:12:27.897775 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:27.897726    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8x2gb" podStartSLOduration=3.105529786 podStartE2EDuration="21.89770839s" totalImagesPullingTime="18.792178604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:27.897617035 +0000 UTC m=+22.786816749" watchObservedRunningTime="2026-09-19 15:12:27.89770839 +0000 UTC m=+22.786908105"
Sep 19 15:12:27.913124 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:27.913082    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sxpzd" podStartSLOduration=3.159815061 podStartE2EDuration="21.913064556s" totalImagesPullingTime="18.753249495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:27.912605118 +0000 UTC m=+22.801804832" watchObservedRunningTime="2026-09-19 15:12:27.913064556 +0000 UTC m=+22.802264333"
Sep 19 15:12:28.830712 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:28.830627    2563 generic.go:356] "Generic (PLEG): container finished" podID="7dfc2b45-4bf9-4ca1-80ca-83e1dc131492" containerID="b2c6de84036757aebc98ff8768f221772edf9e6a939f2cc5ae8210e723833f42" exitCode=0
Sep 19 15:12:28.831595 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:28.830712    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s88xt" event={"ID":"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492","Type":"ContainerDied","Data":"b2c6de84036757aebc98ff8768f221772edf9e6a939f2cc5ae8210e723833f42"}
Sep 19 15:12:28.833787 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:28.833761    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t8k78" event={"ID":"7bfa1a78-818c-4473-938c-b1e9e95d8b5c","Type":"ContainerStarted","Data":"fbe4e8fb2696758cc1293055c021aed72ed3eecee8a3d90c76c9d0f2fc4167cf"}
Sep 19 15:12:28.833917 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:28.833824    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t8k78" event={"ID":"7bfa1a78-818c-4473-938c-b1e9e95d8b5c","Type":"ContainerStarted","Data":"2765d66acd9965b20fef3327c29d0e9fc8143d2ab948f9f87f378c986d0c6cc0"}
Sep 19 15:12:28.833917 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:28.833855    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t8k78" event={"ID":"7bfa1a78-818c-4473-938c-b1e9e95d8b5c","Type":"ContainerStarted","Data":"a8d0246b1248666a5118b656d0d393a67526b68835e086399bde7d7eeb27126f"}
Sep 19 15:12:28.833917 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:28.833885    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t8k78" event={"ID":"7bfa1a78-818c-4473-938c-b1e9e95d8b5c","Type":"ContainerStarted","Data":"861f37d5970e7ea4c7123eae22aaf5a38d510a5d421a35f36c6f8cd5e87b4b2f"}
Sep 19 15:12:29.053995 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:29.053822    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 19 15:12:29.592737 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:29.592629    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-19T15:12:29.053990029Z","UUID":"77f3ba54-ddc0-468f-b61c-5c838850f091","Handler":null,"Name":"","Endpoint":""}
Sep 19 15:12:29.594235 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:29.594205    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 19 15:12:29.594235 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:29.594241    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 19 15:12:29.635626 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:29.634996    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:29.635626 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:29.635122    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctzjp" podUID="fc07702b-1393-4278-9027-3b4592ee57d4"
Sep 19 15:12:29.635626 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:29.635471    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:29.635626 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:29.635558    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rqqg5" podUID="d53e44ab-657f-4d2a-b85b-d04a1b632d50"
Sep 19 15:12:29.636925 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:29.636478    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:29.636925 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:29.636606    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c44rt" podUID="825442d3-29e0-41cb-82ef-99f7b9cf9529"
Sep 19 15:12:29.839080 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:29.839043    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm" event={"ID":"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766","Type":"ContainerStarted","Data":"ca0bb4ca31603fff7eab221a1fcb18bc796e44ca381893d1593bf2e230f7c18a"}
Sep 19 15:12:29.840786 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:29.840754    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m4fj6" event={"ID":"e65a97c2-377b-4d21-9454-1a98ceab6cbd","Type":"ContainerStarted","Data":"54bd517748c9c72d3a1e073f14cb410a9ab124b0a21917d84db44c4f1cd39b86"}
Sep 19 15:12:29.853423 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:29.853326    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m4fj6" podStartSLOduration=5.108517287 podStartE2EDuration="23.853308778s" totalImagesPullingTime="18.744791491s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:29.85305879 +0000 UTC m=+24.742258514" watchObservedRunningTime="2026-09-19 15:12:29.853308778 +0000 UTC m=+24.742508493"
Sep 19 15:12:30.287259 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:30.287215    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-86pbw"
Sep 19 15:12:30.287960 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:30.287938    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-86pbw"
Sep 19 15:12:30.846769 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:30.846734    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t8k78" event={"ID":"7bfa1a78-818c-4473-938c-b1e9e95d8b5c","Type":"ContainerStarted","Data":"8509a562c7cd685b7c67cefc708d824c556ce5a01343be05519d6ecaaae1c31e"}
Sep 19 15:12:30.849220 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:30.849189    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm" event={"ID":"2644a7eb-ab01-4ccd-89bb-bc63eb5d6766","Type":"ContainerStarted","Data":"238c3841bccf14000b1bae01b973401d889ba94b50de82b606bdf34b2b00c1c7"}
Sep 19 15:12:31.635316 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:31.635279    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:31.635534 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:31.635283    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:31.635534 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:31.635418    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:31.635534 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:31.635416    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c44rt" podUID="825442d3-29e0-41cb-82ef-99f7b9cf9529"
Sep 19 15:12:31.635534 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:31.635488    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctzjp" podUID="fc07702b-1393-4278-9027-3b4592ee57d4"
Sep 19 15:12:31.635769 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:31.635564    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rqqg5" podUID="d53e44ab-657f-4d2a-b85b-d04a1b632d50"
Sep 19 15:12:33.635158 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:33.634988    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:33.635578 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:33.634989    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:33.635578 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:33.635278    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctzjp" podUID="fc07702b-1393-4278-9027-3b4592ee57d4"
Sep 19 15:12:33.635578 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:33.635030    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:33.635578 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:33.635352    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c44rt" podUID="825442d3-29e0-41cb-82ef-99f7b9cf9529"
Sep 19 15:12:33.635578 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:33.635504    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rqqg5" podUID="d53e44ab-657f-4d2a-b85b-d04a1b632d50"
Sep 19 15:12:33.861135 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:33.861104    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t8k78" event={"ID":"7bfa1a78-818c-4473-938c-b1e9e95d8b5c","Type":"ContainerStarted","Data":"e30eb681bf340539cd2f6180728af3b75dfb65764f80317c389bcf75d251c70f"}
Sep 19 15:12:33.861400 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:33.861379    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:33.862934 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:33.862908    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s88xt" event={"ID":"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492","Type":"ContainerStarted","Data":"87b961404bac14274002a9ab65307c62527c4ce6f1373d2718b1226ec73c5cf9"}
Sep 19 15:12:33.876830 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:33.876800    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:33.884620 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:33.884560    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5hwm" podStartSLOduration=6.891472855 podStartE2EDuration="27.884541111s" totalImagesPullingTime="20.993068256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:12:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:30.864456401 +0000 UTC m=+25.753656105" watchObservedRunningTime="2026-09-19 15:12:33.884541111 +0000 UTC m=+28.773740825"
Sep 19 15:12:33.885333 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:33.885302    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t8k78" podStartSLOduration=9.08299971 podStartE2EDuration="27.885292555s" totalImagesPullingTime="18.802292845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:33.883422459 +0000 UTC m=+28.772622172" watchObservedRunningTime="2026-09-19 15:12:33.885292555 +0000 UTC m=+28.774492267"
Sep 19 15:12:34.035199 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:34.035169    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-86pbw"
Sep 19 15:12:34.035358 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:34.035296    2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 19 15:12:34.035840 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:34.035822    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-86pbw"
Sep 19 15:12:34.867249 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:34.867213    2563 generic.go:356] "Generic (PLEG): container finished" podID="7dfc2b45-4bf9-4ca1-80ca-83e1dc131492" containerID="87b961404bac14274002a9ab65307c62527c4ce6f1373d2718b1226ec73c5cf9" exitCode=0
Sep 19 15:12:34.867920 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:34.867299    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s88xt" event={"ID":"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492","Type":"ContainerDied","Data":"87b961404bac14274002a9ab65307c62527c4ce6f1373d2718b1226ec73c5cf9"}
Sep 19 15:12:34.868312 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:34.868102    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:34.868312 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:34.868165    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:34.883700 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:34.883677    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:12:35.629020 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:35.628990    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c44rt"]
Sep 19 15:12:35.629192 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:35.629124    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:35.629254 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:35.629231    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c44rt" podUID="825442d3-29e0-41cb-82ef-99f7b9cf9529"
Sep 19 15:12:35.631670 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:35.631646    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ctzjp"]
Sep 19 15:12:35.631775 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:35.631756    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:35.631870 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:35.631847    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctzjp" podUID="fc07702b-1393-4278-9027-3b4592ee57d4"
Sep 19 15:12:35.632348 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:35.632329    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rqqg5"]
Sep 19 15:12:35.632416 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:35.632406    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:35.632490 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:35.632469    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rqqg5" podUID="d53e44ab-657f-4d2a-b85b-d04a1b632d50"
Sep 19 15:12:36.874713 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:36.874489    2563 generic.go:356] "Generic (PLEG): container finished" podID="7dfc2b45-4bf9-4ca1-80ca-83e1dc131492" containerID="8d23b1a3d5329189f167d366c8b418e362cf44b0b8a8ec6e6aeec5daddd0f96d" exitCode=0
Sep 19 15:12:36.874713 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:36.874558    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s88xt" event={"ID":"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492","Type":"ContainerDied","Data":"8d23b1a3d5329189f167d366c8b418e362cf44b0b8a8ec6e6aeec5daddd0f96d"}
Sep 19 15:12:37.635101 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:37.635064    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:37.635263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:37.635064    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:37.635263 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:37.635182    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctzjp" podUID="fc07702b-1393-4278-9027-3b4592ee57d4"
Sep 19 15:12:37.635263 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:37.635243    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rqqg5" podUID="d53e44ab-657f-4d2a-b85b-d04a1b632d50"
Sep 19 15:12:37.635382 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:37.635064    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:37.635421 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:37.635398    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c44rt" podUID="825442d3-29e0-41cb-82ef-99f7b9cf9529"
Sep 19 15:12:38.881693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:38.881661    2563 generic.go:356] "Generic (PLEG): container finished" podID="7dfc2b45-4bf9-4ca1-80ca-83e1dc131492" containerID="2d66eef9f2c3d708d821044fb03d6e7c3922c6956277c38cc08c7eb43a167f74" exitCode=0
Sep 19 15:12:38.882122 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:38.881700    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s88xt" event={"ID":"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492","Type":"ContainerDied","Data":"2d66eef9f2c3d708d821044fb03d6e7c3922c6956277c38cc08c7eb43a167f74"}
Sep 19 15:12:39.261000 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:39.260967    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret\") pod \"global-pull-secret-syncer-c44rt\" (UID: \"825442d3-29e0-41cb-82ef-99f7b9cf9529\") " pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:39.261154 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:39.261112    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:39.261237 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:39.261174    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret podName:825442d3-29e0-41cb-82ef-99f7b9cf9529 nodeName:}" failed. No retries permitted until 2026-09-19 15:13:11.261157924 +0000 UTC m=+66.150357638 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret") pod "global-pull-secret-syncer-c44rt" (UID: "825442d3-29e0-41cb-82ef-99f7b9cf9529") : object "kube-system"/"original-pull-secret" not registered
Sep 19 15:12:39.361824 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:39.361791    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs\") pod \"network-metrics-daemon-ctzjp\" (UID: \"fc07702b-1393-4278-9027-3b4592ee57d4\") " pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:39.361993 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:39.361959    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:39.362043 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:39.362023    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs podName:fc07702b-1393-4278-9027-3b4592ee57d4 nodeName:}" failed. No retries permitted until 2026-09-19 15:13:11.362008272 +0000 UTC m=+66.251207964 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs") pod "network-metrics-daemon-ctzjp" (UID: "fc07702b-1393-4278-9027-3b4592ee57d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 15:12:39.462534 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:39.462496    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkmbr\" (UniqueName: \"kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr\") pod \"network-check-target-rqqg5\" (UID: \"d53e44ab-657f-4d2a-b85b-d04a1b632d50\") " pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:39.462715 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:39.462655    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 15:12:39.462715 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:39.462675    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 15:12:39.462715 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:39.462687    2563 projected.go:196] Error preparing data for projected volume kube-api-access-lkmbr for pod openshift-network-diagnostics/network-check-target-rqqg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:39.462875 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:39.462752    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr podName:d53e44ab-657f-4d2a-b85b-d04a1b632d50 nodeName:}" failed. No retries permitted until 2026-09-19 15:13:11.462733689 +0000 UTC m=+66.351933398 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lkmbr" (UniqueName: "kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr") pod "network-check-target-rqqg5" (UID: "d53e44ab-657f-4d2a-b85b-d04a1b632d50") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 15:12:39.635380 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:39.635292    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:39.635554 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:39.635292    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:39.635554 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:39.635437    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:39.635554 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:39.635435    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c44rt" podUID="825442d3-29e0-41cb-82ef-99f7b9cf9529"
Sep 19 15:12:39.635732 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:39.635548    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctzjp" podUID="fc07702b-1393-4278-9027-3b4592ee57d4"
Sep 19 15:12:39.635732 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:39.635675    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rqqg5" podUID="d53e44ab-657f-4d2a-b85b-d04a1b632d50"
Sep 19 15:12:41.397724 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.397648    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-237.ec2.internal" event="NodeReady"
Sep 19 15:12:41.398117 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.397810    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 19 15:12:41.436644 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.435779    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7dfc5587d8-dbhkz"]
Sep 19 15:12:41.439637 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.439594    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw"]
Sep 19 15:12:41.439798 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.439729    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.441752 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.441728    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 19 15:12:41.441910 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.441808    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 19 15:12:41.443092 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.442482    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xbxpb\""
Sep 19 15:12:41.443092 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.442572    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 19 15:12:41.443249 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.443114    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw"
Sep 19 15:12:41.446098 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.445916    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zjpxs\""
Sep 19 15:12:41.446279 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.446263    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 19 15:12:41.446363 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.446335    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 19 15:12:41.449931 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.449910    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 19 15:12:41.450559 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.450538    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw"]
Sep 19 15:12:41.457312 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.457281    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dfc5587d8-dbhkz"]
Sep 19 15:12:41.457424 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.457351    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-przrv"]
Sep 19 15:12:41.461193 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.461170    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-42lfw"]
Sep 19 15:12:41.461297 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.461277    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-przrv"
Sep 19 15:12:41.463282 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.463264    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 19 15:12:41.463380 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.463303    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p4wjr\""
Sep 19 15:12:41.463380 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.463309    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 19 15:12:41.464576 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.464562    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-42lfw"
Sep 19 15:12:41.466343 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.466319    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v2755\""
Sep 19 15:12:41.466434 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.466397    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 19 15:12:41.466573 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.466561    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 19 15:12:41.466634 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.466601    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 19 15:12:41.469206 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.469186    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-42lfw"]
Sep 19 15:12:41.470065 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.470044    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-przrv"]
Sep 19 15:12:41.578381 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.578349    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hpln\" (UniqueName: \"kubernetes.io/projected/a29dd07f-cdb8-4df8-9b5c-a3993af1bebf-kube-api-access-8hpln\") pod \"ingress-canary-42lfw\" (UID: \"a29dd07f-cdb8-4df8-9b5c-a3993af1bebf\") " pod="openshift-ingress-canary/ingress-canary-42lfw"
Sep 19 15:12:41.578547 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.578389    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.578547 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.578414    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fea819f6-340a-495e-9a03-f9c11485c8e7-tmp-dir\") pod \"dns-default-przrv\" (UID: \"fea819f6-340a-495e-9a03-f9c11485c8e7\") " pod="openshift-dns/dns-default-przrv"
Sep 19 15:12:41.578547 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.578447    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a57ee30d-5eee-4cf5-aa2b-85197a177068-image-registry-private-configuration\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.578547 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.578473    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-certificates\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.578547 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.578489    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgqpq\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-kube-api-access-jgqpq\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.578547 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.578520    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a29dd07f-cdb8-4df8-9b5c-a3993af1bebf-cert\") pod \"ingress-canary-42lfw\" (UID: \"a29dd07f-cdb8-4df8-9b5c-a3993af1bebf\") " pod="openshift-ingress-canary/ingress-canary-42lfw"
Sep 19 15:12:41.578809 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.578551    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-9kjxw\" (UID: \"e5fee3ed-19c1-4c0c-9006-4524c20d9ed8\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw"
Sep 19 15:12:41.578809 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.578566    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls\") pod \"dns-default-przrv\" (UID: \"fea819f6-340a-495e-9a03-f9c11485c8e7\") " pod="openshift-dns/dns-default-przrv"
Sep 19 15:12:41.578809 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.578584    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-9kjxw\" (UID: \"e5fee3ed-19c1-4c0c-9006-4524c20d9ed8\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw"
Sep 19 15:12:41.578809 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.578609    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-bound-sa-token\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.578809 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.578634    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hszzh\" (UniqueName: \"kubernetes.io/projected/fea819f6-340a-495e-9a03-f9c11485c8e7-kube-api-access-hszzh\") pod \"dns-default-przrv\" (UID: \"fea819f6-340a-495e-9a03-f9c11485c8e7\") " pod="openshift-dns/dns-default-przrv"
Sep 19 15:12:41.578809 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.578674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a57ee30d-5eee-4cf5-aa2b-85197a177068-installation-pull-secrets\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.578809 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.578694    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a57ee30d-5eee-4cf5-aa2b-85197a177068-ca-trust-extracted\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.578809 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.578715    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a57ee30d-5eee-4cf5-aa2b-85197a177068-trusted-ca\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.578809 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.578771    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fea819f6-340a-495e-9a03-f9c11485c8e7-config-volume\") pod \"dns-default-przrv\" (UID: \"fea819f6-340a-495e-9a03-f9c11485c8e7\") " pod="openshift-dns/dns-default-przrv"
Sep 19 15:12:41.634420 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.634390    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:12:41.634605 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.634386    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:12:41.634605 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.634528    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:12:41.636742 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.636699    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 19 15:12:41.636865 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.636824    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 19 15:12:41.636865 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.636838    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zprn6\""
Sep 19 15:12:41.636865 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.636846    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 19 15:12:41.636865 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.636848    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 19 15:12:41.637071 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.636959    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fxxj8\""
Sep 19 15:12:41.679596 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.679569    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a57ee30d-5eee-4cf5-aa2b-85197a177068-installation-pull-secrets\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.679764 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.679609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a57ee30d-5eee-4cf5-aa2b-85197a177068-ca-trust-extracted\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.679764 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.679639    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a57ee30d-5eee-4cf5-aa2b-85197a177068-trusted-ca\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.679764 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.679690    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fea819f6-340a-495e-9a03-f9c11485c8e7-config-volume\") pod \"dns-default-przrv\" (UID: \"fea819f6-340a-495e-9a03-f9c11485c8e7\") " pod="openshift-dns/dns-default-przrv"
Sep 19 15:12:41.679764 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.679723    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hpln\" (UniqueName: \"kubernetes.io/projected/a29dd07f-cdb8-4df8-9b5c-a3993af1bebf-kube-api-access-8hpln\") pod \"ingress-canary-42lfw\" (UID: \"a29dd07f-cdb8-4df8-9b5c-a3993af1bebf\") " pod="openshift-ingress-canary/ingress-canary-42lfw"
Sep 19 15:12:41.679764 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.679747    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.680045 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.679771    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fea819f6-340a-495e-9a03-f9c11485c8e7-tmp-dir\") pod \"dns-default-przrv\" (UID: \"fea819f6-340a-495e-9a03-f9c11485c8e7\") " pod="openshift-dns/dns-default-przrv"
Sep 19 15:12:41.680045 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.679797    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a57ee30d-5eee-4cf5-aa2b-85197a177068-image-registry-private-configuration\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.680045 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.679834    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-certificates\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.680045 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.679859    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgqpq\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-kube-api-access-jgqpq\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.680045 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.679918    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a29dd07f-cdb8-4df8-9b5c-a3993af1bebf-cert\") pod \"ingress-canary-42lfw\" (UID: \"a29dd07f-cdb8-4df8-9b5c-a3993af1bebf\") " pod="openshift-ingress-canary/ingress-canary-42lfw"
Sep 19 15:12:41.680045 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.679957    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-9kjxw\" (UID: \"e5fee3ed-19c1-4c0c-9006-4524c20d9ed8\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw"
Sep 19 15:12:41.680045 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.679983    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls\") pod \"dns-default-przrv\" (UID: \"fea819f6-340a-495e-9a03-f9c11485c8e7\") " pod="openshift-dns/dns-default-przrv"
Sep 19 15:12:41.680045 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.680008    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-9kjxw\" (UID: \"e5fee3ed-19c1-4c0c-9006-4524c20d9ed8\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw"
Sep 19 15:12:41.680045 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.680010    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a57ee30d-5eee-4cf5-aa2b-85197a177068-ca-trust-extracted\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.680045 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.680032    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-bound-sa-token\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.680465 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.680056    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hszzh\" (UniqueName: \"kubernetes.io/projected/fea819f6-340a-495e-9a03-f9c11485c8e7-kube-api-access-hszzh\") pod \"dns-default-przrv\" (UID: \"fea819f6-340a-495e-9a03-f9c11485c8e7\") " pod="openshift-dns/dns-default-przrv"
Sep 19 15:12:41.680465 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.680360    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fea819f6-340a-495e-9a03-f9c11485c8e7-config-volume\") pod \"dns-default-przrv\" (UID: \"fea819f6-340a-495e-9a03-f9c11485c8e7\") " pod="openshift-dns/dns-default-przrv"
Sep 19 15:12:41.680465 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:41.680448    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 15:12:41.680465 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:41.680465    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfc5587d8-dbhkz: secret "image-registry-tls" not found
Sep 19 15:12:41.680640 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.680518    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-certificates\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.682734 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:41.681132    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls podName:a57ee30d-5eee-4cf5-aa2b-85197a177068 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:42.180530874 +0000 UTC m=+37.069730587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls") pod "image-registry-7dfc5587d8-dbhkz" (UID: "a57ee30d-5eee-4cf5-aa2b-85197a177068") : secret "image-registry-tls" not found
Sep 19 15:12:41.682734 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:41.682006    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 15:12:41.682734 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:41.682075    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls podName:fea819f6-340a-495e-9a03-f9c11485c8e7 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:42.182050168 +0000 UTC m=+37.071249862 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls") pod "dns-default-przrv" (UID: "fea819f6-340a-495e-9a03-f9c11485c8e7") : secret "dns-default-metrics-tls" not found
Sep 19 15:12:41.682734 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.682102    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fea819f6-340a-495e-9a03-f9c11485c8e7-tmp-dir\") pod \"dns-default-przrv\" (UID: \"fea819f6-340a-495e-9a03-f9c11485c8e7\") " pod="openshift-dns/dns-default-przrv"
Sep 19 15:12:41.682734 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.682499    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-9kjxw\" (UID: \"e5fee3ed-19c1-4c0c-9006-4524c20d9ed8\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw"
Sep 19 15:12:41.682734 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.682643    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a57ee30d-5eee-4cf5-aa2b-85197a177068-trusted-ca\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.683137 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:41.682993    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 19 15:12:41.683137 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:41.683057    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert podName:e5fee3ed-19c1-4c0c-9006-4524c20d9ed8 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:42.183031841 +0000 UTC m=+37.072231551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-9kjxw" (UID: "e5fee3ed-19c1-4c0c-9006-4524c20d9ed8") : secret "networking-console-plugin-cert" not found
Sep 19 15:12:41.686926 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.685231    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a57ee30d-5eee-4cf5-aa2b-85197a177068-image-registry-private-configuration\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.687550 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.687297    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a57ee30d-5eee-4cf5-aa2b-85197a177068-installation-pull-secrets\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.690132 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.689837    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a29dd07f-cdb8-4df8-9b5c-a3993af1bebf-cert\") pod \"ingress-canary-42lfw\" (UID: \"a29dd07f-cdb8-4df8-9b5c-a3993af1bebf\") " pod="openshift-ingress-canary/ingress-canary-42lfw"
Sep 19 15:12:41.690249 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.690157    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hszzh\" (UniqueName: \"kubernetes.io/projected/fea819f6-340a-495e-9a03-f9c11485c8e7-kube-api-access-hszzh\") pod \"dns-default-przrv\" (UID: \"fea819f6-340a-495e-9a03-f9c11485c8e7\") " pod="openshift-dns/dns-default-przrv"
Sep 19 15:12:41.691223 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.691202    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-bound-sa-token\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.691611 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.691594    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgqpq\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-kube-api-access-jgqpq\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:41.692276 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.692253    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hpln\" (UniqueName: \"kubernetes.io/projected/a29dd07f-cdb8-4df8-9b5c-a3993af1bebf-kube-api-access-8hpln\") pod \"ingress-canary-42lfw\" (UID: \"a29dd07f-cdb8-4df8-9b5c-a3993af1bebf\") " pod="openshift-ingress-canary/ingress-canary-42lfw"
Sep 19 15:12:41.779083 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:41.779048    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-42lfw"
Sep 19 15:12:42.184717 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:42.184682    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:42.184915 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:42.184748    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-9kjxw\" (UID: \"e5fee3ed-19c1-4c0c-9006-4524c20d9ed8\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw"
Sep 19 15:12:42.184915 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:42.184773    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls\") pod \"dns-default-przrv\" (UID: \"fea819f6-340a-495e-9a03-f9c11485c8e7\") " pod="openshift-dns/dns-default-przrv"
Sep 19 15:12:42.184915 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:42.184854    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 15:12:42.184915 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:42.184860    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 15:12:42.184915 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:42.184886    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfc5587d8-dbhkz: secret "image-registry-tls" not found
Sep 19 15:12:42.185145 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:42.184857    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 19 15:12:42.185145 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:42.184940    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls podName:fea819f6-340a-495e-9a03-f9c11485c8e7 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:43.184919077 +0000 UTC m=+38.074118770 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls") pod "dns-default-przrv" (UID: "fea819f6-340a-495e-9a03-f9c11485c8e7") : secret "dns-default-metrics-tls" not found
Sep 19 15:12:42.185145 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:42.184968    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls podName:a57ee30d-5eee-4cf5-aa2b-85197a177068 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:43.184951531 +0000 UTC m=+38.074151253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls") pod "image-registry-7dfc5587d8-dbhkz" (UID: "a57ee30d-5eee-4cf5-aa2b-85197a177068") : secret "image-registry-tls" not found
Sep 19 15:12:42.185145 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:42.184983    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert podName:e5fee3ed-19c1-4c0c-9006-4524c20d9ed8 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:43.184976746 +0000 UTC m=+38.074176436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-9kjxw" (UID: "e5fee3ed-19c1-4c0c-9006-4524c20d9ed8") : secret "networking-console-plugin-cert" not found
Sep 19 15:12:43.193549 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:43.193494    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:43.194075 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:43.193561    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-9kjxw\" (UID: \"e5fee3ed-19c1-4c0c-9006-4524c20d9ed8\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw"
Sep 19 15:12:43.194075 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:43.193580    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls\") pod \"dns-default-przrv\" (UID: \"fea819f6-340a-495e-9a03-f9c11485c8e7\") " pod="openshift-dns/dns-default-przrv"
Sep 19 15:12:43.194075 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:43.193655    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 15:12:43.194075 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:43.193670    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 19 15:12:43.194075 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:43.193677    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfc5587d8-dbhkz: secret "image-registry-tls" not found
Sep 19 15:12:43.194075 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:43.193707    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 15:12:43.194075 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:43.193752    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls podName:a57ee30d-5eee-4cf5-aa2b-85197a177068 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:45.193729743 +0000 UTC m=+40.082929458 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls") pod "image-registry-7dfc5587d8-dbhkz" (UID: "a57ee30d-5eee-4cf5-aa2b-85197a177068") : secret "image-registry-tls" not found
Sep 19 15:12:43.194075 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:43.193766    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls podName:fea819f6-340a-495e-9a03-f9c11485c8e7 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:45.193760352 +0000 UTC m=+40.082960042 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls") pod "dns-default-przrv" (UID: "fea819f6-340a-495e-9a03-f9c11485c8e7") : secret "dns-default-metrics-tls" not found
Sep 19 15:12:43.194075 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:43.193778    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert podName:e5fee3ed-19c1-4c0c-9006-4524c20d9ed8 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:45.193772971 +0000 UTC m=+40.082972662 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-9kjxw" (UID: "e5fee3ed-19c1-4c0c-9006-4524c20d9ed8") : secret "networking-console-plugin-cert" not found
Sep 19 15:12:43.211345 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:43.211320    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-42lfw"]
Sep 19 15:12:43.223749 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:12:43.223715    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda29dd07f_cdb8_4df8_9b5c_a3993af1bebf.slice/crio-a4b05d8009f4efab89f368e568f631f739b3ad65c3f4f536ef9286d971520099 WatchSource:0}: Error finding container a4b05d8009f4efab89f368e568f631f739b3ad65c3f4f536ef9286d971520099: Status 404 returned error can't find the container with id a4b05d8009f4efab89f368e568f631f739b3ad65c3f4f536ef9286d971520099
Sep 19 15:12:43.898030 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:43.897994    2563 generic.go:356] "Generic (PLEG): container finished" podID="7dfc2b45-4bf9-4ca1-80ca-83e1dc131492" containerID="bf04704fd9479f5fff6074e51667bc8300c8ebbcac87787e4b80f4a975b98c79" exitCode=0
Sep 19 15:12:43.898204 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:43.898053    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s88xt" event={"ID":"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492","Type":"ContainerDied","Data":"bf04704fd9479f5fff6074e51667bc8300c8ebbcac87787e4b80f4a975b98c79"}
Sep 19 15:12:43.899570 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:43.899547    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-42lfw" event={"ID":"a29dd07f-cdb8-4df8-9b5c-a3993af1bebf","Type":"ContainerStarted","Data":"a4b05d8009f4efab89f368e568f631f739b3ad65c3f4f536ef9286d971520099"}
Sep 19 15:12:44.906335 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:44.906254    2563 generic.go:356] "Generic (PLEG): container finished" podID="7dfc2b45-4bf9-4ca1-80ca-83e1dc131492" containerID="edadbbde62cc5b9d731942da79c1af31b6e3701c10e6821f6188b31d51f1cac1" exitCode=0
Sep 19 15:12:44.906335 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:44.906307    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s88xt" event={"ID":"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492","Type":"ContainerDied","Data":"edadbbde62cc5b9d731942da79c1af31b6e3701c10e6821f6188b31d51f1cac1"}
Sep 19 15:12:45.210370 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:45.210333    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:45.210553 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:45.210394    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-9kjxw\" (UID: \"e5fee3ed-19c1-4c0c-9006-4524c20d9ed8\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw"
Sep 19 15:12:45.210553 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:45.210414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls\") pod \"dns-default-przrv\" (UID: \"fea819f6-340a-495e-9a03-f9c11485c8e7\") " pod="openshift-dns/dns-default-przrv"
Sep 19 15:12:45.210553 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:45.210525    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 15:12:45.210553 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:45.210542    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 19 15:12:45.210733 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:45.210558    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfc5587d8-dbhkz: secret "image-registry-tls" not found
Sep 19 15:12:45.210733 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:45.210530    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 15:12:45.210733 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:45.210614    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert podName:e5fee3ed-19c1-4c0c-9006-4524c20d9ed8 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:49.210594378 +0000 UTC m=+44.099794089 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-9kjxw" (UID: "e5fee3ed-19c1-4c0c-9006-4524c20d9ed8") : secret "networking-console-plugin-cert" not found
Sep 19 15:12:45.210733 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:45.210629    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls podName:fea819f6-340a-495e-9a03-f9c11485c8e7 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:49.21062276 +0000 UTC m=+44.099822452 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls") pod "dns-default-przrv" (UID: "fea819f6-340a-495e-9a03-f9c11485c8e7") : secret "dns-default-metrics-tls" not found
Sep 19 15:12:45.210733 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:45.210639    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls podName:a57ee30d-5eee-4cf5-aa2b-85197a177068 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:49.210634212 +0000 UTC m=+44.099833902 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls") pod "image-registry-7dfc5587d8-dbhkz" (UID: "a57ee30d-5eee-4cf5-aa2b-85197a177068") : secret "image-registry-tls" not found
Sep 19 15:12:45.912751 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:45.912671    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s88xt" event={"ID":"7dfc2b45-4bf9-4ca1-80ca-83e1dc131492","Type":"ContainerStarted","Data":"1bb7fc55497d35653c50d82c94298253e770e2f0155edc6133accf8c1d85e2d8"}
Sep 19 15:12:45.931462 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:45.931413    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s88xt" podStartSLOduration=10.180811989 podStartE2EDuration="39.931397275s" totalImagesPullingTime="29.750585286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:12:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:45.929693164 +0000 UTC m=+40.818892888" watchObservedRunningTime="2026-09-19 15:12:45.931397275 +0000 UTC m=+40.820596987"
Sep 19 15:12:46.916950 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:46.916913    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-42lfw" event={"ID":"a29dd07f-cdb8-4df8-9b5c-a3993af1bebf","Type":"ContainerStarted","Data":"fd3add7a169c20f61913283e910b59d4573e57214d410aa5741706ec3b189398"}
Sep 19 15:12:46.930002 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:46.929945    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-42lfw" podStartSLOduration=3.165472291 podStartE2EDuration="5.929927707s" totalImagesPullingTime="2.764455416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:12:46.929435722 +0000 UTC m=+41.818635436" watchObservedRunningTime="2026-09-19 15:12:46.929927707 +0000 UTC m=+41.819127420"
Sep 19 15:12:49.237966 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:49.237923    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:49.238350 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:49.237987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-9kjxw\" (UID: \"e5fee3ed-19c1-4c0c-9006-4524c20d9ed8\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw"
Sep 19 15:12:49.238350 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:49.238007    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls\") pod \"dns-default-przrv\" (UID: \"fea819f6-340a-495e-9a03-f9c11485c8e7\") " pod="openshift-dns/dns-default-przrv"
Sep 19 15:12:49.238350 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:49.238117    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 15:12:49.238350 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:49.238126    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 19 15:12:49.238350 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:49.238165    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls podName:fea819f6-340a-495e-9a03-f9c11485c8e7 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:57.238152064 +0000 UTC m=+52.127351755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls") pod "dns-default-przrv" (UID: "fea819f6-340a-495e-9a03-f9c11485c8e7") : secret "dns-default-metrics-tls" not found
Sep 19 15:12:49.238350 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:49.238129    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 15:12:49.238350 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:49.238178    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert podName:e5fee3ed-19c1-4c0c-9006-4524c20d9ed8 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:57.238172715 +0000 UTC m=+52.127372406 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-9kjxw" (UID: "e5fee3ed-19c1-4c0c-9006-4524c20d9ed8") : secret "networking-console-plugin-cert" not found
Sep 19 15:12:49.238350 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:49.238179    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfc5587d8-dbhkz: secret "image-registry-tls" not found
Sep 19 15:12:49.238350 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:49.238208    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls podName:a57ee30d-5eee-4cf5-aa2b-85197a177068 nodeName:}" failed. No retries permitted until 2026-09-19 15:12:57.238196717 +0000 UTC m=+52.127396408 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls") pod "image-registry-7dfc5587d8-dbhkz" (UID: "a57ee30d-5eee-4cf5-aa2b-85197a177068") : secret "image-registry-tls" not found
Sep 19 15:12:57.297654 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:57.297621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:12:57.298148 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:57.297680    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-9kjxw\" (UID: \"e5fee3ed-19c1-4c0c-9006-4524c20d9ed8\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw"
Sep 19 15:12:57.298148 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:12:57.297705    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls\") pod \"dns-default-przrv\" (UID: \"fea819f6-340a-495e-9a03-f9c11485c8e7\") " pod="openshift-dns/dns-default-przrv"
Sep 19 15:12:57.298148 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:57.297805    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 19 15:12:57.298148 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:57.297813    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 15:12:57.298148 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:57.297830    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 15:12:57.298148 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:57.297831    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfc5587d8-dbhkz: secret "image-registry-tls" not found
Sep 19 15:12:57.298148 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:57.297885    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert podName:e5fee3ed-19c1-4c0c-9006-4524c20d9ed8 nodeName:}" failed. No retries permitted until 2026-09-19 15:13:13.297868871 +0000 UTC m=+68.187068562 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-9kjxw" (UID: "e5fee3ed-19c1-4c0c-9006-4524c20d9ed8") : secret "networking-console-plugin-cert" not found
Sep 19 15:12:57.298148 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:57.297920    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls podName:fea819f6-340a-495e-9a03-f9c11485c8e7 nodeName:}" failed. No retries permitted until 2026-09-19 15:13:13.297913132 +0000 UTC m=+68.187112824 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls") pod "dns-default-przrv" (UID: "fea819f6-340a-495e-9a03-f9c11485c8e7") : secret "dns-default-metrics-tls" not found
Sep 19 15:12:57.298148 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:12:57.297930    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls podName:a57ee30d-5eee-4cf5-aa2b-85197a177068 nodeName:}" failed. No retries permitted until 2026-09-19 15:13:13.297924736 +0000 UTC m=+68.187124427 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls") pod "image-registry-7dfc5587d8-dbhkz" (UID: "a57ee30d-5eee-4cf5-aa2b-85197a177068") : secret "image-registry-tls" not found
Sep 19 15:13:06.886001 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:06.885972    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t8k78"
Sep 19 15:13:11.307659 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:11.307605    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret\") pod \"global-pull-secret-syncer-c44rt\" (UID: \"825442d3-29e0-41cb-82ef-99f7b9cf9529\") " pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:13:11.310125 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:11.310106    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 19 15:13:11.320732 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:11.320706    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/825442d3-29e0-41cb-82ef-99f7b9cf9529-original-pull-secret\") pod \"global-pull-secret-syncer-c44rt\" (UID: \"825442d3-29e0-41cb-82ef-99f7b9cf9529\") " pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:13:11.346846 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:11.346811    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c44rt"
Sep 19 15:13:11.408556 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:11.408532    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs\") pod \"network-metrics-daemon-ctzjp\" (UID: \"fc07702b-1393-4278-9027-3b4592ee57d4\") " pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:13:11.410717 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:11.410694    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 19 15:13:11.419283 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:13:11.419264    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 19 15:13:11.419372 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:13:11.419330    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs podName:fc07702b-1393-4278-9027-3b4592ee57d4 nodeName:}" failed. No retries permitted until 2026-09-19 15:14:15.419312667 +0000 UTC m=+130.308512358 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs") pod "network-metrics-daemon-ctzjp" (UID: "fc07702b-1393-4278-9027-3b4592ee57d4") : secret "metrics-daemon-secret" not found
Sep 19 15:13:11.508911 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:11.508851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkmbr\" (UniqueName: \"kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr\") pod \"network-check-target-rqqg5\" (UID: \"d53e44ab-657f-4d2a-b85b-d04a1b632d50\") " pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:13:11.510931 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:11.510913    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 19 15:13:11.521577 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:11.521555    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 19 15:13:11.532538 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:11.532516    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkmbr\" (UniqueName: \"kubernetes.io/projected/d53e44ab-657f-4d2a-b85b-d04a1b632d50-kube-api-access-lkmbr\") pod \"network-check-target-rqqg5\" (UID: \"d53e44ab-657f-4d2a-b85b-d04a1b632d50\") " pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:13:11.610265 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:11.610201    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c44rt"]
Sep 19 15:13:11.613522 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:13:11.613498    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod825442d3_29e0_41cb_82ef_99f7b9cf9529.slice/crio-5cc35e668b376c0a7a5c1d1eab797a501dc9e5825f17e16bd2e766ba83b0ca27 WatchSource:0}: Error finding container 5cc35e668b376c0a7a5c1d1eab797a501dc9e5825f17e16bd2e766ba83b0ca27: Status 404 returned error can't find the container with id 5cc35e668b376c0a7a5c1d1eab797a501dc9e5825f17e16bd2e766ba83b0ca27
Sep 19 15:13:11.654631 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:11.654602    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zprn6\""
Sep 19 15:13:11.663265 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:11.663243    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:13:11.925769 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:11.925696    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rqqg5"]
Sep 19 15:13:11.928652 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:13:11.928628    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53e44ab_657f_4d2a_b85b_d04a1b632d50.slice/crio-a6f980f4d4e75d75348ac76fc8f60700d76ef5bf72b5fe9bf74a0c74756f8b53 WatchSource:0}: Error finding container a6f980f4d4e75d75348ac76fc8f60700d76ef5bf72b5fe9bf74a0c74756f8b53: Status 404 returned error can't find the container with id a6f980f4d4e75d75348ac76fc8f60700d76ef5bf72b5fe9bf74a0c74756f8b53
Sep 19 15:13:11.977973 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:11.977934    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c44rt" event={"ID":"825442d3-29e0-41cb-82ef-99f7b9cf9529","Type":"ContainerStarted","Data":"5cc35e668b376c0a7a5c1d1eab797a501dc9e5825f17e16bd2e766ba83b0ca27"}
Sep 19 15:13:11.979412 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:11.979375    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rqqg5" event={"ID":"d53e44ab-657f-4d2a-b85b-d04a1b632d50","Type":"ContainerStarted","Data":"a6f980f4d4e75d75348ac76fc8f60700d76ef5bf72b5fe9bf74a0c74756f8b53"}
Sep 19 15:13:13.320385 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:13.320330    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-9kjxw\" (UID: \"e5fee3ed-19c1-4c0c-9006-4524c20d9ed8\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw"
Sep 19 15:13:13.320385 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:13.320384    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls\") pod \"dns-default-przrv\" (UID: \"fea819f6-340a-495e-9a03-f9c11485c8e7\") " pod="openshift-dns/dns-default-przrv"
Sep 19 15:13:13.320951 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:13.320443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:13:13.320951 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:13:13.320486    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 19 15:13:13.320951 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:13:13.320546    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 15:13:13.320951 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:13:13.320557    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfc5587d8-dbhkz: secret "image-registry-tls" not found
Sep 19 15:13:13.320951 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:13:13.320585    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert podName:e5fee3ed-19c1-4c0c-9006-4524c20d9ed8 nodeName:}" failed. No retries permitted until 2026-09-19 15:13:45.320532264 +0000 UTC m=+100.209731971 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-9kjxw" (UID: "e5fee3ed-19c1-4c0c-9006-4524c20d9ed8") : secret "networking-console-plugin-cert" not found
Sep 19 15:13:13.320951 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:13:13.320604    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls podName:a57ee30d-5eee-4cf5-aa2b-85197a177068 nodeName:}" failed. No retries permitted until 2026-09-19 15:13:45.320594517 +0000 UTC m=+100.209794208 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls") pod "image-registry-7dfc5587d8-dbhkz" (UID: "a57ee30d-5eee-4cf5-aa2b-85197a177068") : secret "image-registry-tls" not found
Sep 19 15:13:13.320951 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:13:13.320636    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 15:13:13.320951 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:13:13.320664    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls podName:fea819f6-340a-495e-9a03-f9c11485c8e7 nodeName:}" failed. No retries permitted until 2026-09-19 15:13:45.320654312 +0000 UTC m=+100.209854003 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls") pod "dns-default-przrv" (UID: "fea819f6-340a-495e-9a03-f9c11485c8e7") : secret "dns-default-metrics-tls" not found
Sep 19 15:13:16.994388 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:16.994353    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c44rt" event={"ID":"825442d3-29e0-41cb-82ef-99f7b9cf9529","Type":"ContainerStarted","Data":"b3254cf8de96f846e183eb38b70be82fe0c04fd06510163199b18010c97c2741"}
Sep 19 15:13:16.995905 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:16.995856    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rqqg5" event={"ID":"d53e44ab-657f-4d2a-b85b-d04a1b632d50","Type":"ContainerStarted","Data":"8867cfdfd49b67bf9bc747f4438504cdad7e3c4537e3a5082fd0488127fe66e5"}
Sep 19 15:13:16.996021 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:16.995927    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:13:17.007268 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:17.007212    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-c44rt" podStartSLOduration=66.254920258 podStartE2EDuration="1m11.007187s" totalImagesPullingTime="4.752266742s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:13:17.007147649 +0000 UTC m=+71.896347363" watchObservedRunningTime="2026-09-19 15:13:17.007187 +0000 UTC m=+71.896386718"
Sep 19 15:13:17.019688 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:17.019646    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rqqg5" podStartSLOduration=66.58737913 podStartE2EDuration="1m11.019629503s" totalImagesPullingTime="4.432250373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:13:17.019122497 +0000 UTC m=+71.908322210" watchObservedRunningTime="2026-09-19 15:13:17.019629503 +0000 UTC m=+71.908829215"
Sep 19 15:13:45.351308 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:45.351216    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:13:45.351308 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:45.351276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-9kjxw\" (UID: \"e5fee3ed-19c1-4c0c-9006-4524c20d9ed8\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw"
Sep 19 15:13:45.351308 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:45.351296    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls\") pod \"dns-default-przrv\" (UID: \"fea819f6-340a-495e-9a03-f9c11485c8e7\") " pod="openshift-dns/dns-default-przrv"
Sep 19 15:13:45.351728 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:13:45.351379    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 15:13:45.351728 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:13:45.351398    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfc5587d8-dbhkz: secret "image-registry-tls" not found
Sep 19 15:13:45.351728 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:13:45.351415    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 15:13:45.351728 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:13:45.351416    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 19 15:13:45.351728 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:13:45.351456    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls podName:a57ee30d-5eee-4cf5-aa2b-85197a177068 nodeName:}" failed. No retries permitted until 2026-09-19 15:14:49.351441553 +0000 UTC m=+164.240641243 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls") pod "image-registry-7dfc5587d8-dbhkz" (UID: "a57ee30d-5eee-4cf5-aa2b-85197a177068") : secret "image-registry-tls" not found
Sep 19 15:13:45.351728 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:13:45.351475    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert podName:e5fee3ed-19c1-4c0c-9006-4524c20d9ed8 nodeName:}" failed. No retries permitted until 2026-09-19 15:14:49.351462465 +0000 UTC m=+164.240662188 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-9kjxw" (UID: "e5fee3ed-19c1-4c0c-9006-4524c20d9ed8") : secret "networking-console-plugin-cert" not found
Sep 19 15:13:45.351728 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:13:45.351489    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls podName:fea819f6-340a-495e-9a03-f9c11485c8e7 nodeName:}" failed. No retries permitted until 2026-09-19 15:14:49.351482037 +0000 UTC m=+164.240681728 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls") pod "dns-default-przrv" (UID: "fea819f6-340a-495e-9a03-f9c11485c8e7") : secret "dns-default-metrics-tls" not found
Sep 19 15:13:48.000356 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:13:48.000324    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rqqg5"
Sep 19 15:14:15.465677 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:14:15.465616    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs\") pod \"network-metrics-daemon-ctzjp\" (UID: \"fc07702b-1393-4278-9027-3b4592ee57d4\") " pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:14:15.466207 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:14:15.465776    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 19 15:14:15.466207 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:14:15.465857    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs podName:fc07702b-1393-4278-9027-3b4592ee57d4 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:17.465841033 +0000 UTC m=+252.355040737 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs") pod "network-metrics-daemon-ctzjp" (UID: "fc07702b-1393-4278-9027-3b4592ee57d4") : secret "metrics-daemon-secret" not found
Sep 19 15:14:44.458849 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:14:44.458801    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz" podUID="a57ee30d-5eee-4cf5-aa2b-85197a177068"
Sep 19 15:14:44.462951 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:14:44.462922    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw" podUID="e5fee3ed-19c1-4c0c-9006-4524c20d9ed8"
Sep 19 15:14:44.472059 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:14:44.472034    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-przrv" podUID="fea819f6-340a-495e-9a03-f9c11485c8e7"
Sep 19 15:14:44.658562 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:14:44.658502    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ctzjp" podUID="fc07702b-1393-4278-9027-3b4592ee57d4"
Sep 19 15:14:45.201882 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:14:45.201812    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:14:45.201882 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:14:45.201842    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-przrv"
Sep 19 15:14:45.202053 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:14:45.202017    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw"
Sep 19 15:14:49.406323 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:14:49.406288    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-9kjxw\" (UID: \"e5fee3ed-19c1-4c0c-9006-4524c20d9ed8\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw"
Sep 19 15:14:49.406323 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:14:49.406322    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls\") pod \"dns-default-przrv\" (UID: \"fea819f6-340a-495e-9a03-f9c11485c8e7\") " pod="openshift-dns/dns-default-przrv"
Sep 19 15:14:49.406847 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:14:49.406360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:14:49.406847 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:14:49.406444    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 15:14:49.406847 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:14:49.406443    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 19 15:14:49.406847 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:14:49.406454    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfc5587d8-dbhkz: secret "image-registry-tls" not found
Sep 19 15:14:49.406847 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:14:49.406443    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 15:14:49.406847 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:14:49.406512    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert podName:e5fee3ed-19c1-4c0c-9006-4524c20d9ed8 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:51.406491737 +0000 UTC m=+286.295691447 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-9kjxw" (UID: "e5fee3ed-19c1-4c0c-9006-4524c20d9ed8") : secret "networking-console-plugin-cert" not found
Sep 19 15:14:49.406847 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:14:49.406527    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls podName:a57ee30d-5eee-4cf5-aa2b-85197a177068 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:51.406520715 +0000 UTC m=+286.295720406 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls") pod "image-registry-7dfc5587d8-dbhkz" (UID: "a57ee30d-5eee-4cf5-aa2b-85197a177068") : secret "image-registry-tls" not found
Sep 19 15:14:49.406847 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:14:49.406537    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls podName:fea819f6-340a-495e-9a03-f9c11485c8e7 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:51.406531607 +0000 UTC m=+286.295731297 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls") pod "dns-default-przrv" (UID: "fea819f6-340a-495e-9a03-f9c11485c8e7") : secret "dns-default-metrics-tls" not found
Sep 19 15:14:59.634737 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:14:59.634699    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:16:14.456912 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.456848    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc"]
Sep 19 15:16:14.459875 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.459853    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc"
Sep 19 15:16:14.460173 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.460123    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-g2qck"]
Sep 19 15:16:14.461850 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.461822    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 19 15:16:14.461967 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.461847    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zp4cx\""
Sep 19 15:16:14.462751 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.462734    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 19 15:16:14.462843 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.462817    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-dghnr"]
Sep 19 15:16:14.462921 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.462852    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 19 15:16:14.462984 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.462851    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 19 15:16:14.462984 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.462947    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-g2qck"
Sep 19 15:16:14.464955 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.464937    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 19 15:16:14.464955 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.464939    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 19 15:16:14.465109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.465013    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 19 15:16:14.465109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.465033    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 19 15:16:14.465215 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.465108    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-2f8bd\""
Sep 19 15:16:14.465634 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.465614    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-fz6j8"]
Sep 19 15:16:14.465748 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.465731    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-dghnr"
Sep 19 15:16:14.467716 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.467700    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 19 15:16:14.467716 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.467715    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 19 15:16:14.468077 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.468060    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 19 15:16:14.468196 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.468181    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zh9wt\""
Sep 19 15:16:14.468544 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.468531    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8"
Sep 19 15:16:14.470514 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.470496    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 19 15:16:14.470713 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.470654    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 19 15:16:14.470908 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.470874    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc"]
Sep 19 15:16:14.471010 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.470988    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 19 15:16:14.471129 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.471092    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 19 15:16:14.471268 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.471246    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 19 15:16:14.471731 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.471711    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4jvww\""
Sep 19 15:16:14.474383 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.474331    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-g2qck"]
Sep 19 15:16:14.477054 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.477037    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 19 15:16:14.477266 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.477039    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-fz6j8"]
Sep 19 15:16:14.482752 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.482729    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-dghnr"]
Sep 19 15:16:14.558644 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.558604    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87hpj"]
Sep 19 15:16:14.562618 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.562593    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87hpj"
Sep 19 15:16:14.563353 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.563329    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-76d56ddb5b-flrvn"]
Sep 19 15:16:14.565494 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.565472    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 19 15:16:14.565595 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.565479    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 19 15:16:14.565659 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.565595    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 19 15:16:14.565659 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.565480    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-dbmwj\""
Sep 19 15:16:14.565763 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.565674    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 19 15:16:14.566181 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.566160    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:14.567933 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.567912    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 19 15:16:14.568036 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.567912    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-l8jj5\""
Sep 19 15:16:14.568100 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.568089    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 19 15:16:14.568331 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.568306    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 19 15:16:14.568331 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.568329    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 19 15:16:14.568485 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.568389    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 19 15:16:14.568485 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.568307    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 19 15:16:14.571055 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.571037    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87hpj"]
Sep 19 15:16:14.581534 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.581516    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76d56ddb5b-flrvn"]
Sep 19 15:16:14.592132 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.592110    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzhtt\" (UniqueName: \"kubernetes.io/projected/8181741c-8615-4587-8457-18381d08e00c-kube-api-access-hzhtt\") pod \"cluster-samples-operator-685d7d68b5-dghnr\" (UID: \"8181741c-8615-4587-8457-18381d08e00c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-dghnr"
Sep 19 15:16:14.592223 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.592140    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8181741c-8615-4587-8457-18381d08e00c-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-dghnr\" (UID: \"8181741c-8615-4587-8457-18381d08e00c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-dghnr"
Sep 19 15:16:14.592223 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.592182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc3705a0-4a6c-40a1-9233-776b60b77090-serving-cert\") pod \"insights-operator-6f9c644dd9-fz6j8\" (UID: \"fc3705a0-4a6c-40a1-9233-776b60b77090\") " pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8"
Sep 19 15:16:14.592223 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.592214    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-p9bwc\" (UID: \"8925bba2-d5a0-4386-9ccc-9ef824dfd7bd\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc"
Sep 19 15:16:14.592318 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.592233    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fc3705a0-4a6c-40a1-9233-776b60b77090-snapshots\") pod \"insights-operator-6f9c644dd9-fz6j8\" (UID: \"fc3705a0-4a6c-40a1-9233-776b60b77090\") " pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8"
Sep 19 15:16:14.592318 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.592252    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9177bc4f-c634-4722-8a81-74946afb6a3d-config\") pod \"console-operator-fd4bb46c-g2qck\" (UID: \"9177bc4f-c634-4722-8a81-74946afb6a3d\") " pod="openshift-console-operator/console-operator-fd4bb46c-g2qck"
Sep 19 15:16:14.592318 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.592273    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9177bc4f-c634-4722-8a81-74946afb6a3d-trusted-ca\") pod \"console-operator-fd4bb46c-g2qck\" (UID: \"9177bc4f-c634-4722-8a81-74946afb6a3d\") " pod="openshift-console-operator/console-operator-fd4bb46c-g2qck"
Sep 19 15:16:14.592404 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.592322    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc3705a0-4a6c-40a1-9233-776b60b77090-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-fz6j8\" (UID: \"fc3705a0-4a6c-40a1-9233-776b60b77090\") " pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8"
Sep 19 15:16:14.592404 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.592340    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4cvl\" (UniqueName: \"kubernetes.io/projected/9177bc4f-c634-4722-8a81-74946afb6a3d-kube-api-access-j4cvl\") pod \"console-operator-fd4bb46c-g2qck\" (UID: \"9177bc4f-c634-4722-8a81-74946afb6a3d\") " pod="openshift-console-operator/console-operator-fd4bb46c-g2qck"
Sep 19 15:16:14.592404 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.592361    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-p9bwc\" (UID: \"8925bba2-d5a0-4386-9ccc-9ef824dfd7bd\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc"
Sep 19 15:16:14.592404 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.592384    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9177bc4f-c634-4722-8a81-74946afb6a3d-serving-cert\") pod \"console-operator-fd4bb46c-g2qck\" (UID: \"9177bc4f-c634-4722-8a81-74946afb6a3d\") " pod="openshift-console-operator/console-operator-fd4bb46c-g2qck"
Sep 19 15:16:14.592404 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.592401    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvbcc\" (UniqueName: \"kubernetes.io/projected/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-kube-api-access-lvbcc\") pod \"cluster-monitoring-operator-847b8bd8d7-p9bwc\" (UID: \"8925bba2-d5a0-4386-9ccc-9ef824dfd7bd\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc"
Sep 19 15:16:14.592552 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.592451    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wjjg\" (UniqueName: \"kubernetes.io/projected/fc3705a0-4a6c-40a1-9233-776b60b77090-kube-api-access-7wjjg\") pod \"insights-operator-6f9c644dd9-fz6j8\" (UID: \"fc3705a0-4a6c-40a1-9233-776b60b77090\") " pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8"
Sep 19 15:16:14.592552 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.592474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc3705a0-4a6c-40a1-9233-776b60b77090-tmp\") pod \"insights-operator-6f9c644dd9-fz6j8\" (UID: \"fc3705a0-4a6c-40a1-9233-776b60b77090\") " pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8"
Sep 19 15:16:14.592552 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.592523    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc3705a0-4a6c-40a1-9233-776b60b77090-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-fz6j8\" (UID: \"fc3705a0-4a6c-40a1-9233-776b60b77090\") " pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8"
Sep 19 15:16:14.655143 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.655106    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mjpvx"]
Sep 19 15:16:14.658095 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.658073    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mjpvx"
Sep 19 15:16:14.660171 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.660151    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 19 15:16:14.660282 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.660154    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 19 15:16:14.660282 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.660201    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-qn5wr\""
Sep 19 15:16:14.666557 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.666533    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mjpvx"]
Sep 19 15:16:14.693592 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.693563    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fc3705a0-4a6c-40a1-9233-776b60b77090-snapshots\") pod \"insights-operator-6f9c644dd9-fz6j8\" (UID: \"fc3705a0-4a6c-40a1-9233-776b60b77090\") " pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8"
Sep 19 15:16:14.693743 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.693602    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9177bc4f-c634-4722-8a81-74946afb6a3d-config\") pod \"console-operator-fd4bb46c-g2qck\" (UID: \"9177bc4f-c634-4722-8a81-74946afb6a3d\") " pod="openshift-console-operator/console-operator-fd4bb46c-g2qck"
Sep 19 15:16:14.693743 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.693618    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9177bc4f-c634-4722-8a81-74946afb6a3d-trusted-ca\") pod \"console-operator-fd4bb46c-g2qck\" (UID: \"9177bc4f-c634-4722-8a81-74946afb6a3d\") " pod="openshift-console-operator/console-operator-fd4bb46c-g2qck"
Sep 19 15:16:14.693743 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.693639    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92c14079-3000-467d-8823-9a2c8d6c6730-service-ca-bundle\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:14.693917 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.693768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89jff\" (UniqueName: \"kubernetes.io/projected/92c14079-3000-467d-8823-9a2c8d6c6730-kube-api-access-89jff\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:14.693917 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.693857    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc3705a0-4a6c-40a1-9233-776b60b77090-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-fz6j8\" (UID: \"fc3705a0-4a6c-40a1-9233-776b60b77090\") " pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8"
Sep 19 15:16:14.694026 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.693908    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e954267-9310-40da-9df9-939865cb489a-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-87hpj\" (UID: \"6e954267-9310-40da-9df9-939865cb489a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87hpj"
Sep 19 15:16:14.694026 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.693946    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4cvl\" (UniqueName: \"kubernetes.io/projected/9177bc4f-c634-4722-8a81-74946afb6a3d-kube-api-access-j4cvl\") pod \"console-operator-fd4bb46c-g2qck\" (UID: \"9177bc4f-c634-4722-8a81-74946afb6a3d\") " pod="openshift-console-operator/console-operator-fd4bb46c-g2qck"
Sep 19 15:16:14.694026 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.693976    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-p9bwc\" (UID: \"8925bba2-d5a0-4386-9ccc-9ef824dfd7bd\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc"
Sep 19 15:16:14.694026 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.694002    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e954267-9310-40da-9df9-939865cb489a-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-87hpj\" (UID: \"6e954267-9310-40da-9df9-939865cb489a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87hpj"
Sep 19 15:16:14.694218 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:14.694121    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 19 15:16:14.694218 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.694136    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzqf4\" (UniqueName: \"kubernetes.io/projected/6e954267-9310-40da-9df9-939865cb489a-kube-api-access-rzqf4\") pod \"kube-storage-version-migrator-operator-55889f7b47-87hpj\" (UID: \"6e954267-9310-40da-9df9-939865cb489a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87hpj"
Sep 19 15:16:14.694218 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:14.694195    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-cluster-monitoring-operator-tls podName:8925bba2-d5a0-4386-9ccc-9ef824dfd7bd nodeName:}" failed. No retries permitted until 2026-09-19 15:16:15.194174377 +0000 UTC m=+250.083374092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-p9bwc" (UID: "8925bba2-d5a0-4386-9ccc-9ef824dfd7bd") : secret "cluster-monitoring-operator-tls" not found
Sep 19 15:16:14.694218 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.694175    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-default-certificate\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:14.694430 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.694239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9177bc4f-c634-4722-8a81-74946afb6a3d-serving-cert\") pod \"console-operator-fd4bb46c-g2qck\" (UID: \"9177bc4f-c634-4722-8a81-74946afb6a3d\") " pod="openshift-console-operator/console-operator-fd4bb46c-g2qck"
Sep 19 15:16:14.694430 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.694291    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvbcc\" (UniqueName: \"kubernetes.io/projected/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-kube-api-access-lvbcc\") pod \"cluster-monitoring-operator-847b8bd8d7-p9bwc\" (UID: \"8925bba2-d5a0-4386-9ccc-9ef824dfd7bd\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc"
Sep 19 15:16:14.694430 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.694327    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fc3705a0-4a6c-40a1-9233-776b60b77090-snapshots\") pod \"insights-operator-6f9c644dd9-fz6j8\" (UID: \"fc3705a0-4a6c-40a1-9233-776b60b77090\") " pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8"
Sep 19 15:16:14.694430 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.694333    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9177bc4f-c634-4722-8a81-74946afb6a3d-config\") pod \"console-operator-fd4bb46c-g2qck\" (UID: \"9177bc4f-c634-4722-8a81-74946afb6a3d\") " pod="openshift-console-operator/console-operator-fd4bb46c-g2qck"
Sep 19 15:16:14.694430 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.694337    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wjjg\" (UniqueName: \"kubernetes.io/projected/fc3705a0-4a6c-40a1-9233-776b60b77090-kube-api-access-7wjjg\") pod \"insights-operator-6f9c644dd9-fz6j8\" (UID: \"fc3705a0-4a6c-40a1-9233-776b60b77090\") " pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8"
Sep 19 15:16:14.694430 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.694404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc3705a0-4a6c-40a1-9233-776b60b77090-tmp\") pod \"insights-operator-6f9c644dd9-fz6j8\" (UID: \"fc3705a0-4a6c-40a1-9233-776b60b77090\") " pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8"
Sep 19 15:16:14.694782 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.694439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc3705a0-4a6c-40a1-9233-776b60b77090-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-fz6j8\" (UID: \"fc3705a0-4a6c-40a1-9233-776b60b77090\") " pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8"
Sep 19 15:16:14.694782 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.694476    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-metrics-certs\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:14.694782 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.694488    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9177bc4f-c634-4722-8a81-74946afb6a3d-trusted-ca\") pod \"console-operator-fd4bb46c-g2qck\" (UID: \"9177bc4f-c634-4722-8a81-74946afb6a3d\") " pod="openshift-console-operator/console-operator-fd4bb46c-g2qck"
Sep 19 15:16:14.694782 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.694508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzhtt\" (UniqueName: \"kubernetes.io/projected/8181741c-8615-4587-8457-18381d08e00c-kube-api-access-hzhtt\") pod \"cluster-samples-operator-685d7d68b5-dghnr\" (UID: \"8181741c-8615-4587-8457-18381d08e00c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-dghnr"
Sep 19 15:16:14.694782 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.694536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8181741c-8615-4587-8457-18381d08e00c-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-dghnr\" (UID: \"8181741c-8615-4587-8457-18381d08e00c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-dghnr"
Sep 19 15:16:14.694782 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.694584    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc3705a0-4a6c-40a1-9233-776b60b77090-serving-cert\") pod \"insights-operator-6f9c644dd9-fz6j8\" (UID: \"fc3705a0-4a6c-40a1-9233-776b60b77090\") " pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8"
Sep 19 15:16:14.694782 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.694618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-stats-auth\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:14.694782 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.694655    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-p9bwc\" (UID: \"8925bba2-d5a0-4386-9ccc-9ef824dfd7bd\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc"
Sep 19 15:16:14.694782 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:14.694702    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 19 15:16:14.694782 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.694720    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc3705a0-4a6c-40a1-9233-776b60b77090-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-fz6j8\" (UID: \"fc3705a0-4a6c-40a1-9233-776b60b77090\") " pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8"
Sep 19 15:16:14.694782 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.694724    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc3705a0-4a6c-40a1-9233-776b60b77090-tmp\") pod \"insights-operator-6f9c644dd9-fz6j8\" (UID: \"fc3705a0-4a6c-40a1-9233-776b60b77090\") " pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8"
Sep 19 15:16:14.694782 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:14.694764    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8181741c-8615-4587-8457-18381d08e00c-samples-operator-tls podName:8181741c-8615-4587-8457-18381d08e00c nodeName:}" failed. No retries permitted until 2026-09-19 15:16:15.194747417 +0000 UTC m=+250.083947143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8181741c-8615-4587-8457-18381d08e00c-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-dghnr" (UID: "8181741c-8615-4587-8457-18381d08e00c") : secret "samples-operator-tls" not found
Sep 19 15:16:14.695226 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.694914    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc3705a0-4a6c-40a1-9233-776b60b77090-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-fz6j8\" (UID: \"fc3705a0-4a6c-40a1-9233-776b60b77090\") " pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8"
Sep 19 15:16:14.695596 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.695577    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-p9bwc\" (UID: \"8925bba2-d5a0-4386-9ccc-9ef824dfd7bd\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc"
Sep 19 15:16:14.696819 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.696800    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9177bc4f-c634-4722-8a81-74946afb6a3d-serving-cert\") pod \"console-operator-fd4bb46c-g2qck\" (UID: \"9177bc4f-c634-4722-8a81-74946afb6a3d\") " pod="openshift-console-operator/console-operator-fd4bb46c-g2qck"
Sep 19 15:16:14.697041 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.697025    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc3705a0-4a6c-40a1-9233-776b60b77090-serving-cert\") pod \"insights-operator-6f9c644dd9-fz6j8\" (UID: \"fc3705a0-4a6c-40a1-9233-776b60b77090\") " pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8"
Sep 19 15:16:14.704044 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.704021    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4cvl\" (UniqueName: \"kubernetes.io/projected/9177bc4f-c634-4722-8a81-74946afb6a3d-kube-api-access-j4cvl\") pod \"console-operator-fd4bb46c-g2qck\" (UID: \"9177bc4f-c634-4722-8a81-74946afb6a3d\") " pod="openshift-console-operator/console-operator-fd4bb46c-g2qck"
Sep 19 15:16:14.704199 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.704182    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzhtt\" (UniqueName: \"kubernetes.io/projected/8181741c-8615-4587-8457-18381d08e00c-kube-api-access-hzhtt\") pod \"cluster-samples-operator-685d7d68b5-dghnr\" (UID: \"8181741c-8615-4587-8457-18381d08e00c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-dghnr"
Sep 19 15:16:14.704304 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.704285    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvbcc\" (UniqueName: \"kubernetes.io/projected/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-kube-api-access-lvbcc\") pod \"cluster-monitoring-operator-847b8bd8d7-p9bwc\" (UID: \"8925bba2-d5a0-4386-9ccc-9ef824dfd7bd\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc"
Sep 19 15:16:14.704690 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.704675    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wjjg\" (UniqueName: \"kubernetes.io/projected/fc3705a0-4a6c-40a1-9233-776b60b77090-kube-api-access-7wjjg\") pod \"insights-operator-6f9c644dd9-fz6j8\" (UID: \"fc3705a0-4a6c-40a1-9233-776b60b77090\") " pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8"
Sep 19 15:16:14.779041 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.778938    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-g2qck"
Sep 19 15:16:14.791472 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.791447    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8"
Sep 19 15:16:14.795405 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.795369    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89jff\" (UniqueName: \"kubernetes.io/projected/92c14079-3000-467d-8823-9a2c8d6c6730-kube-api-access-89jff\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:14.795488 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.795420    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e954267-9310-40da-9df9-939865cb489a-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-87hpj\" (UID: \"6e954267-9310-40da-9df9-939865cb489a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87hpj"
Sep 19 15:16:14.795488 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.795447    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e954267-9310-40da-9df9-939865cb489a-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-87hpj\" (UID: \"6e954267-9310-40da-9df9-939865cb489a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87hpj"
Sep 19 15:16:14.795488 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.795465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzqf4\" (UniqueName: \"kubernetes.io/projected/6e954267-9310-40da-9df9-939865cb489a-kube-api-access-rzqf4\") pod \"kube-storage-version-migrator-operator-55889f7b47-87hpj\" (UID: \"6e954267-9310-40da-9df9-939865cb489a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87hpj"
Sep 19 15:16:14.795488 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.795484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-default-certificate\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:14.795682 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.795529    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-metrics-certs\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:14.795682 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.795595    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-stats-auth\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:14.795682 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.795635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srkxx\" (UniqueName: \"kubernetes.io/projected/e56103e3-9eb1-4204-bd40-b82464d93412-kube-api-access-srkxx\") pod \"volume-data-source-validator-5c4db8bdf9-mjpvx\" (UID: \"e56103e3-9eb1-4204-bd40-b82464d93412\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mjpvx"
Sep 19 15:16:14.795682 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.795667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92c14079-3000-467d-8823-9a2c8d6c6730-service-ca-bundle\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:14.795881 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:14.795731    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 19 15:16:14.795881 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:14.795798    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-metrics-certs podName:92c14079-3000-467d-8823-9a2c8d6c6730 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:15.29576619 +0000 UTC m=+250.184965888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-metrics-certs") pod "router-default-76d56ddb5b-flrvn" (UID: "92c14079-3000-467d-8823-9a2c8d6c6730") : secret "router-metrics-certs-default" not found
Sep 19 15:16:14.795881 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:14.795816    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92c14079-3000-467d-8823-9a2c8d6c6730-service-ca-bundle podName:92c14079-3000-467d-8823-9a2c8d6c6730 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:15.295806657 +0000 UTC m=+250.185006353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92c14079-3000-467d-8823-9a2c8d6c6730-service-ca-bundle") pod "router-default-76d56ddb5b-flrvn" (UID: "92c14079-3000-467d-8823-9a2c8d6c6730") : configmap references non-existent config key: service-ca.crt
Sep 19 15:16:14.796138 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.796113    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e954267-9310-40da-9df9-939865cb489a-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-87hpj\" (UID: \"6e954267-9310-40da-9df9-939865cb489a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87hpj"
Sep 19 15:16:14.798303 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.798282    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-stats-auth\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:14.798577 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.798554    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e954267-9310-40da-9df9-939865cb489a-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-87hpj\" (UID: \"6e954267-9310-40da-9df9-939865cb489a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87hpj"
Sep 19 15:16:14.798699 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.798685    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-default-certificate\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:14.803621 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.803561    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzqf4\" (UniqueName: \"kubernetes.io/projected/6e954267-9310-40da-9df9-939865cb489a-kube-api-access-rzqf4\") pod \"kube-storage-version-migrator-operator-55889f7b47-87hpj\" (UID: \"6e954267-9310-40da-9df9-939865cb489a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87hpj"
Sep 19 15:16:14.803826 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.803741    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89jff\" (UniqueName: \"kubernetes.io/projected/92c14079-3000-467d-8823-9a2c8d6c6730-kube-api-access-89jff\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:14.873673 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.873645    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87hpj"
Sep 19 15:16:14.896412 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.896386    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srkxx\" (UniqueName: \"kubernetes.io/projected/e56103e3-9eb1-4204-bd40-b82464d93412-kube-api-access-srkxx\") pod \"volume-data-source-validator-5c4db8bdf9-mjpvx\" (UID: \"e56103e3-9eb1-4204-bd40-b82464d93412\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mjpvx"
Sep 19 15:16:14.903937 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.903887    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srkxx\" (UniqueName: \"kubernetes.io/projected/e56103e3-9eb1-4204-bd40-b82464d93412-kube-api-access-srkxx\") pod \"volume-data-source-validator-5c4db8bdf9-mjpvx\" (UID: \"e56103e3-9eb1-4204-bd40-b82464d93412\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mjpvx"
Sep 19 15:16:14.966495 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:14.966463    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mjpvx"
Sep 19 15:16:15.052102 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:15.052076    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-g2qck"]
Sep 19 15:16:15.054668 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:16:15.054639    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9177bc4f_c634_4722_8a81_74946afb6a3d.slice/crio-6870c50b93af59fe59de2c6851651e6f307d672a8530ab8498a0c56ca72dd1ad WatchSource:0}: Error finding container 6870c50b93af59fe59de2c6851651e6f307d672a8530ab8498a0c56ca72dd1ad: Status 404 returned error can't find the container with id 6870c50b93af59fe59de2c6851651e6f307d672a8530ab8498a0c56ca72dd1ad
Sep 19 15:16:15.070542 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:15.070515    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-fz6j8"]
Sep 19 15:16:15.073300 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:16:15.073272    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc3705a0_4a6c_40a1_9233_776b60b77090.slice/crio-65a4f7396745a7d35127667b4d2993aeeb099cc2bc40ce7bc67cb1bbe7737762 WatchSource:0}: Error finding container 65a4f7396745a7d35127667b4d2993aeeb099cc2bc40ce7bc67cb1bbe7737762: Status 404 returned error can't find the container with id 65a4f7396745a7d35127667b4d2993aeeb099cc2bc40ce7bc67cb1bbe7737762
Sep 19 15:16:15.138579 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:15.138549    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87hpj"]
Sep 19 15:16:15.141028 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:16:15.141001    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e954267_9310_40da_9df9_939865cb489a.slice/crio-47b4a0e5f6f6aca4527c87f85603a59a2477dcc59850c3393c5c07b2fccc0848 WatchSource:0}: Error finding container 47b4a0e5f6f6aca4527c87f85603a59a2477dcc59850c3393c5c07b2fccc0848: Status 404 returned error can't find the container with id 47b4a0e5f6f6aca4527c87f85603a59a2477dcc59850c3393c5c07b2fccc0848
Sep 19 15:16:15.199460 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:15.199427    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-p9bwc\" (UID: \"8925bba2-d5a0-4386-9ccc-9ef824dfd7bd\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc"
Sep 19 15:16:15.199630 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:15.199507    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8181741c-8615-4587-8457-18381d08e00c-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-dghnr\" (UID: \"8181741c-8615-4587-8457-18381d08e00c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-dghnr"
Sep 19 15:16:15.199630 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:15.199589    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 19 15:16:15.199724 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:15.199637    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-cluster-monitoring-operator-tls podName:8925bba2-d5a0-4386-9ccc-9ef824dfd7bd nodeName:}" failed. No retries permitted until 2026-09-19 15:16:16.199622862 +0000 UTC m=+251.088822553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-p9bwc" (UID: "8925bba2-d5a0-4386-9ccc-9ef824dfd7bd") : secret "cluster-monitoring-operator-tls" not found
Sep 19 15:16:15.199724 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:15.199651    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 19 15:16:15.199724 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:15.199697    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8181741c-8615-4587-8457-18381d08e00c-samples-operator-tls podName:8181741c-8615-4587-8457-18381d08e00c nodeName:}" failed. No retries permitted until 2026-09-19 15:16:16.199685288 +0000 UTC m=+251.088884978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8181741c-8615-4587-8457-18381d08e00c-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-dghnr" (UID: "8181741c-8615-4587-8457-18381d08e00c") : secret "samples-operator-tls" not found
Sep 19 15:16:15.231799 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:15.231773    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mjpvx"]
Sep 19 15:16:15.235401 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:16:15.235366    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode56103e3_9eb1_4204_bd40_b82464d93412.slice/crio-79cef861f2fbf663cbfc690bbf3cc72e2bd625ae94b9d16b316daa2a7b8fe93e WatchSource:0}: Error finding container 79cef861f2fbf663cbfc690bbf3cc72e2bd625ae94b9d16b316daa2a7b8fe93e: Status 404 returned error can't find the container with id 79cef861f2fbf663cbfc690bbf3cc72e2bd625ae94b9d16b316daa2a7b8fe93e
Sep 19 15:16:15.299957 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:15.299917    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-metrics-certs\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:15.300142 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:15.300032    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92c14079-3000-467d-8823-9a2c8d6c6730-service-ca-bundle\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:15.300142 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:15.300057    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 19 15:16:15.300142 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:15.300118    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-metrics-certs podName:92c14079-3000-467d-8823-9a2c8d6c6730 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:16.300102134 +0000 UTC m=+251.189301830 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-metrics-certs") pod "router-default-76d56ddb5b-flrvn" (UID: "92c14079-3000-467d-8823-9a2c8d6c6730") : secret "router-metrics-certs-default" not found
Sep 19 15:16:15.300271 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:15.300184    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92c14079-3000-467d-8823-9a2c8d6c6730-service-ca-bundle podName:92c14079-3000-467d-8823-9a2c8d6c6730 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:16.300169322 +0000 UTC m=+251.189369013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92c14079-3000-467d-8823-9a2c8d6c6730-service-ca-bundle") pod "router-default-76d56ddb5b-flrvn" (UID: "92c14079-3000-467d-8823-9a2c8d6c6730") : configmap references non-existent config key: service-ca.crt
Sep 19 15:16:15.405180 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:15.405098    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87hpj" event={"ID":"6e954267-9310-40da-9df9-939865cb489a","Type":"ContainerStarted","Data":"47b4a0e5f6f6aca4527c87f85603a59a2477dcc59850c3393c5c07b2fccc0848"}
Sep 19 15:16:15.406226 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:15.406197    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-g2qck" event={"ID":"9177bc4f-c634-4722-8a81-74946afb6a3d","Type":"ContainerStarted","Data":"6870c50b93af59fe59de2c6851651e6f307d672a8530ab8498a0c56ca72dd1ad"}
Sep 19 15:16:15.407255 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:15.407233    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8" event={"ID":"fc3705a0-4a6c-40a1-9233-776b60b77090","Type":"ContainerStarted","Data":"65a4f7396745a7d35127667b4d2993aeeb099cc2bc40ce7bc67cb1bbe7737762"}
Sep 19 15:16:15.408284 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:15.408261    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mjpvx" event={"ID":"e56103e3-9eb1-4204-bd40-b82464d93412","Type":"ContainerStarted","Data":"79cef861f2fbf663cbfc690bbf3cc72e2bd625ae94b9d16b316daa2a7b8fe93e"}
Sep 19 15:16:16.207913 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:16.207864    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8181741c-8615-4587-8457-18381d08e00c-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-dghnr\" (UID: \"8181741c-8615-4587-8457-18381d08e00c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-dghnr"
Sep 19 15:16:16.208388 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:16.208010    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-p9bwc\" (UID: \"8925bba2-d5a0-4386-9ccc-9ef824dfd7bd\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc"
Sep 19 15:16:16.208388 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:16.208164    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 19 15:16:16.208388 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:16.208228    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-cluster-monitoring-operator-tls podName:8925bba2-d5a0-4386-9ccc-9ef824dfd7bd nodeName:}" failed. No retries permitted until 2026-09-19 15:16:18.208208859 +0000 UTC m=+253.097408553 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-p9bwc" (UID: "8925bba2-d5a0-4386-9ccc-9ef824dfd7bd") : secret "cluster-monitoring-operator-tls" not found
Sep 19 15:16:16.208599 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:16.208391    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 19 15:16:16.208599 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:16.208447    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8181741c-8615-4587-8457-18381d08e00c-samples-operator-tls podName:8181741c-8615-4587-8457-18381d08e00c nodeName:}" failed. No retries permitted until 2026-09-19 15:16:18.208433298 +0000 UTC m=+253.097633003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8181741c-8615-4587-8457-18381d08e00c-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-dghnr" (UID: "8181741c-8615-4587-8457-18381d08e00c") : secret "samples-operator-tls" not found
Sep 19 15:16:16.308706 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:16.308662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-metrics-certs\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:16.308920 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:16.308779    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92c14079-3000-467d-8823-9a2c8d6c6730-service-ca-bundle\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:16.308920 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:16.308851    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 19 15:16:16.309050 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:16.308930    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-metrics-certs podName:92c14079-3000-467d-8823-9a2c8d6c6730 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:18.308912281 +0000 UTC m=+253.198111988 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-metrics-certs") pod "router-default-76d56ddb5b-flrvn" (UID: "92c14079-3000-467d-8823-9a2c8d6c6730") : secret "router-metrics-certs-default" not found
Sep 19 15:16:16.309050 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:16.308947    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92c14079-3000-467d-8823-9a2c8d6c6730-service-ca-bundle podName:92c14079-3000-467d-8823-9a2c8d6c6730 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:18.308939232 +0000 UTC m=+253.198138923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92c14079-3000-467d-8823-9a2c8d6c6730-service-ca-bundle") pod "router-default-76d56ddb5b-flrvn" (UID: "92c14079-3000-467d-8823-9a2c8d6c6730") : configmap references non-existent config key: service-ca.crt
Sep 19 15:16:17.517823 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:17.517775    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs\") pod \"network-metrics-daemon-ctzjp\" (UID: \"fc07702b-1393-4278-9027-3b4592ee57d4\") " pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:16:17.518317 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:17.517976    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 19 15:16:17.518317 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:17.518049    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs podName:fc07702b-1393-4278-9027-3b4592ee57d4 nodeName:}" failed. No retries permitted until 2026-09-19 15:18:19.518032095 +0000 UTC m=+374.407231786 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs") pod "network-metrics-daemon-ctzjp" (UID: "fc07702b-1393-4278-9027-3b4592ee57d4") : secret "metrics-daemon-secret" not found
Sep 19 15:16:18.224865 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:18.224825    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8181741c-8615-4587-8457-18381d08e00c-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-dghnr\" (UID: \"8181741c-8615-4587-8457-18381d08e00c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-dghnr"
Sep 19 15:16:18.225072 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:18.224986    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-p9bwc\" (UID: \"8925bba2-d5a0-4386-9ccc-9ef824dfd7bd\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc"
Sep 19 15:16:18.225146 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:18.225130    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 19 15:16:18.225201 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:18.225189    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-cluster-monitoring-operator-tls podName:8925bba2-d5a0-4386-9ccc-9ef824dfd7bd nodeName:}" failed. No retries permitted until 2026-09-19 15:16:22.225169054 +0000 UTC m=+257.114368762 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-p9bwc" (UID: "8925bba2-d5a0-4386-9ccc-9ef824dfd7bd") : secret "cluster-monitoring-operator-tls" not found
Sep 19 15:16:18.225478 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:18.225385    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 19 15:16:18.225478 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:18.225450    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8181741c-8615-4587-8457-18381d08e00c-samples-operator-tls podName:8181741c-8615-4587-8457-18381d08e00c nodeName:}" failed. No retries permitted until 2026-09-19 15:16:22.225433063 +0000 UTC m=+257.114632773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8181741c-8615-4587-8457-18381d08e00c-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-dghnr" (UID: "8181741c-8615-4587-8457-18381d08e00c") : secret "samples-operator-tls" not found
Sep 19 15:16:18.325563 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:18.325531    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-metrics-certs\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:18.325709 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:18.325631    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92c14079-3000-467d-8823-9a2c8d6c6730-service-ca-bundle\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:18.325750 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:18.325715    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 19 15:16:18.325810 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:18.325794    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-metrics-certs podName:92c14079-3000-467d-8823-9a2c8d6c6730 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:22.325774178 +0000 UTC m=+257.214973876 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-metrics-certs") pod "router-default-76d56ddb5b-flrvn" (UID: "92c14079-3000-467d-8823-9a2c8d6c6730") : secret "router-metrics-certs-default" not found
Sep 19 15:16:18.325865 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:18.325815    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92c14079-3000-467d-8823-9a2c8d6c6730-service-ca-bundle podName:92c14079-3000-467d-8823-9a2c8d6c6730 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:22.325806236 +0000 UTC m=+257.215005933 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92c14079-3000-467d-8823-9a2c8d6c6730-service-ca-bundle") pod "router-default-76d56ddb5b-flrvn" (UID: "92c14079-3000-467d-8823-9a2c8d6c6730") : configmap references non-existent config key: service-ca.crt
Sep 19 15:16:18.418764 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:18.418662    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87hpj" event={"ID":"6e954267-9310-40da-9df9-939865cb489a","Type":"ContainerStarted","Data":"106fae46c5f3464317505f6d9ce1efcbf0a6b51d86b582b7bcccf40356c6b8f1"}
Sep 19 15:16:18.420501 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:18.420480    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/0.log"
Sep 19 15:16:18.420642 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:18.420515    2563 generic.go:356] "Generic (PLEG): container finished" podID="9177bc4f-c634-4722-8a81-74946afb6a3d" containerID="5023b4afd268c4dbb66438e2c576ce5b012e1910400babb3de08b9259acbf1ed" exitCode=255
Sep 19 15:16:18.420642 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:18.420592    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-g2qck" event={"ID":"9177bc4f-c634-4722-8a81-74946afb6a3d","Type":"ContainerDied","Data":"5023b4afd268c4dbb66438e2c576ce5b012e1910400babb3de08b9259acbf1ed"}
Sep 19 15:16:18.420811 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:18.420793    2563 scope.go:117] "RemoveContainer" containerID="5023b4afd268c4dbb66438e2c576ce5b012e1910400babb3de08b9259acbf1ed"
Sep 19 15:16:18.422342 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:18.422305    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8" event={"ID":"fc3705a0-4a6c-40a1-9233-776b60b77090","Type":"ContainerStarted","Data":"d0f15db9730b6b1a447446c8af7cce00b19cd9dc5deb94ae85cd646e2c079cf8"}
Sep 19 15:16:18.426425 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:18.426337    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mjpvx" event={"ID":"e56103e3-9eb1-4204-bd40-b82464d93412","Type":"ContainerStarted","Data":"e2bf9e1219d2a69202d32d3d93a165cc6e197fc384a2c7324605c5a385cef1f3"}
Sep 19 15:16:18.434119 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:18.434075    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87hpj" podStartSLOduration=1.452280352 podStartE2EDuration="4.434059145s" totalImagesPullingTime="2.981778793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:16:18.433447378 +0000 UTC m=+253.322647115" watchObservedRunningTime="2026-09-19 15:16:18.434059145 +0000 UTC m=+253.323258881"
Sep 19 15:16:18.461013 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:18.460961    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8" podStartSLOduration=1.411802085 podStartE2EDuration="4.460941034s" totalImagesPullingTime="3.049138949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:16:18.46038955 +0000 UTC m=+253.349589266" watchObservedRunningTime="2026-09-19 15:16:18.460941034 +0000 UTC m=+253.350140748"
Sep 19 15:16:18.472832 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:18.472785    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mjpvx" podStartSLOduration=3.131097311 podStartE2EDuration="4.472772745s" totalImagesPullingTime="1.341675434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:16:18.471919139 +0000 UTC m=+253.361118854" watchObservedRunningTime="2026-09-19 15:16:18.472772745 +0000 UTC m=+253.361972475"
Sep 19 15:16:19.431697 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:19.431668    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/1.log"
Sep 19 15:16:19.432169 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:19.432143    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/0.log"
Sep 19 15:16:19.432234 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:19.432186    2563 generic.go:356] "Generic (PLEG): container finished" podID="9177bc4f-c634-4722-8a81-74946afb6a3d" containerID="cd31b658ca37ecaf78ea25e15338a40433b86a2a3557fd906230b5f68dfd6495" exitCode=255
Sep 19 15:16:19.432292 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:19.432260    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-g2qck" event={"ID":"9177bc4f-c634-4722-8a81-74946afb6a3d","Type":"ContainerDied","Data":"cd31b658ca37ecaf78ea25e15338a40433b86a2a3557fd906230b5f68dfd6495"}
Sep 19 15:16:19.432343 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:19.432326    2563 scope.go:117] "RemoveContainer" containerID="5023b4afd268c4dbb66438e2c576ce5b012e1910400babb3de08b9259acbf1ed"
Sep 19 15:16:19.432500 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:19.432471    2563 scope.go:117] "RemoveContainer" containerID="cd31b658ca37ecaf78ea25e15338a40433b86a2a3557fd906230b5f68dfd6495"
Sep 19 15:16:19.432702 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:19.432676    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-g2qck_openshift-console-operator(9177bc4f-c634-4722-8a81-74946afb6a3d)\"" pod="openshift-console-operator/console-operator-fd4bb46c-g2qck" podUID="9177bc4f-c634-4722-8a81-74946afb6a3d"
Sep 19 15:16:19.682539 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:19.682455    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-q4r9g"]
Sep 19 15:16:19.687019 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:19.686995    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-q4r9g"
Sep 19 15:16:19.688987 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:19.688966    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 19 15:16:19.689084 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:19.689068    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 19 15:16:19.689141 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:19.689124    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wrsd4\""
Sep 19 15:16:19.694911 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:19.694866    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-q4r9g"]
Sep 19 15:16:19.839133 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:19.839101    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b4wd\" (UniqueName: \"kubernetes.io/projected/2a62045b-6663-436f-871a-3597bc37718a-kube-api-access-5b4wd\") pod \"migrator-76794cbd6c-q4r9g\" (UID: \"2a62045b-6663-436f-871a-3597bc37718a\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-q4r9g"
Sep 19 15:16:19.867171 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:19.867143    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5kpc7"]
Sep 19 15:16:19.870644 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:19.870613    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:19.872607 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:19.872569    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 19 15:16:19.872754 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:19.872620    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 19 15:16:19.872754 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:19.872668    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tkfcq\""
Sep 19 15:16:19.880526 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:19.880492    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5kpc7"]
Sep 19 15:16:19.940019 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:19.939949    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b4wd\" (UniqueName: \"kubernetes.io/projected/2a62045b-6663-436f-871a-3597bc37718a-kube-api-access-5b4wd\") pod \"migrator-76794cbd6c-q4r9g\" (UID: \"2a62045b-6663-436f-871a-3597bc37718a\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-q4r9g"
Sep 19 15:16:19.947943 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:19.947921    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b4wd\" (UniqueName: \"kubernetes.io/projected/2a62045b-6663-436f-871a-3597bc37718a-kube-api-access-5b4wd\") pod \"migrator-76794cbd6c-q4r9g\" (UID: \"2a62045b-6663-436f-871a-3597bc37718a\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-q4r9g"
Sep 19 15:16:19.997201 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:19.997164    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-q4r9g"
Sep 19 15:16:20.040556 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:20.040525    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:20.040709 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:20.040597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v2kw\" (UniqueName: \"kubernetes.io/projected/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-kube-api-access-2v2kw\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:20.040709 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:20.040635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:20.040709 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:20.040678    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-crio-socket\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:20.040825 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:20.040732    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-data-volume\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:20.141759 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:20.141720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-data-volume\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:20.141967 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:20.141787    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:20.141967 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:20.141853    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v2kw\" (UniqueName: \"kubernetes.io/projected/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-kube-api-access-2v2kw\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:20.141967 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:20.141914    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:20.141967 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:20.141921    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 15:16:20.141967 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:20.141955    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-crio-socket\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:20.142195 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:20.141989    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-insights-runtime-extractor-tls podName:fd34628c-f7ee-45bd-bd7a-78cf975cdd59 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:20.641967856 +0000 UTC m=+255.531167564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5kpc7" (UID: "fd34628c-f7ee-45bd-bd7a-78cf975cdd59") : secret "insights-runtime-extractor-tls" not found
Sep 19 15:16:20.142195 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:20.142022    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 15:16:20.142195 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:20.142047    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-crio-socket\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:20.142195 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:20.142082    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-kube-rbac-proxy-cm podName:fd34628c-f7ee-45bd-bd7a-78cf975cdd59 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:20.642066509 +0000 UTC m=+255.531266205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5kpc7" (UID: "fd34628c-f7ee-45bd-bd7a-78cf975cdd59") : configmap "kube-rbac-proxy" not found
Sep 19 15:16:20.142195 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:20.142093    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-data-volume\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:20.151809 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:20.151782    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v2kw\" (UniqueName: \"kubernetes.io/projected/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-kube-api-access-2v2kw\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:20.263399 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:20.263323    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-q4r9g"]
Sep 19 15:16:20.266098 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:16:20.266069    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a62045b_6663_436f_871a_3597bc37718a.slice/crio-7452ab56284bd57b1607b029f2cc0d16bc33cb2f3e060bf5f2d60a0457453322 WatchSource:0}: Error finding container 7452ab56284bd57b1607b029f2cc0d16bc33cb2f3e060bf5f2d60a0457453322: Status 404 returned error can't find the container with id 7452ab56284bd57b1607b029f2cc0d16bc33cb2f3e060bf5f2d60a0457453322
Sep 19 15:16:20.436220 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:20.436178    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-q4r9g" event={"ID":"2a62045b-6663-436f-871a-3597bc37718a","Type":"ContainerStarted","Data":"7452ab56284bd57b1607b029f2cc0d16bc33cb2f3e060bf5f2d60a0457453322"}
Sep 19 15:16:20.437523 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:20.437506    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/1.log"
Sep 19 15:16:20.437813 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:20.437800    2563 scope.go:117] "RemoveContainer" containerID="cd31b658ca37ecaf78ea25e15338a40433b86a2a3557fd906230b5f68dfd6495"
Sep 19 15:16:20.437980 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:20.437963    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-g2qck_openshift-console-operator(9177bc4f-c634-4722-8a81-74946afb6a3d)\"" pod="openshift-console-operator/console-operator-fd4bb46c-g2qck" podUID="9177bc4f-c634-4722-8a81-74946afb6a3d"
Sep 19 15:16:20.646637 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:20.646548    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:20.646783 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:20.646658    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:20.646783 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:20.646669    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 15:16:20.646783 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:20.646725    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-kube-rbac-proxy-cm podName:fd34628c-f7ee-45bd-bd7a-78cf975cdd59 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:21.646709954 +0000 UTC m=+256.535909661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5kpc7" (UID: "fd34628c-f7ee-45bd-bd7a-78cf975cdd59") : configmap "kube-rbac-proxy" not found
Sep 19 15:16:20.646911 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:20.646797    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 15:16:20.646911 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:20.646850    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-insights-runtime-extractor-tls podName:fd34628c-f7ee-45bd-bd7a-78cf975cdd59 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:21.646836405 +0000 UTC m=+256.536036101 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5kpc7" (UID: "fd34628c-f7ee-45bd-bd7a-78cf975cdd59") : secret "insights-runtime-extractor-tls" not found
Sep 19 15:16:21.655055 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:21.655026    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:21.655500 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:21.655126    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:21.655500 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:21.655148    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 15:16:21.655500 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:21.655212    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-kube-rbac-proxy-cm podName:fd34628c-f7ee-45bd-bd7a-78cf975cdd59 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:23.655193534 +0000 UTC m=+258.544393230 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5kpc7" (UID: "fd34628c-f7ee-45bd-bd7a-78cf975cdd59") : configmap "kube-rbac-proxy" not found
Sep 19 15:16:21.655500 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:21.655281    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 15:16:21.655500 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:21.655318    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-insights-runtime-extractor-tls podName:fd34628c-f7ee-45bd-bd7a-78cf975cdd59 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:23.655309509 +0000 UTC m=+258.544509200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5kpc7" (UID: "fd34628c-f7ee-45bd-bd7a-78cf975cdd59") : secret "insights-runtime-extractor-tls" not found
Sep 19 15:16:22.260384 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:22.260342    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-p9bwc\" (UID: \"8925bba2-d5a0-4386-9ccc-9ef824dfd7bd\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc"
Sep 19 15:16:22.260531 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:22.260451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8181741c-8615-4587-8457-18381d08e00c-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-dghnr\" (UID: \"8181741c-8615-4587-8457-18381d08e00c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-dghnr"
Sep 19 15:16:22.260531 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:22.260509    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 19 15:16:22.260610 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:22.260582    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-cluster-monitoring-operator-tls podName:8925bba2-d5a0-4386-9ccc-9ef824dfd7bd nodeName:}" failed. No retries permitted until 2026-09-19 15:16:30.260564834 +0000 UTC m=+265.149764532 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-p9bwc" (UID: "8925bba2-d5a0-4386-9ccc-9ef824dfd7bd") : secret "cluster-monitoring-operator-tls" not found
Sep 19 15:16:22.260610 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:22.260595    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 19 15:16:22.260682 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:22.260647    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8181741c-8615-4587-8457-18381d08e00c-samples-operator-tls podName:8181741c-8615-4587-8457-18381d08e00c nodeName:}" failed. No retries permitted until 2026-09-19 15:16:30.260634863 +0000 UTC m=+265.149834586 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8181741c-8615-4587-8457-18381d08e00c-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-dghnr" (UID: "8181741c-8615-4587-8457-18381d08e00c") : secret "samples-operator-tls" not found
Sep 19 15:16:22.361064 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:22.361027    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-metrics-certs\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:22.361222 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:22.361138    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92c14079-3000-467d-8823-9a2c8d6c6730-service-ca-bundle\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:22.361222 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:22.361184    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 19 15:16:22.361288 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:22.361250    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-metrics-certs podName:92c14079-3000-467d-8823-9a2c8d6c6730 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:30.361236188 +0000 UTC m=+265.250435879 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-metrics-certs") pod "router-default-76d56ddb5b-flrvn" (UID: "92c14079-3000-467d-8823-9a2c8d6c6730") : secret "router-metrics-certs-default" not found
Sep 19 15:16:22.361334 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:22.361286    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92c14079-3000-467d-8823-9a2c8d6c6730-service-ca-bundle podName:92c14079-3000-467d-8823-9a2c8d6c6730 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:30.361270508 +0000 UTC m=+265.250470199 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92c14079-3000-467d-8823-9a2c8d6c6730-service-ca-bundle") pod "router-default-76d56ddb5b-flrvn" (UID: "92c14079-3000-467d-8823-9a2c8d6c6730") : configmap references non-existent config key: service-ca.crt
Sep 19 15:16:22.447651 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:22.447610    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-q4r9g" event={"ID":"2a62045b-6663-436f-871a-3597bc37718a","Type":"ContainerStarted","Data":"1f77c7e2d1f8d09ab56c1e455e444934ea690e89494683e69f5ace50d47b3b90"}
Sep 19 15:16:22.447812 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:22.447672    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-q4r9g" event={"ID":"2a62045b-6663-436f-871a-3597bc37718a","Type":"ContainerStarted","Data":"a62f64f09dae8c5a0eb98d75ae5d549bc287a64f361e53bdd70f17db6a1e5bce"}
Sep 19 15:16:22.844224 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:22.844198    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kpxxp_fad92208-d2d8-4b9d-bb3b-8b7b4bef3220/dns-node-resolver/0.log"
Sep 19 15:16:23.643250 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:23.643225    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sxpzd_5057e7a5-e158-4b18-acad-f53613c707c0/node-ca/0.log"
Sep 19 15:16:23.674044 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:23.674003    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:23.674193 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:23.674127    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 15:16:23.674193 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:23.674183    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-kube-rbac-proxy-cm podName:fd34628c-f7ee-45bd-bd7a-78cf975cdd59 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:27.674167384 +0000 UTC m=+262.563367109 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5kpc7" (UID: "fd34628c-f7ee-45bd-bd7a-78cf975cdd59") : configmap "kube-rbac-proxy" not found
Sep 19 15:16:23.674193 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:23.674128    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:23.674443 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:23.674213    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 15:16:23.674443 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:23.674270    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-insights-runtime-extractor-tls podName:fd34628c-f7ee-45bd-bd7a-78cf975cdd59 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:27.674254897 +0000 UTC m=+262.563454590 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5kpc7" (UID: "fd34628c-f7ee-45bd-bd7a-78cf975cdd59") : secret "insights-runtime-extractor-tls" not found
Sep 19 15:16:24.243730 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:24.243704    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-42lfw_a29dd07f-cdb8-4df8-9b5c-a3993af1bebf/serve-healthcheck-canary/0.log"
Sep 19 15:16:24.779994 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:24.779959    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-g2qck"
Sep 19 15:16:24.780176 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:24.780014    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-g2qck"
Sep 19 15:16:24.780403 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:24.780384    2563 scope.go:117] "RemoveContainer" containerID="cd31b658ca37ecaf78ea25e15338a40433b86a2a3557fd906230b5f68dfd6495"
Sep 19 15:16:24.780580 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:24.780550    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-g2qck_openshift-console-operator(9177bc4f-c634-4722-8a81-74946afb6a3d)\"" pod="openshift-console-operator/console-operator-fd4bb46c-g2qck" podUID="9177bc4f-c634-4722-8a81-74946afb6a3d"
Sep 19 15:16:24.844458 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:24.844429    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-q4r9g_2a62045b-6663-436f-871a-3597bc37718a/migrator/0.log"
Sep 19 15:16:25.044423 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:25.044339    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-q4r9g_2a62045b-6663-436f-871a-3597bc37718a/graceful-termination/0.log"
Sep 19 15:16:25.245138 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:25.245087    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-87hpj_6e954267-9310-40da-9df9-939865cb489a/kube-storage-version-migrator-operator/0.log"
Sep 19 15:16:27.708715 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:27.708627    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:27.709147 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:27.708742    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 15:16:27.709147 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:27.708770    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:27.709147 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:27.708800    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-kube-rbac-proxy-cm podName:fd34628c-f7ee-45bd-bd7a-78cf975cdd59 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:35.708786163 +0000 UTC m=+270.597985854 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5kpc7" (UID: "fd34628c-f7ee-45bd-bd7a-78cf975cdd59") : configmap "kube-rbac-proxy" not found
Sep 19 15:16:27.709147 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:27.708870    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 15:16:27.709147 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:27.708961    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-insights-runtime-extractor-tls podName:fd34628c-f7ee-45bd-bd7a-78cf975cdd59 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:35.708943925 +0000 UTC m=+270.598143635 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5kpc7" (UID: "fd34628c-f7ee-45bd-bd7a-78cf975cdd59") : secret "insights-runtime-extractor-tls" not found
Sep 19 15:16:30.330730 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:30.330686    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-p9bwc\" (UID: \"8925bba2-d5a0-4386-9ccc-9ef824dfd7bd\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc"
Sep 19 15:16:30.331241 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:30.330806    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8181741c-8615-4587-8457-18381d08e00c-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-dghnr\" (UID: \"8181741c-8615-4587-8457-18381d08e00c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-dghnr"
Sep 19 15:16:30.331241 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:30.330856    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 19 15:16:30.331241 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:30.330955    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-cluster-monitoring-operator-tls podName:8925bba2-d5a0-4386-9ccc-9ef824dfd7bd nodeName:}" failed. No retries permitted until 2026-09-19 15:16:46.33093574 +0000 UTC m=+281.220135431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-p9bwc" (UID: "8925bba2-d5a0-4386-9ccc-9ef824dfd7bd") : secret "cluster-monitoring-operator-tls" not found
Sep 19 15:16:30.333459 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:30.333431    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8181741c-8615-4587-8457-18381d08e00c-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-dghnr\" (UID: \"8181741c-8615-4587-8457-18381d08e00c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-dghnr"
Sep 19 15:16:30.386846 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:30.386810    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-dghnr"
Sep 19 15:16:30.432550 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:30.432408    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92c14079-3000-467d-8823-9a2c8d6c6730-service-ca-bundle\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:30.432550 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:30.432545    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-metrics-certs\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:30.432694 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:30.432656    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92c14079-3000-467d-8823-9a2c8d6c6730-service-ca-bundle podName:92c14079-3000-467d-8823-9a2c8d6c6730 nodeName:}" failed. No retries permitted until 2026-09-19 15:16:46.432632612 +0000 UTC m=+281.321832305 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92c14079-3000-467d-8823-9a2c8d6c6730-service-ca-bundle") pod "router-default-76d56ddb5b-flrvn" (UID: "92c14079-3000-467d-8823-9a2c8d6c6730") : configmap references non-existent config key: service-ca.crt
Sep 19 15:16:30.435545 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:30.435374    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c14079-3000-467d-8823-9a2c8d6c6730-metrics-certs\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:30.653984 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:30.653865    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-q4r9g" podStartSLOduration=10.474138194 podStartE2EDuration="11.653847351s" totalImagesPullingTime="1.179709157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:16:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:16:22.462566979 +0000 UTC m=+257.351766713" watchObservedRunningTime="2026-09-19 15:16:30.653847351 +0000 UTC m=+265.543047063"
Sep 19 15:16:30.654736 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:30.654712    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-dghnr"]
Sep 19 15:16:31.481369 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:31.481326    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-dghnr" event={"ID":"8181741c-8615-4587-8457-18381d08e00c","Type":"ContainerStarted","Data":"c115c57099e2bcfbd32c42e3d1939d681add7f749f28f0a9fdd214e7da668ed5"}
Sep 19 15:16:32.486444 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:32.486408    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-dghnr" event={"ID":"8181741c-8615-4587-8457-18381d08e00c","Type":"ContainerStarted","Data":"03abc6ef73f8f3ad01b1ca11d755ab088bb3f5affc1b961ccd3d925b1eeab201"}
Sep 19 15:16:32.486785 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:32.486460    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-dghnr" event={"ID":"8181741c-8615-4587-8457-18381d08e00c","Type":"ContainerStarted","Data":"d71fd735215dff0a634b3df2f58dbfaa2c9fed2c35852462c7425657e30c50eb"}
Sep 19 15:16:32.499769 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:32.499717    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-dghnr" podStartSLOduration=16.930030451 podStartE2EDuration="18.499697175s" totalImagesPullingTime="1.569666724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:16:32.499399209 +0000 UTC m=+267.388598904" watchObservedRunningTime="2026-09-19 15:16:32.499697175 +0000 UTC m=+267.388896888"
Sep 19 15:16:35.779856 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:35.779820    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:35.780289 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:35.779887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:35.780375 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:35.780357    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:35.782172 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:35.782141    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd34628c-f7ee-45bd-bd7a-78cf975cdd59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5kpc7\" (UID: \"fd34628c-f7ee-45bd-bd7a-78cf975cdd59\") " pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:36.080367 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:36.080280    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5kpc7"
Sep 19 15:16:36.353355 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:36.353275    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5kpc7"]
Sep 19 15:16:36.356116 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:16:36.356089    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd34628c_f7ee_45bd_bd7a_78cf975cdd59.slice/crio-2adfbc0ed7f92cf9a52eebc2c8e2be3135bb631e0ff58dd4c818998735f64ae2 WatchSource:0}: Error finding container 2adfbc0ed7f92cf9a52eebc2c8e2be3135bb631e0ff58dd4c818998735f64ae2: Status 404 returned error can't find the container with id 2adfbc0ed7f92cf9a52eebc2c8e2be3135bb631e0ff58dd4c818998735f64ae2
Sep 19 15:16:36.499382 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:36.499337    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5kpc7" event={"ID":"fd34628c-f7ee-45bd-bd7a-78cf975cdd59","Type":"ContainerStarted","Data":"f414f704dda1682245a628785ebc8d5cea74c1607bada2038435c270cb682f41"}
Sep 19 15:16:36.499556 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:36.499406    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5kpc7" event={"ID":"fd34628c-f7ee-45bd-bd7a-78cf975cdd59","Type":"ContainerStarted","Data":"2adfbc0ed7f92cf9a52eebc2c8e2be3135bb631e0ff58dd4c818998735f64ae2"}
Sep 19 15:16:37.504884 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:37.504845    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5kpc7" event={"ID":"fd34628c-f7ee-45bd-bd7a-78cf975cdd59","Type":"ContainerStarted","Data":"5c0beced1593348b51fe8b267835a260e92aa6a166d1a45e6f131c1cd1e66e8b"}
Sep 19 15:16:38.509806 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:38.509773    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5kpc7" event={"ID":"fd34628c-f7ee-45bd-bd7a-78cf975cdd59","Type":"ContainerStarted","Data":"56d52c84cb5d2be7b208b95169249aa73fb74ac818281444c13af517a4b37af6"}
Sep 19 15:16:38.525661 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:38.525616    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5kpc7" podStartSLOduration=17.871730986 podStartE2EDuration="19.525600011s" totalImagesPullingTime="1.653869025s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:16:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:16:38.524918815 +0000 UTC m=+273.414118524" watchObservedRunningTime="2026-09-19 15:16:38.525600011 +0000 UTC m=+273.414799723"
Sep 19 15:16:39.635503 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:39.635474    2563 scope.go:117] "RemoveContainer" containerID="cd31b658ca37ecaf78ea25e15338a40433b86a2a3557fd906230b5f68dfd6495"
Sep 19 15:16:40.519409 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:40.519374    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/1.log"
Sep 19 15:16:40.519566 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:40.519429    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-g2qck" event={"ID":"9177bc4f-c634-4722-8a81-74946afb6a3d","Type":"ContainerStarted","Data":"0fa18c054ca3983e088d74a5df0b72324973dc45dfaa4271c1d390bbde5ba18d"}
Sep 19 15:16:40.519723 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:40.519701    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-g2qck"
Sep 19 15:16:40.535516 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:40.535470    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-g2qck" podStartSLOduration=23.471786421 podStartE2EDuration="26.535454671s" totalImagesPullingTime="3.06366825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:16:40.533862017 +0000 UTC m=+275.423061730" watchObservedRunningTime="2026-09-19 15:16:40.535454671 +0000 UTC m=+275.424654384"
Sep 19 15:16:40.815641 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:40.815570    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-g2qck"
Sep 19 15:16:46.367258 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:46.367218    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-p9bwc\" (UID: \"8925bba2-d5a0-4386-9ccc-9ef824dfd7bd\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc"
Sep 19 15:16:46.369724 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:46.369700    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8925bba2-d5a0-4386-9ccc-9ef824dfd7bd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-p9bwc\" (UID: \"8925bba2-d5a0-4386-9ccc-9ef824dfd7bd\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc"
Sep 19 15:16:46.467814 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:46.467782    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92c14079-3000-467d-8823-9a2c8d6c6730-service-ca-bundle\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:46.468348 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:46.468329    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92c14079-3000-467d-8823-9a2c8d6c6730-service-ca-bundle\") pod \"router-default-76d56ddb5b-flrvn\" (UID: \"92c14079-3000-467d-8823-9a2c8d6c6730\") " pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:46.570574 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:46.570530    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc"
Sep 19 15:16:46.679157 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:46.679124    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:46.840872 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:46.840756    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc"]
Sep 19 15:16:46.843042 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:16:46.842986    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8925bba2_d5a0_4386_9ccc_9ef824dfd7bd.slice/crio-7f7f6b72df6b03e73ba66e751ce8eca2c4780bb8e262add8b8c3b85cc1e1433a WatchSource:0}: Error finding container 7f7f6b72df6b03e73ba66e751ce8eca2c4780bb8e262add8b8c3b85cc1e1433a: Status 404 returned error can't find the container with id 7f7f6b72df6b03e73ba66e751ce8eca2c4780bb8e262add8b8c3b85cc1e1433a
Sep 19 15:16:46.947608 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:46.947489    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76d56ddb5b-flrvn"]
Sep 19 15:16:46.949956 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:16:46.949935    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c14079_3000_467d_8823_9a2c8d6c6730.slice/crio-adedd04545349540d11ec83c630cd48caf62693eb1e00c257813aff1d53205b7 WatchSource:0}: Error finding container adedd04545349540d11ec83c630cd48caf62693eb1e00c257813aff1d53205b7: Status 404 returned error can't find the container with id adedd04545349540d11ec83c630cd48caf62693eb1e00c257813aff1d53205b7
Sep 19 15:16:47.542126 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:47.542090    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76d56ddb5b-flrvn" event={"ID":"92c14079-3000-467d-8823-9a2c8d6c6730","Type":"ContainerStarted","Data":"5adb2789a7188317bffaaf849761d1e5173fce0741b18013b39b07c3696d6444"}
Sep 19 15:16:47.542541 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:47.542189    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76d56ddb5b-flrvn" event={"ID":"92c14079-3000-467d-8823-9a2c8d6c6730","Type":"ContainerStarted","Data":"adedd04545349540d11ec83c630cd48caf62693eb1e00c257813aff1d53205b7"}
Sep 19 15:16:47.543364 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:47.543343    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc" event={"ID":"8925bba2-d5a0-4386-9ccc-9ef824dfd7bd","Type":"ContainerStarted","Data":"7f7f6b72df6b03e73ba66e751ce8eca2c4780bb8e262add8b8c3b85cc1e1433a"}
Sep 19 15:16:47.558983 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:47.558936    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-76d56ddb5b-flrvn" podStartSLOduration=33.558921844 podStartE2EDuration="33.558921844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:16:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:16:47.557569589 +0000 UTC m=+282.446769315" watchObservedRunningTime="2026-09-19 15:16:47.558921844 +0000 UTC m=+282.448121550"
Sep 19 15:16:47.679650 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:47.679617    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:47.682720 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:47.682699    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:48.202681 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:48.202632    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw" podUID="e5fee3ed-19c1-4c0c-9006-4524c20d9ed8"
Sep 19 15:16:48.202681 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:48.202655    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-przrv" podUID="fea819f6-340a-495e-9a03-f9c11485c8e7"
Sep 19 15:16:48.202949 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:16:48.202651    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz" podUID="a57ee30d-5eee-4cf5-aa2b-85197a177068"
Sep 19 15:16:48.548636 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:48.548600    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw"
Sep 19 15:16:48.548636 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:48.548605    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-przrv"
Sep 19 15:16:48.548636 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:48.548601    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc" event={"ID":"8925bba2-d5a0-4386-9ccc-9ef824dfd7bd","Type":"ContainerStarted","Data":"4b9bacf1ee926d5451399149a532b346a5180902fb97482f8c2077daca29eeb9"}
Sep 19 15:16:48.549236 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:48.548852    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:16:48.549286 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:48.549253    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:48.550019 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:48.550004    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-76d56ddb5b-flrvn"
Sep 19 15:16:48.562496 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:48.562445    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-p9bwc" podStartSLOduration=32.955843724 podStartE2EDuration="34.562431697s" totalImagesPullingTime="1.606587973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:16:48.56134941 +0000 UTC m=+283.450549125" watchObservedRunningTime="2026-09-19 15:16:48.562431697 +0000 UTC m=+283.451631413"
Sep 19 15:16:51.412590 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:51.412555    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls\") pod \"dns-default-przrv\" (UID: \"fea819f6-340a-495e-9a03-f9c11485c8e7\") " pod="openshift-dns/dns-default-przrv"
Sep 19 15:16:51.412985 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:51.412621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-9kjxw\" (UID: \"e5fee3ed-19c1-4c0c-9006-4524c20d9ed8\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw"
Sep 19 15:16:51.412985 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:51.412656    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:16:51.415225 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:51.415198    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fea819f6-340a-495e-9a03-f9c11485c8e7-metrics-tls\") pod \"dns-default-przrv\" (UID: \"fea819f6-340a-495e-9a03-f9c11485c8e7\") " pod="openshift-dns/dns-default-przrv"
Sep 19 15:16:51.415280 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:51.415209    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls\") pod \"image-registry-7dfc5587d8-dbhkz\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") " pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:16:51.415280 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:51.415211    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5fee3ed-19c1-4c0c-9006-4524c20d9ed8-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-9kjxw\" (UID: \"e5fee3ed-19c1-4c0c-9006-4524c20d9ed8\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw"
Sep 19 15:16:51.552057 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:51.552023    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p4wjr\""
Sep 19 15:16:51.552057 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:51.552023    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zjpxs\""
Sep 19 15:16:51.552296 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:51.552023    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xbxpb\""
Sep 19 15:16:51.559723 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:51.559701    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw"
Sep 19 15:16:51.559812 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:51.559727    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-przrv"
Sep 19 15:16:51.559812 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:51.559747    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:16:51.865978 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:51.865945    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw"]
Sep 19 15:16:51.868793 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:16:51.868764    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5fee3ed_19c1_4c0c_9006_4524c20d9ed8.slice/crio-c8834ba4ee97f17a1687263be3640fb123c6bf030ca5e5a71c33355c55d9569a WatchSource:0}: Error finding container c8834ba4ee97f17a1687263be3640fb123c6bf030ca5e5a71c33355c55d9569a: Status 404 returned error can't find the container with id c8834ba4ee97f17a1687263be3640fb123c6bf030ca5e5a71c33355c55d9569a
Sep 19 15:16:51.893703 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:51.893678    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-przrv"]
Sep 19 15:16:51.897029 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:16:51.897005    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfea819f6_340a_495e_9a03_f9c11485c8e7.slice/crio-19d185ddfb6af385fc755bf0b32742378b34ea0948665248e7ef375b150572af WatchSource:0}: Error finding container 19d185ddfb6af385fc755bf0b32742378b34ea0948665248e7ef375b150572af: Status 404 returned error can't find the container with id 19d185ddfb6af385fc755bf0b32742378b34ea0948665248e7ef375b150572af
Sep 19 15:16:51.926401 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:51.926383    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dfc5587d8-dbhkz"]
Sep 19 15:16:51.928315 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:16:51.928286    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda57ee30d_5eee_4cf5_aa2b_85197a177068.slice/crio-418a2e86893fcc4ad2633c9557184fdc8192b5bc42e156727e423c8ecdf7af69 WatchSource:0}: Error finding container 418a2e86893fcc4ad2633c9557184fdc8192b5bc42e156727e423c8ecdf7af69: Status 404 returned error can't find the container with id 418a2e86893fcc4ad2633c9557184fdc8192b5bc42e156727e423c8ecdf7af69
Sep 19 15:16:52.566259 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:52.566179    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw" event={"ID":"e5fee3ed-19c1-4c0c-9006-4524c20d9ed8","Type":"ContainerStarted","Data":"c8834ba4ee97f17a1687263be3640fb123c6bf030ca5e5a71c33355c55d9569a"}
Sep 19 15:16:52.569141 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:52.569059    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz" event={"ID":"a57ee30d-5eee-4cf5-aa2b-85197a177068","Type":"ContainerStarted","Data":"1e31ce25631a1130f574e6ea4b2127b5c8322e8fa5b29b4badf0565adee0a62e"}
Sep 19 15:16:52.569141 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:52.569109    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz" event={"ID":"a57ee30d-5eee-4cf5-aa2b-85197a177068","Type":"ContainerStarted","Data":"418a2e86893fcc4ad2633c9557184fdc8192b5bc42e156727e423c8ecdf7af69"}
Sep 19 15:16:52.569360 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:52.569288    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:16:52.570557 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:52.570530    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-przrv" event={"ID":"fea819f6-340a-495e-9a03-f9c11485c8e7","Type":"ContainerStarted","Data":"19d185ddfb6af385fc755bf0b32742378b34ea0948665248e7ef375b150572af"}
Sep 19 15:16:52.588063 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:52.588002    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz" podStartSLOduration=286.587979917 podStartE2EDuration="4m46.587979917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:12:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:16:52.58672548 +0000 UTC m=+287.475925194" watchObservedRunningTime="2026-09-19 15:16:52.587979917 +0000 UTC m=+287.477179633"
Sep 19 15:16:54.580160 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:54.580131    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-przrv" event={"ID":"fea819f6-340a-495e-9a03-f9c11485c8e7","Type":"ContainerStarted","Data":"3ff7b724650577e6107c7755b642b66d8cd89e0a947d6f33ef4b6a5db2f5c193"}
Sep 19 15:16:54.581701 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:54.581656    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw" event={"ID":"e5fee3ed-19c1-4c0c-9006-4524c20d9ed8","Type":"ContainerStarted","Data":"45606377dac46ad0f1b58715eaccfa0bde22d7821545aa9876b1318e7915ad59"}
Sep 19 15:16:54.596538 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:54.596491    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-9kjxw" podStartSLOduration=279.413801955 podStartE2EDuration="4m41.596474055s" totalImagesPullingTime="2.1826721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:16:54.595581632 +0000 UTC m=+289.484781345" watchObservedRunningTime="2026-09-19 15:16:54.596474055 +0000 UTC m=+289.485673767"
Sep 19 15:16:55.586389 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:55.586348    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-przrv" event={"ID":"fea819f6-340a-495e-9a03-f9c11485c8e7","Type":"ContainerStarted","Data":"b910784315a4c7f39f2c41c0e0cd1636f728b8a5f2e56a6e84ed388958ebe73f"}
Sep 19 15:16:55.601433 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:55.601385    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-przrv" podStartSLOduration=252.074182717 podStartE2EDuration="4m14.601369336s" totalImagesPullingTime="2.527186619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:16:55.599922455 +0000 UTC m=+290.489122167" watchObservedRunningTime="2026-09-19 15:16:55.601369336 +0000 UTC m=+290.490569048"
Sep 19 15:16:56.589303 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:16:56.589272    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-przrv"
Sep 19 15:17:02.635783 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:17:02.635743    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ctzjp" podUID="fc07702b-1393-4278-9027-3b4592ee57d4"
Sep 19 15:17:04.971154 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:04.971120    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-x4hm2"]
Sep 19 15:17:04.975522 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:04.975503    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-x4hm2"
Sep 19 15:17:04.977325 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:04.977292    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 19 15:17:04.977429 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:04.977306    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-m5mtk\""
Sep 19 15:17:04.978032 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:04.978013    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 19 15:17:04.978128 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:04.978038    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 19 15:17:04.983489 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:04.983468    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-x4hm2"]
Sep 19 15:17:05.122769 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:05.122729    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acb4fb7b-aab4-4e1d-9442-b8439354e5c7-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-x4hm2\" (UID: \"acb4fb7b-aab4-4e1d-9442-b8439354e5c7\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-x4hm2"
Sep 19 15:17:05.122955 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:05.122785    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/acb4fb7b-aab4-4e1d-9442-b8439354e5c7-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-x4hm2\" (UID: \"acb4fb7b-aab4-4e1d-9442-b8439354e5c7\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-x4hm2"
Sep 19 15:17:05.122955 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:05.122868    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acb4fb7b-aab4-4e1d-9442-b8439354e5c7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-x4hm2\" (UID: \"acb4fb7b-aab4-4e1d-9442-b8439354e5c7\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-x4hm2"
Sep 19 15:17:05.122955 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:05.122939    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24vsg\" (UniqueName: \"kubernetes.io/projected/acb4fb7b-aab4-4e1d-9442-b8439354e5c7-kube-api-access-24vsg\") pod \"prometheus-operator-7bd5d56d6-x4hm2\" (UID: \"acb4fb7b-aab4-4e1d-9442-b8439354e5c7\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-x4hm2"
Sep 19 15:17:05.223630 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:05.223548    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/acb4fb7b-aab4-4e1d-9442-b8439354e5c7-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-x4hm2\" (UID: \"acb4fb7b-aab4-4e1d-9442-b8439354e5c7\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-x4hm2"
Sep 19 15:17:05.223630 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:05.223593    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acb4fb7b-aab4-4e1d-9442-b8439354e5c7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-x4hm2\" (UID: \"acb4fb7b-aab4-4e1d-9442-b8439354e5c7\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-x4hm2"
Sep 19 15:17:05.223630 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:05.223624    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24vsg\" (UniqueName: \"kubernetes.io/projected/acb4fb7b-aab4-4e1d-9442-b8439354e5c7-kube-api-access-24vsg\") pod \"prometheus-operator-7bd5d56d6-x4hm2\" (UID: \"acb4fb7b-aab4-4e1d-9442-b8439354e5c7\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-x4hm2"
Sep 19 15:17:05.223833 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:05.223644    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acb4fb7b-aab4-4e1d-9442-b8439354e5c7-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-x4hm2\" (UID: \"acb4fb7b-aab4-4e1d-9442-b8439354e5c7\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-x4hm2"
Sep 19 15:17:05.224412 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:05.224298    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acb4fb7b-aab4-4e1d-9442-b8439354e5c7-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-x4hm2\" (UID: \"acb4fb7b-aab4-4e1d-9442-b8439354e5c7\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-x4hm2"
Sep 19 15:17:05.226076 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:05.226053    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/acb4fb7b-aab4-4e1d-9442-b8439354e5c7-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-x4hm2\" (UID: \"acb4fb7b-aab4-4e1d-9442-b8439354e5c7\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-x4hm2"
Sep 19 15:17:05.226161 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:05.226113    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acb4fb7b-aab4-4e1d-9442-b8439354e5c7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-x4hm2\" (UID: \"acb4fb7b-aab4-4e1d-9442-b8439354e5c7\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-x4hm2"
Sep 19 15:17:05.231580 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:05.231556    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24vsg\" (UniqueName: \"kubernetes.io/projected/acb4fb7b-aab4-4e1d-9442-b8439354e5c7-kube-api-access-24vsg\") pod \"prometheus-operator-7bd5d56d6-x4hm2\" (UID: \"acb4fb7b-aab4-4e1d-9442-b8439354e5c7\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-x4hm2"
Sep 19 15:17:05.285446 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:05.285421    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-x4hm2"
Sep 19 15:17:05.514696 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:05.514624    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/1.log"
Sep 19 15:17:05.514829 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:05.514709    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/1.log"
Sep 19 15:17:05.524371 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:05.524348    2563 kubelet.go:1648] "Image garbage collection succeeded"
Sep 19 15:17:05.556275 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:05.556241    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-x4hm2"]
Sep 19 15:17:05.558798 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:17:05.558776    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacb4fb7b_aab4_4e1d_9442_b8439354e5c7.slice/crio-5929ed1ce9fdaec4d88da44234850ddab3f76dccccf8be776652e4eeef300f15 WatchSource:0}: Error finding container 5929ed1ce9fdaec4d88da44234850ddab3f76dccccf8be776652e4eeef300f15: Status 404 returned error can't find the container with id 5929ed1ce9fdaec4d88da44234850ddab3f76dccccf8be776652e4eeef300f15
Sep 19 15:17:05.622020 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:05.621856    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-x4hm2" event={"ID":"acb4fb7b-aab4-4e1d-9442-b8439354e5c7","Type":"ContainerStarted","Data":"5929ed1ce9fdaec4d88da44234850ddab3f76dccccf8be776652e4eeef300f15"}
Sep 19 15:17:06.594792 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:06.594764    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-przrv"
Sep 19 15:17:07.630969 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:07.630933    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-x4hm2" event={"ID":"acb4fb7b-aab4-4e1d-9442-b8439354e5c7","Type":"ContainerStarted","Data":"8c55f34642df6bf7a8e31165aebeb4718fe256b44b0a364c21456e80d35326a0"}
Sep 19 15:17:07.631378 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:07.631023    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-x4hm2" event={"ID":"acb4fb7b-aab4-4e1d-9442-b8439354e5c7","Type":"ContainerStarted","Data":"6ef6c47cc4665cfb6d4b4e36399c03f8a8f6d01b5ce236816fb8dbde2fd74a07"}
Sep 19 15:17:07.645664 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:07.645618    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-x4hm2" podStartSLOduration=2.442894697 podStartE2EDuration="3.64560086s" totalImagesPullingTime="1.202706163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:17:07.644068353 +0000 UTC m=+302.533268059" watchObservedRunningTime="2026-09-19 15:17:07.64560086 +0000 UTC m=+302.534800572"
Sep 19 15:17:09.326749 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.326708    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9l5jm"]
Sep 19 15:17:09.330464 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.330443    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.332444 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.332405    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 19 15:17:09.332444 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.332421    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 19 15:17:09.332444 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.332410    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 19 15:17:09.332619 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.332509    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w8ll2\""
Sep 19 15:17:09.458823 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.458784    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwsrr\" (UniqueName: \"kubernetes.io/projected/821d59ce-9fad-436d-b71c-bbeaaec11fb3-kube-api-access-vwsrr\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.458823 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.458832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/821d59ce-9fad-436d-b71c-bbeaaec11fb3-root\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.459085 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.458921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/821d59ce-9fad-436d-b71c-bbeaaec11fb3-node-exporter-accelerators-collector-config\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.459085 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.458951    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/821d59ce-9fad-436d-b71c-bbeaaec11fb3-node-exporter-tls\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.459085 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.458992    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/821d59ce-9fad-436d-b71c-bbeaaec11fb3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.459085 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.459023    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/821d59ce-9fad-436d-b71c-bbeaaec11fb3-sys\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.459085 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.459054    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/821d59ce-9fad-436d-b71c-bbeaaec11fb3-metrics-client-ca\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.459332 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.459114    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/821d59ce-9fad-436d-b71c-bbeaaec11fb3-node-exporter-textfile\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.459332 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.459145    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/821d59ce-9fad-436d-b71c-bbeaaec11fb3-node-exporter-wtmp\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.560511 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.560482    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/821d59ce-9fad-436d-b71c-bbeaaec11fb3-sys\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.560679 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.560519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/821d59ce-9fad-436d-b71c-bbeaaec11fb3-metrics-client-ca\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.560679 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.560544    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/821d59ce-9fad-436d-b71c-bbeaaec11fb3-node-exporter-textfile\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.560679 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.560614    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/821d59ce-9fad-436d-b71c-bbeaaec11fb3-sys\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.560679 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.560668    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/821d59ce-9fad-436d-b71c-bbeaaec11fb3-node-exporter-wtmp\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.560911 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.560705    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwsrr\" (UniqueName: \"kubernetes.io/projected/821d59ce-9fad-436d-b71c-bbeaaec11fb3-kube-api-access-vwsrr\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.560911 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.560732    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/821d59ce-9fad-436d-b71c-bbeaaec11fb3-root\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.560911 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.560799    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/821d59ce-9fad-436d-b71c-bbeaaec11fb3-node-exporter-accelerators-collector-config\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.560911 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.560828    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/821d59ce-9fad-436d-b71c-bbeaaec11fb3-node-exporter-tls\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.560911 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.560846    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/821d59ce-9fad-436d-b71c-bbeaaec11fb3-node-exporter-textfile\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.560911 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.560859    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/821d59ce-9fad-436d-b71c-bbeaaec11fb3-node-exporter-wtmp\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.560911 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.560874    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/821d59ce-9fad-436d-b71c-bbeaaec11fb3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.560911 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.560867    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/821d59ce-9fad-436d-b71c-bbeaaec11fb3-root\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.561377 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.561326    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/821d59ce-9fad-436d-b71c-bbeaaec11fb3-node-exporter-accelerators-collector-config\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.561497 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.561456    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/821d59ce-9fad-436d-b71c-bbeaaec11fb3-metrics-client-ca\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.563380 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.563359    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/821d59ce-9fad-436d-b71c-bbeaaec11fb3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.563523 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.563504    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/821d59ce-9fad-436d-b71c-bbeaaec11fb3-node-exporter-tls\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.567850 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.567814    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwsrr\" (UniqueName: \"kubernetes.io/projected/821d59ce-9fad-436d-b71c-bbeaaec11fb3-kube-api-access-vwsrr\") pod \"node-exporter-9l5jm\" (UID: \"821d59ce-9fad-436d-b71c-bbeaaec11fb3\") " pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.639313 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.639238    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9l5jm"
Sep 19 15:17:09.650714 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:17:09.650688    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod821d59ce_9fad_436d_b71c_bbeaaec11fb3.slice/crio-4d2467ff5a967e3fc1adc71c83577ec8d27a935456b7f96a0706e08decb46c5a WatchSource:0}: Error finding container 4d2467ff5a967e3fc1adc71c83577ec8d27a935456b7f96a0706e08decb46c5a: Status 404 returned error can't find the container with id 4d2467ff5a967e3fc1adc71c83577ec8d27a935456b7f96a0706e08decb46c5a
Sep 19 15:17:09.652407 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:09.652390    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 15:17:10.643607 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:10.643576    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9l5jm" event={"ID":"821d59ce-9fad-436d-b71c-bbeaaec11fb3","Type":"ContainerStarted","Data":"4d2467ff5a967e3fc1adc71c83577ec8d27a935456b7f96a0706e08decb46c5a"}
Sep 19 15:17:11.564030 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:11.563997    2563 patch_prober.go:28] interesting pod/image-registry-7dfc5587d8-dbhkz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 19 15:17:11.564188 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:11.564045    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz" podUID="a57ee30d-5eee-4cf5-aa2b-85197a177068" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 15:17:11.647758 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:11.647723    2563 generic.go:356] "Generic (PLEG): container finished" podID="821d59ce-9fad-436d-b71c-bbeaaec11fb3" containerID="7a0958edfb649761036bfb75d4cd7f6b56d02aebad596571790a36e6def7c533" exitCode=0
Sep 19 15:17:11.648146 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:11.647797    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9l5jm" event={"ID":"821d59ce-9fad-436d-b71c-bbeaaec11fb3","Type":"ContainerDied","Data":"7a0958edfb649761036bfb75d4cd7f6b56d02aebad596571790a36e6def7c533"}
Sep 19 15:17:12.000435 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:12.000402    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dfc5587d8-dbhkz"]
Sep 19 15:17:12.005138 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:12.005107    2563 patch_prober.go:28] interesting pod/image-registry-7dfc5587d8-dbhkz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 19 15:17:12.005327 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:12.005155    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz" podUID="a57ee30d-5eee-4cf5-aa2b-85197a177068" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 15:17:12.653506 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:12.653478    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9l5jm" event={"ID":"821d59ce-9fad-436d-b71c-bbeaaec11fb3","Type":"ContainerStarted","Data":"da6b7150acd884f4538d13fc82c46ddf3804beeba0e0bbb0c2715bb4dbd00809"}
Sep 19 15:17:12.653932 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:12.653526    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9l5jm" event={"ID":"821d59ce-9fad-436d-b71c-bbeaaec11fb3","Type":"ContainerStarted","Data":"65ce795cb0c32232bed061415e450399ae0ec79a643c19f502600f4406e1f21e"}
Sep 19 15:17:12.670878 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:12.670829    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9l5jm" podStartSLOduration=2.575925063 podStartE2EDuration="3.670813451s" totalImagesPullingTime="1.026618228s" totalInitContainerRuntime="68.27016ms" isStatefulPod=true podCreationTimestamp="2026-09-19 15:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:17:12.66940561 +0000 UTC m=+307.558605334" watchObservedRunningTime="2026-09-19 15:17:12.670813451 +0000 UTC m=+307.560013164"
Sep 19 15:17:15.640802 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:15.640775    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:17:22.004841 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:22.004812    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:17:24.698283 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:24.698247    2563 generic.go:356] "Generic (PLEG): container finished" podID="fc3705a0-4a6c-40a1-9233-776b60b77090" containerID="d0f15db9730b6b1a447446c8af7cce00b19cd9dc5deb94ae85cd646e2c079cf8" exitCode=0
Sep 19 15:17:24.698651 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:24.698290    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8" event={"ID":"fc3705a0-4a6c-40a1-9233-776b60b77090","Type":"ContainerDied","Data":"d0f15db9730b6b1a447446c8af7cce00b19cd9dc5deb94ae85cd646e2c079cf8"}
Sep 19 15:17:24.698651 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:24.698610    2563 scope.go:117] "RemoveContainer" containerID="d0f15db9730b6b1a447446c8af7cce00b19cd9dc5deb94ae85cd646e2c079cf8"
Sep 19 15:17:25.705395 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:25.705363    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-fz6j8" event={"ID":"fc3705a0-4a6c-40a1-9233-776b60b77090","Type":"ContainerStarted","Data":"07450f8d03789334440da45a2f3162b7d70f8415f4d03be0b5cdd6fe872cdb09"}
Sep 19 15:17:37.022321 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.022272    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz" podUID="a57ee30d-5eee-4cf5-aa2b-85197a177068" containerName="registry" containerID="cri-o://1e31ce25631a1130f574e6ea4b2127b5c8322e8fa5b29b4badf0565adee0a62e" gracePeriod=30
Sep 19 15:17:37.300227 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.300152    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:17:37.396224 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.396192    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgqpq\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-kube-api-access-jgqpq\") pod \"a57ee30d-5eee-4cf5-aa2b-85197a177068\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") "
Sep 19 15:17:37.396224 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.396225    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-bound-sa-token\") pod \"a57ee30d-5eee-4cf5-aa2b-85197a177068\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") "
Sep 19 15:17:37.396475 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.396248    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a57ee30d-5eee-4cf5-aa2b-85197a177068-ca-trust-extracted\") pod \"a57ee30d-5eee-4cf5-aa2b-85197a177068\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") "
Sep 19 15:17:37.396475 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.396285    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a57ee30d-5eee-4cf5-aa2b-85197a177068-installation-pull-secrets\") pod \"a57ee30d-5eee-4cf5-aa2b-85197a177068\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") "
Sep 19 15:17:37.396475 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.396314    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a57ee30d-5eee-4cf5-aa2b-85197a177068-image-registry-private-configuration\") pod \"a57ee30d-5eee-4cf5-aa2b-85197a177068\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") "
Sep 19 15:17:37.396475 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.396352    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-certificates\") pod \"a57ee30d-5eee-4cf5-aa2b-85197a177068\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") "
Sep 19 15:17:37.396475 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.396394    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a57ee30d-5eee-4cf5-aa2b-85197a177068-trusted-ca\") pod \"a57ee30d-5eee-4cf5-aa2b-85197a177068\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") "
Sep 19 15:17:37.396475 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.396465    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls\") pod \"a57ee30d-5eee-4cf5-aa2b-85197a177068\" (UID: \"a57ee30d-5eee-4cf5-aa2b-85197a177068\") "
Sep 19 15:17:37.397255 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.396881    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a57ee30d-5eee-4cf5-aa2b-85197a177068-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a57ee30d-5eee-4cf5-aa2b-85197a177068" (UID: "a57ee30d-5eee-4cf5-aa2b-85197a177068"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:17:37.397255 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.397208    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a57ee30d-5eee-4cf5-aa2b-85197a177068" (UID: "a57ee30d-5eee-4cf5-aa2b-85197a177068"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:17:37.399430 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.399392    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a57ee30d-5eee-4cf5-aa2b-85197a177068-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a57ee30d-5eee-4cf5-aa2b-85197a177068" (UID: "a57ee30d-5eee-4cf5-aa2b-85197a177068"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:17:37.399550 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.399422    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-kube-api-access-jgqpq" (OuterVolumeSpecName: "kube-api-access-jgqpq") pod "a57ee30d-5eee-4cf5-aa2b-85197a177068" (UID: "a57ee30d-5eee-4cf5-aa2b-85197a177068"). InnerVolumeSpecName "kube-api-access-jgqpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:17:37.399550 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.399540    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a57ee30d-5eee-4cf5-aa2b-85197a177068-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a57ee30d-5eee-4cf5-aa2b-85197a177068" (UID: "a57ee30d-5eee-4cf5-aa2b-85197a177068"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:17:37.399803 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.399779    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a57ee30d-5eee-4cf5-aa2b-85197a177068" (UID: "a57ee30d-5eee-4cf5-aa2b-85197a177068"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:17:37.399938 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.399921    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a57ee30d-5eee-4cf5-aa2b-85197a177068" (UID: "a57ee30d-5eee-4cf5-aa2b-85197a177068"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:17:37.407203 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.407181    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a57ee30d-5eee-4cf5-aa2b-85197a177068-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a57ee30d-5eee-4cf5-aa2b-85197a177068" (UID: "a57ee30d-5eee-4cf5-aa2b-85197a177068"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:17:37.497808 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.497771    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a57ee30d-5eee-4cf5-aa2b-85197a177068-trusted-ca\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:17:37.498075 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.498058    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-tls\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:17:37.498183 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.498161    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgqpq\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-kube-api-access-jgqpq\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:17:37.498183 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.498183    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a57ee30d-5eee-4cf5-aa2b-85197a177068-bound-sa-token\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:17:37.498327 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.498198    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a57ee30d-5eee-4cf5-aa2b-85197a177068-ca-trust-extracted\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:17:37.498327 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.498210    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a57ee30d-5eee-4cf5-aa2b-85197a177068-installation-pull-secrets\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:17:37.498327 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.498223    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a57ee30d-5eee-4cf5-aa2b-85197a177068-image-registry-private-configuration\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:17:37.498327 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.498236    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a57ee30d-5eee-4cf5-aa2b-85197a177068-registry-certificates\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:17:37.749106 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.749070    2563 generic.go:356] "Generic (PLEG): container finished" podID="a57ee30d-5eee-4cf5-aa2b-85197a177068" containerID="1e31ce25631a1130f574e6ea4b2127b5c8322e8fa5b29b4badf0565adee0a62e" exitCode=0
Sep 19 15:17:37.749433 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.749112    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz"
Sep 19 15:17:37.749433 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.749151    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz" event={"ID":"a57ee30d-5eee-4cf5-aa2b-85197a177068","Type":"ContainerDied","Data":"1e31ce25631a1130f574e6ea4b2127b5c8322e8fa5b29b4badf0565adee0a62e"}
Sep 19 15:17:37.749433 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.749206    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dfc5587d8-dbhkz" event={"ID":"a57ee30d-5eee-4cf5-aa2b-85197a177068","Type":"ContainerDied","Data":"418a2e86893fcc4ad2633c9557184fdc8192b5bc42e156727e423c8ecdf7af69"}
Sep 19 15:17:37.749433 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.749232    2563 scope.go:117] "RemoveContainer" containerID="1e31ce25631a1130f574e6ea4b2127b5c8322e8fa5b29b4badf0565adee0a62e"
Sep 19 15:17:37.758369 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.758330    2563 scope.go:117] "RemoveContainer" containerID="1e31ce25631a1130f574e6ea4b2127b5c8322e8fa5b29b4badf0565adee0a62e"
Sep 19 15:17:37.758628 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:17:37.758606    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e31ce25631a1130f574e6ea4b2127b5c8322e8fa5b29b4badf0565adee0a62e\": container with ID starting with 1e31ce25631a1130f574e6ea4b2127b5c8322e8fa5b29b4badf0565adee0a62e not found: ID does not exist" containerID="1e31ce25631a1130f574e6ea4b2127b5c8322e8fa5b29b4badf0565adee0a62e"
Sep 19 15:17:37.758699 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.758636    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e31ce25631a1130f574e6ea4b2127b5c8322e8fa5b29b4badf0565adee0a62e"} err="failed to get container status \"1e31ce25631a1130f574e6ea4b2127b5c8322e8fa5b29b4badf0565adee0a62e\": rpc error: code = NotFound desc = could not find container \"1e31ce25631a1130f574e6ea4b2127b5c8322e8fa5b29b4badf0565adee0a62e\": container with ID starting with 1e31ce25631a1130f574e6ea4b2127b5c8322e8fa5b29b4badf0565adee0a62e not found: ID does not exist"
Sep 19 15:17:37.765025 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.764976    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dfc5587d8-dbhkz"]
Sep 19 15:17:37.768313 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:37.768285    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7dfc5587d8-dbhkz"]
Sep 19 15:17:39.639448 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:39.639418    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a57ee30d-5eee-4cf5-aa2b-85197a177068" path="/var/lib/kubelet/pods/a57ee30d-5eee-4cf5-aa2b-85197a177068/volumes"
Sep 19 15:17:54.815958 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:54.815920    2563 generic.go:356] "Generic (PLEG): container finished" podID="6e954267-9310-40da-9df9-939865cb489a" containerID="106fae46c5f3464317505f6d9ce1efcbf0a6b51d86b582b7bcccf40356c6b8f1" exitCode=0
Sep 19 15:17:54.816442 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:54.815994    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87hpj" event={"ID":"6e954267-9310-40da-9df9-939865cb489a","Type":"ContainerDied","Data":"106fae46c5f3464317505f6d9ce1efcbf0a6b51d86b582b7bcccf40356c6b8f1"}
Sep 19 15:17:54.816442 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:54.816310    2563 scope.go:117] "RemoveContainer" containerID="106fae46c5f3464317505f6d9ce1efcbf0a6b51d86b582b7bcccf40356c6b8f1"
Sep 19 15:17:55.821341 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:17:55.821309    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-87hpj" event={"ID":"6e954267-9310-40da-9df9-939865cb489a","Type":"ContainerStarted","Data":"c26211003cdfa5241bafffef25c0b3cb8e7287d87c7e5ee39c94ca47664c9a5b"}
Sep 19 15:18:19.528948 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:18:19.528911    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs\") pod \"network-metrics-daemon-ctzjp\" (UID: \"fc07702b-1393-4278-9027-3b4592ee57d4\") " pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:18:19.531393 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:18:19.531371    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc07702b-1393-4278-9027-3b4592ee57d4-metrics-certs\") pod \"network-metrics-daemon-ctzjp\" (UID: \"fc07702b-1393-4278-9027-3b4592ee57d4\") " pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:18:19.544141 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:18:19.544117    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fxxj8\""
Sep 19 15:18:19.552519 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:18:19.552502    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctzjp"
Sep 19 15:18:19.824359 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:18:19.824279    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ctzjp"]
Sep 19 15:18:19.828355 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:18:19.828329    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc07702b_1393_4278_9027_3b4592ee57d4.slice/crio-aea2ff9c4e622eb45fcba02ab9c27d37479c3139ceefc97403c98b0d0a5c9cd4 WatchSource:0}: Error finding container aea2ff9c4e622eb45fcba02ab9c27d37479c3139ceefc97403c98b0d0a5c9cd4: Status 404 returned error can't find the container with id aea2ff9c4e622eb45fcba02ab9c27d37479c3139ceefc97403c98b0d0a5c9cd4
Sep 19 15:18:19.906680 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:18:19.906642    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ctzjp" event={"ID":"fc07702b-1393-4278-9027-3b4592ee57d4","Type":"ContainerStarted","Data":"aea2ff9c4e622eb45fcba02ab9c27d37479c3139ceefc97403c98b0d0a5c9cd4"}
Sep 19 15:18:20.913147 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:18:20.913116    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ctzjp" event={"ID":"fc07702b-1393-4278-9027-3b4592ee57d4","Type":"ContainerStarted","Data":"526b8d8f3a1b9abbffa1218b56eaf766ac43f3541e3a6e7f12fc8ae08b43d0a7"}
Sep 19 15:18:21.918478 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:18:21.918444    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ctzjp" event={"ID":"fc07702b-1393-4278-9027-3b4592ee57d4","Type":"ContainerStarted","Data":"df2012ec028282d524b0e7ee47359f83ea1ad5e41e5a3e73b39300d766188516"}
Sep 19 15:18:21.932914 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:18:21.932856    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ctzjp" podStartSLOduration=374.943785175 podStartE2EDuration="6m15.932838777s" totalImagesPullingTime="989.053602ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:18:21.931215734 +0000 UTC m=+376.820415459" watchObservedRunningTime="2026-09-19 15:18:21.932838777 +0000 UTC m=+376.822038490"
Sep 19 15:20:40.502020 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:40.501984    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87"]
Sep 19 15:20:40.502463 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:40.502255    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a57ee30d-5eee-4cf5-aa2b-85197a177068" containerName="registry"
Sep 19 15:20:40.502463 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:40.502265    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a57ee30d-5eee-4cf5-aa2b-85197a177068" containerName="registry"
Sep 19 15:20:40.502463 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:40.502308    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a57ee30d-5eee-4cf5-aa2b-85197a177068" containerName="registry"
Sep 19 15:20:40.505196 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:40.505179    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87"
Sep 19 15:20:40.507413 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:40.507386    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 19 15:20:40.507537 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:40.507452    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 19 15:20:40.507537 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:40.507465    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cmsdb\""
Sep 19 15:20:40.513005 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:40.512977    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87"]
Sep 19 15:20:40.531875 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:40.531852    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kznrx\" (UniqueName: \"kubernetes.io/projected/22c42707-dad8-40f9-a588-e4380580a508-kube-api-access-kznrx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87\" (UID: \"22c42707-dad8-40f9-a588-e4380580a508\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87"
Sep 19 15:20:40.532015 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:40.531947    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22c42707-dad8-40f9-a588-e4380580a508-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87\" (UID: \"22c42707-dad8-40f9-a588-e4380580a508\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87"
Sep 19 15:20:40.532079 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:40.532025    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22c42707-dad8-40f9-a588-e4380580a508-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87\" (UID: \"22c42707-dad8-40f9-a588-e4380580a508\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87"
Sep 19 15:20:40.632800 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:40.632765    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22c42707-dad8-40f9-a588-e4380580a508-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87\" (UID: \"22c42707-dad8-40f9-a588-e4380580a508\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87"
Sep 19 15:20:40.633011 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:40.632821    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22c42707-dad8-40f9-a588-e4380580a508-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87\" (UID: \"22c42707-dad8-40f9-a588-e4380580a508\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87"
Sep 19 15:20:40.633011 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:40.632858    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kznrx\" (UniqueName: \"kubernetes.io/projected/22c42707-dad8-40f9-a588-e4380580a508-kube-api-access-kznrx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87\" (UID: \"22c42707-dad8-40f9-a588-e4380580a508\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87"
Sep 19 15:20:40.633220 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:40.633194    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22c42707-dad8-40f9-a588-e4380580a508-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87\" (UID: \"22c42707-dad8-40f9-a588-e4380580a508\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87"
Sep 19 15:20:40.633277 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:40.633207    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22c42707-dad8-40f9-a588-e4380580a508-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87\" (UID: \"22c42707-dad8-40f9-a588-e4380580a508\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87"
Sep 19 15:20:40.640907 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:40.640871    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kznrx\" (UniqueName: \"kubernetes.io/projected/22c42707-dad8-40f9-a588-e4380580a508-kube-api-access-kznrx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87\" (UID: \"22c42707-dad8-40f9-a588-e4380580a508\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87"
Sep 19 15:20:40.814672 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:40.814588    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87"
Sep 19 15:20:41.085419 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:41.085326    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87"]
Sep 19 15:20:41.087978 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:20:41.087949    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22c42707_dad8_40f9_a588_e4380580a508.slice/crio-3fca9435384f91576a474dff70b8c334fc533e098ef74c6731144302265ea93b WatchSource:0}: Error finding container 3fca9435384f91576a474dff70b8c334fc533e098ef74c6731144302265ea93b: Status 404 returned error can't find the container with id 3fca9435384f91576a474dff70b8c334fc533e098ef74c6731144302265ea93b
Sep 19 15:20:41.414414 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:41.414329    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87" event={"ID":"22c42707-dad8-40f9-a588-e4380580a508","Type":"ContainerStarted","Data":"3fca9435384f91576a474dff70b8c334fc533e098ef74c6731144302265ea93b"}
Sep 19 15:20:47.440180 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:47.440146    2563 generic.go:356] "Generic (PLEG): container finished" podID="22c42707-dad8-40f9-a588-e4380580a508" containerID="4d5b2fea6e66ec711d035f6281e55dc9eccc693451a3294a6cc11d86315e0bf8" exitCode=0
Sep 19 15:20:47.440571 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:47.440223    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87" event={"ID":"22c42707-dad8-40f9-a588-e4380580a508","Type":"ContainerDied","Data":"4d5b2fea6e66ec711d035f6281e55dc9eccc693451a3294a6cc11d86315e0bf8"}
Sep 19 15:20:50.454400 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:50.454366    2563 generic.go:356] "Generic (PLEG): container finished" podID="22c42707-dad8-40f9-a588-e4380580a508" containerID="db9aaaff9ce29610a8c89f9c3902692e766118ce3631658a44b4a6d0cdb884fa" exitCode=0
Sep 19 15:20:50.454771 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:50.454442    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87" event={"ID":"22c42707-dad8-40f9-a588-e4380580a508","Type":"ContainerDied","Data":"db9aaaff9ce29610a8c89f9c3902692e766118ce3631658a44b4a6d0cdb884fa"}
Sep 19 15:20:57.484953 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:57.484915    2563 generic.go:356] "Generic (PLEG): container finished" podID="22c42707-dad8-40f9-a588-e4380580a508" containerID="66d800a16a2531110f38de707b1e1a1f2f92c168f7a8cedc16a8fe108a2b7834" exitCode=0
Sep 19 15:20:57.485358 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:57.484971    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87" event={"ID":"22c42707-dad8-40f9-a588-e4380580a508","Type":"ContainerDied","Data":"66d800a16a2531110f38de707b1e1a1f2f92c168f7a8cedc16a8fe108a2b7834"}
Sep 19 15:20:58.617020 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:58.616995    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87"
Sep 19 15:20:58.688388 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:58.688353    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22c42707-dad8-40f9-a588-e4380580a508-util\") pod \"22c42707-dad8-40f9-a588-e4380580a508\" (UID: \"22c42707-dad8-40f9-a588-e4380580a508\") "
Sep 19 15:20:58.688388 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:58.688390    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22c42707-dad8-40f9-a588-e4380580a508-bundle\") pod \"22c42707-dad8-40f9-a588-e4380580a508\" (UID: \"22c42707-dad8-40f9-a588-e4380580a508\") "
Sep 19 15:20:58.688587 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:58.688433    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kznrx\" (UniqueName: \"kubernetes.io/projected/22c42707-dad8-40f9-a588-e4380580a508-kube-api-access-kznrx\") pod \"22c42707-dad8-40f9-a588-e4380580a508\" (UID: \"22c42707-dad8-40f9-a588-e4380580a508\") "
Sep 19 15:20:58.689073 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:58.689042    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22c42707-dad8-40f9-a588-e4380580a508-bundle" (OuterVolumeSpecName: "bundle") pod "22c42707-dad8-40f9-a588-e4380580a508" (UID: "22c42707-dad8-40f9-a588-e4380580a508"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:20:58.690762 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:58.690730    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22c42707-dad8-40f9-a588-e4380580a508-kube-api-access-kznrx" (OuterVolumeSpecName: "kube-api-access-kznrx") pod "22c42707-dad8-40f9-a588-e4380580a508" (UID: "22c42707-dad8-40f9-a588-e4380580a508"). InnerVolumeSpecName "kube-api-access-kznrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:20:58.693268 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:58.693245    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22c42707-dad8-40f9-a588-e4380580a508-util" (OuterVolumeSpecName: "util") pod "22c42707-dad8-40f9-a588-e4380580a508" (UID: "22c42707-dad8-40f9-a588-e4380580a508"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:20:58.789300 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:58.789202    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22c42707-dad8-40f9-a588-e4380580a508-util\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:20:58.789300 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:58.789245    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22c42707-dad8-40f9-a588-e4380580a508-bundle\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:20:58.789300 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:58.789256    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kznrx\" (UniqueName: \"kubernetes.io/projected/22c42707-dad8-40f9-a588-e4380580a508-kube-api-access-kznrx\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:20:59.493954 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:59.493919    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87" event={"ID":"22c42707-dad8-40f9-a588-e4380580a508","Type":"ContainerDied","Data":"3fca9435384f91576a474dff70b8c334fc533e098ef74c6731144302265ea93b"}
Sep 19 15:20:59.494106 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:59.493960    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754058g87"
Sep 19 15:20:59.494106 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:20:59.493977    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3fca9435384f91576a474dff70b8c334fc533e098ef74c6731144302265ea93b"
Sep 19 15:21:03.422951 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:03.422916    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5r2vs"]
Sep 19 15:21:03.423306 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:03.423188    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22c42707-dad8-40f9-a588-e4380580a508" containerName="pull"
Sep 19 15:21:03.423306 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:03.423200    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="22c42707-dad8-40f9-a588-e4380580a508" containerName="pull"
Sep 19 15:21:03.423306 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:03.423218    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22c42707-dad8-40f9-a588-e4380580a508" containerName="extract"
Sep 19 15:21:03.423306 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:03.423223    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="22c42707-dad8-40f9-a588-e4380580a508" containerName="extract"
Sep 19 15:21:03.423306 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:03.423231    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22c42707-dad8-40f9-a588-e4380580a508" containerName="util"
Sep 19 15:21:03.423306 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:03.423237    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="22c42707-dad8-40f9-a588-e4380580a508" containerName="util"
Sep 19 15:21:03.423306 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:03.423284    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="22c42707-dad8-40f9-a588-e4380580a508" containerName="extract"
Sep 19 15:21:03.458779 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:03.458747    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5r2vs"]
Sep 19 15:21:03.458935 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:03.458850    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5r2vs"
Sep 19 15:21:03.461416 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:03.461389    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 19 15:21:03.461547 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:03.461395    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vczmd\""
Sep 19 15:21:03.461547 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:03.461430    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 19 15:21:03.628007 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:03.627976    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d592909-b237-4434-94a5-beafd96d99bb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5r2vs\" (UID: \"9d592909-b237-4434-94a5-beafd96d99bb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5r2vs"
Sep 19 15:21:03.628180 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:03.628034    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fls9h\" (UniqueName: \"kubernetes.io/projected/9d592909-b237-4434-94a5-beafd96d99bb-kube-api-access-fls9h\") pod \"cert-manager-operator-controller-manager-55c444bf86-5r2vs\" (UID: \"9d592909-b237-4434-94a5-beafd96d99bb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5r2vs"
Sep 19 15:21:03.728593 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:03.728565    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d592909-b237-4434-94a5-beafd96d99bb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5r2vs\" (UID: \"9d592909-b237-4434-94a5-beafd96d99bb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5r2vs"
Sep 19 15:21:03.728746 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:03.728633    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fls9h\" (UniqueName: \"kubernetes.io/projected/9d592909-b237-4434-94a5-beafd96d99bb-kube-api-access-fls9h\") pod \"cert-manager-operator-controller-manager-55c444bf86-5r2vs\" (UID: \"9d592909-b237-4434-94a5-beafd96d99bb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5r2vs"
Sep 19 15:21:03.728946 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:03.728928    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d592909-b237-4434-94a5-beafd96d99bb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5r2vs\" (UID: \"9d592909-b237-4434-94a5-beafd96d99bb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5r2vs"
Sep 19 15:21:03.737858 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:03.737835    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fls9h\" (UniqueName: \"kubernetes.io/projected/9d592909-b237-4434-94a5-beafd96d99bb-kube-api-access-fls9h\") pod \"cert-manager-operator-controller-manager-55c444bf86-5r2vs\" (UID: \"9d592909-b237-4434-94a5-beafd96d99bb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5r2vs"
Sep 19 15:21:03.767814 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:03.767787    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5r2vs"
Sep 19 15:21:04.054487 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:04.054414    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5r2vs"]
Sep 19 15:21:04.059265 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:21:04.059233    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d592909_b237_4434_94a5_beafd96d99bb.slice/crio-34993dd067bd65882f8960b44f7a9a1c55800fac2f9742ec7d3ce4ec4d671554 WatchSource:0}: Error finding container 34993dd067bd65882f8960b44f7a9a1c55800fac2f9742ec7d3ce4ec4d671554: Status 404 returned error can't find the container with id 34993dd067bd65882f8960b44f7a9a1c55800fac2f9742ec7d3ce4ec4d671554
Sep 19 15:21:04.515625 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:04.515590    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5r2vs" event={"ID":"9d592909-b237-4434-94a5-beafd96d99bb","Type":"ContainerStarted","Data":"34993dd067bd65882f8960b44f7a9a1c55800fac2f9742ec7d3ce4ec4d671554"}
Sep 19 15:21:06.525491 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:06.525451    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5r2vs" event={"ID":"9d592909-b237-4434-94a5-beafd96d99bb","Type":"ContainerStarted","Data":"b0096933c7a17e1dcbc3bfee861b100c595165d6fbb62e1aaf1333e30044b072"}
Sep 19 15:21:06.541791 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:06.541735    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5r2vs" podStartSLOduration=1.5194702260000001 podStartE2EDuration="3.54172145s" totalImagesPullingTime="2.022251224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:21:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:21:06.54129371 +0000 UTC m=+541.430493423" watchObservedRunningTime="2026-09-19 15:21:06.54172145 +0000 UTC m=+541.430921164"
Sep 19 15:21:07.209155 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.209122    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls"]
Sep 19 15:21:07.227713 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.227687    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls"]
Sep 19 15:21:07.227873 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.227802    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls"
Sep 19 15:21:07.230126 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.230087    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 19 15:21:07.230240 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.230131    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 19 15:21:07.230759 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.230730    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cmsdb\""
Sep 19 15:21:07.360549 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.360513    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0b9326a-6cca-4541-b515-b8055c577941-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls\" (UID: \"f0b9326a-6cca-4541-b515-b8055c577941\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls"
Sep 19 15:21:07.360549 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.360552    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0b9326a-6cca-4541-b515-b8055c577941-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls\" (UID: \"f0b9326a-6cca-4541-b515-b8055c577941\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls"
Sep 19 15:21:07.360748 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.360635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j944\" (UniqueName: \"kubernetes.io/projected/f0b9326a-6cca-4541-b515-b8055c577941-kube-api-access-6j944\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls\" (UID: \"f0b9326a-6cca-4541-b515-b8055c577941\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls"
Sep 19 15:21:07.450303 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.450271    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2l7kl"]
Sep 19 15:21:07.461376 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.461305    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0b9326a-6cca-4541-b515-b8055c577941-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls\" (UID: \"f0b9326a-6cca-4541-b515-b8055c577941\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls"
Sep 19 15:21:07.461560 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.461406    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j944\" (UniqueName: \"kubernetes.io/projected/f0b9326a-6cca-4541-b515-b8055c577941-kube-api-access-6j944\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls\" (UID: \"f0b9326a-6cca-4541-b515-b8055c577941\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls"
Sep 19 15:21:07.461560 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.461449    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0b9326a-6cca-4541-b515-b8055c577941-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls\" (UID: \"f0b9326a-6cca-4541-b515-b8055c577941\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls"
Sep 19 15:21:07.461776 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.461752    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0b9326a-6cca-4541-b515-b8055c577941-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls\" (UID: \"f0b9326a-6cca-4541-b515-b8055c577941\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls"
Sep 19 15:21:07.461852 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.461783    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0b9326a-6cca-4541-b515-b8055c577941-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls\" (UID: \"f0b9326a-6cca-4541-b515-b8055c577941\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls"
Sep 19 15:21:07.469123 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.469092    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j944\" (UniqueName: \"kubernetes.io/projected/f0b9326a-6cca-4541-b515-b8055c577941-kube-api-access-6j944\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls\" (UID: \"f0b9326a-6cca-4541-b515-b8055c577941\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls"
Sep 19 15:21:07.471347 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.471329    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2l7kl"]
Sep 19 15:21:07.471421 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.471408    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2l7kl"
Sep 19 15:21:07.473410 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.473388    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-29vdp\""
Sep 19 15:21:07.473639 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.473623    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 19 15:21:07.473687 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.473626    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 19 15:21:07.537268 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.537240    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls"
Sep 19 15:21:07.562594 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.562568    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74576fe8-86d8-4576-a664-8790d60cede6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2l7kl\" (UID: \"74576fe8-86d8-4576-a664-8790d60cede6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2l7kl"
Sep 19 15:21:07.562683 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.562608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w2x4\" (UniqueName: \"kubernetes.io/projected/74576fe8-86d8-4576-a664-8790d60cede6-kube-api-access-2w2x4\") pod \"cert-manager-webhook-6486ffd997-2l7kl\" (UID: \"74576fe8-86d8-4576-a664-8790d60cede6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2l7kl"
Sep 19 15:21:07.663143 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.663107    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74576fe8-86d8-4576-a664-8790d60cede6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2l7kl\" (UID: \"74576fe8-86d8-4576-a664-8790d60cede6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2l7kl"
Sep 19 15:21:07.663300 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.663152    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w2x4\" (UniqueName: \"kubernetes.io/projected/74576fe8-86d8-4576-a664-8790d60cede6-kube-api-access-2w2x4\") pod \"cert-manager-webhook-6486ffd997-2l7kl\" (UID: \"74576fe8-86d8-4576-a664-8790d60cede6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2l7kl"
Sep 19 15:21:07.678489 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.678455    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74576fe8-86d8-4576-a664-8790d60cede6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2l7kl\" (UID: \"74576fe8-86d8-4576-a664-8790d60cede6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2l7kl"
Sep 19 15:21:07.678653 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.678629    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w2x4\" (UniqueName: \"kubernetes.io/projected/74576fe8-86d8-4576-a664-8790d60cede6-kube-api-access-2w2x4\") pod \"cert-manager-webhook-6486ffd997-2l7kl\" (UID: \"74576fe8-86d8-4576-a664-8790d60cede6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2l7kl"
Sep 19 15:21:07.795571 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.795485    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2l7kl"
Sep 19 15:21:07.817501 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:07.817459    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls"]
Sep 19 15:21:07.821510 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:21:07.821484    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b9326a_6cca_4541_b515_b8055c577941.slice/crio-d0fad832cc11de26464fb696202b28bc0249ef46db548afaab31dc5d2b37ad6e WatchSource:0}: Error finding container d0fad832cc11de26464fb696202b28bc0249ef46db548afaab31dc5d2b37ad6e: Status 404 returned error can't find the container with id d0fad832cc11de26464fb696202b28bc0249ef46db548afaab31dc5d2b37ad6e
Sep 19 15:21:08.088800 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:08.088734    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2l7kl"]
Sep 19 15:21:08.092229 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:21:08.092206    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74576fe8_86d8_4576_a664_8790d60cede6.slice/crio-e9ff24ae03d1963486b12c087ef8f65e1ba592f22f342861f81c35a20d1d4eb9 WatchSource:0}: Error finding container e9ff24ae03d1963486b12c087ef8f65e1ba592f22f342861f81c35a20d1d4eb9: Status 404 returned error can't find the container with id e9ff24ae03d1963486b12c087ef8f65e1ba592f22f342861f81c35a20d1d4eb9
Sep 19 15:21:08.538974 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:08.538937    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2l7kl" event={"ID":"74576fe8-86d8-4576-a664-8790d60cede6","Type":"ContainerStarted","Data":"e9ff24ae03d1963486b12c087ef8f65e1ba592f22f342861f81c35a20d1d4eb9"}
Sep 19 15:21:08.540462 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:08.540432    2563 generic.go:356] "Generic (PLEG): container finished" podID="f0b9326a-6cca-4541-b515-b8055c577941" containerID="b43532692976c6873d9f3a53482314a99b86a63189dd2dc38a20c6c3dffb7729" exitCode=0
Sep 19 15:21:08.540572 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:08.540465    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls" event={"ID":"f0b9326a-6cca-4541-b515-b8055c577941","Type":"ContainerDied","Data":"b43532692976c6873d9f3a53482314a99b86a63189dd2dc38a20c6c3dffb7729"}
Sep 19 15:21:08.540572 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:08.540535    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls" event={"ID":"f0b9326a-6cca-4541-b515-b8055c577941","Type":"ContainerStarted","Data":"d0fad832cc11de26464fb696202b28bc0249ef46db548afaab31dc5d2b37ad6e"}
Sep 19 15:21:10.660830 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:10.660793    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-c72hd"]
Sep 19 15:21:10.664413 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:10.664391    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-c72hd"
Sep 19 15:21:10.666405 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:10.666379    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-mc658\""
Sep 19 15:21:10.672350 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:10.672323    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-c72hd"]
Sep 19 15:21:10.791509 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:10.791474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86rgm\" (UniqueName: \"kubernetes.io/projected/6a487154-5c61-4dfa-84f9-55fa474160ac-kube-api-access-86rgm\") pod \"cert-manager-cainjector-559cdd8c87-c72hd\" (UID: \"6a487154-5c61-4dfa-84f9-55fa474160ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c72hd"
Sep 19 15:21:10.791675 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:10.791535    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a487154-5c61-4dfa-84f9-55fa474160ac-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-c72hd\" (UID: \"6a487154-5c61-4dfa-84f9-55fa474160ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c72hd"
Sep 19 15:21:10.892612 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:10.892575    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86rgm\" (UniqueName: \"kubernetes.io/projected/6a487154-5c61-4dfa-84f9-55fa474160ac-kube-api-access-86rgm\") pod \"cert-manager-cainjector-559cdd8c87-c72hd\" (UID: \"6a487154-5c61-4dfa-84f9-55fa474160ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c72hd"
Sep 19 15:21:10.892823 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:10.892631    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a487154-5c61-4dfa-84f9-55fa474160ac-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-c72hd\" (UID: \"6a487154-5c61-4dfa-84f9-55fa474160ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c72hd"
Sep 19 15:21:10.900617 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:10.900588    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a487154-5c61-4dfa-84f9-55fa474160ac-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-c72hd\" (UID: \"6a487154-5c61-4dfa-84f9-55fa474160ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c72hd"
Sep 19 15:21:10.900845 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:10.900821    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86rgm\" (UniqueName: \"kubernetes.io/projected/6a487154-5c61-4dfa-84f9-55fa474160ac-kube-api-access-86rgm\") pod \"cert-manager-cainjector-559cdd8c87-c72hd\" (UID: \"6a487154-5c61-4dfa-84f9-55fa474160ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c72hd"
Sep 19 15:21:10.975819 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:10.975781    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-c72hd"
Sep 19 15:21:11.558828 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:11.558779    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2l7kl" event={"ID":"74576fe8-86d8-4576-a664-8790d60cede6","Type":"ContainerStarted","Data":"62e99035a797d7bcf54787635ec70907bd94c3bf5418dc2fa9f548840601f314"}
Sep 19 15:21:11.559015 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:11.558929    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2l7kl"
Sep 19 15:21:11.561728 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:11.561516    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls" event={"ID":"f0b9326a-6cca-4541-b515-b8055c577941","Type":"ContainerStarted","Data":"dd8562d77fd2425c5d60dee3ebec26e2ca44bf6a626a57a2555fab5035bff369"}
Sep 19 15:21:11.574430 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:11.574370    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-2l7kl" podStartSLOduration=1.190006746 podStartE2EDuration="4.574350291s" totalImagesPullingTime="3.384343545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:21:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:21:11.571753199 +0000 UTC m=+546.460952913" watchObservedRunningTime="2026-09-19 15:21:11.574350291 +0000 UTC m=+546.463550006"
Sep 19 15:21:11.728212 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:11.728116    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-c72hd"]
Sep 19 15:21:11.730734 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:21:11.730711    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a487154_5c61_4dfa_84f9_55fa474160ac.slice/crio-a9cd432a938a511f385fd87aa57334059805be261e47a9df44f384e0f4dd0607 WatchSource:0}: Error finding container a9cd432a938a511f385fd87aa57334059805be261e47a9df44f384e0f4dd0607: Status 404 returned error can't find the container with id a9cd432a938a511f385fd87aa57334059805be261e47a9df44f384e0f4dd0607
Sep 19 15:21:12.567275 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:12.567243    2563 generic.go:356] "Generic (PLEG): container finished" podID="f0b9326a-6cca-4541-b515-b8055c577941" containerID="dd8562d77fd2425c5d60dee3ebec26e2ca44bf6a626a57a2555fab5035bff369" exitCode=0
Sep 19 15:21:12.567443 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:12.567321    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls" event={"ID":"f0b9326a-6cca-4541-b515-b8055c577941","Type":"ContainerDied","Data":"dd8562d77fd2425c5d60dee3ebec26e2ca44bf6a626a57a2555fab5035bff369"}
Sep 19 15:21:12.568970 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:12.568934    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-c72hd" event={"ID":"6a487154-5c61-4dfa-84f9-55fa474160ac","Type":"ContainerStarted","Data":"a05cfd346728db53c44b331a73f4dfe01d3bf2ad15b20d0e599c7856da10ee1b"}
Sep 19 15:21:12.569046 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:12.568983    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-c72hd" event={"ID":"6a487154-5c61-4dfa-84f9-55fa474160ac","Type":"ContainerStarted","Data":"a9cd432a938a511f385fd87aa57334059805be261e47a9df44f384e0f4dd0607"}
Sep 19 15:21:12.594514 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:12.594466    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-c72hd" podStartSLOduration=2.5944519489999998 podStartE2EDuration="2.594451949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:21:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:21:12.593318287 +0000 UTC m=+547.482518000" watchObservedRunningTime="2026-09-19 15:21:12.594451949 +0000 UTC m=+547.483651662"
Sep 19 15:21:13.574688 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:13.574650    2563 generic.go:356] "Generic (PLEG): container finished" podID="f0b9326a-6cca-4541-b515-b8055c577941" containerID="113eb1348112e9e6089f51e340e6839e1a0f01070e83f3e2b4d368ecbff79606" exitCode=0
Sep 19 15:21:13.575115 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:13.574738    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls" event={"ID":"f0b9326a-6cca-4541-b515-b8055c577941","Type":"ContainerDied","Data":"113eb1348112e9e6089f51e340e6839e1a0f01070e83f3e2b4d368ecbff79606"}
Sep 19 15:21:14.702646 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:14.702617    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls"
Sep 19 15:21:14.826986 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:14.826956    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0b9326a-6cca-4541-b515-b8055c577941-util\") pod \"f0b9326a-6cca-4541-b515-b8055c577941\" (UID: \"f0b9326a-6cca-4541-b515-b8055c577941\") "
Sep 19 15:21:14.827141 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:14.827036    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0b9326a-6cca-4541-b515-b8055c577941-bundle\") pod \"f0b9326a-6cca-4541-b515-b8055c577941\" (UID: \"f0b9326a-6cca-4541-b515-b8055c577941\") "
Sep 19 15:21:14.827141 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:14.827095    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6j944\" (UniqueName: \"kubernetes.io/projected/f0b9326a-6cca-4541-b515-b8055c577941-kube-api-access-6j944\") pod \"f0b9326a-6cca-4541-b515-b8055c577941\" (UID: \"f0b9326a-6cca-4541-b515-b8055c577941\") "
Sep 19 15:21:14.827392 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:14.827354    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0b9326a-6cca-4541-b515-b8055c577941-bundle" (OuterVolumeSpecName: "bundle") pod "f0b9326a-6cca-4541-b515-b8055c577941" (UID: "f0b9326a-6cca-4541-b515-b8055c577941"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:21:14.829389 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:14.829359    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0b9326a-6cca-4541-b515-b8055c577941-kube-api-access-6j944" (OuterVolumeSpecName: "kube-api-access-6j944") pod "f0b9326a-6cca-4541-b515-b8055c577941" (UID: "f0b9326a-6cca-4541-b515-b8055c577941"). InnerVolumeSpecName "kube-api-access-6j944". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:21:14.831304 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:14.831252    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0b9326a-6cca-4541-b515-b8055c577941-util" (OuterVolumeSpecName: "util") pod "f0b9326a-6cca-4541-b515-b8055c577941" (UID: "f0b9326a-6cca-4541-b515-b8055c577941"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:21:14.928061 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:14.928032    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0b9326a-6cca-4541-b515-b8055c577941-bundle\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:21:14.928061 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:14.928058    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6j944\" (UniqueName: \"kubernetes.io/projected/f0b9326a-6cca-4541-b515-b8055c577941-kube-api-access-6j944\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:21:14.928244 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:14.928070    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0b9326a-6cca-4541-b515-b8055c577941-util\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:21:15.585171 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:15.585139    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls"
Sep 19 15:21:15.585171 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:15.585152    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvftls" event={"ID":"f0b9326a-6cca-4541-b515-b8055c577941","Type":"ContainerDied","Data":"d0fad832cc11de26464fb696202b28bc0249ef46db548afaab31dc5d2b37ad6e"}
Sep 19 15:21:15.585379 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:15.585232    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0fad832cc11de26464fb696202b28bc0249ef46db548afaab31dc5d2b37ad6e"
Sep 19 15:21:17.571146 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:17.571115    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2l7kl"
Sep 19 15:21:27.501451 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.501408    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k"]
Sep 19 15:21:27.501945 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.501829    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0b9326a-6cca-4541-b515-b8055c577941" containerName="extract"
Sep 19 15:21:27.501945 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.501846    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0b9326a-6cca-4541-b515-b8055c577941" containerName="extract"
Sep 19 15:21:27.501945 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.501857    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0b9326a-6cca-4541-b515-b8055c577941" containerName="pull"
Sep 19 15:21:27.501945 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.501865    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0b9326a-6cca-4541-b515-b8055c577941" containerName="pull"
Sep 19 15:21:27.501945 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.501918    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0b9326a-6cca-4541-b515-b8055c577941" containerName="util"
Sep 19 15:21:27.501945 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.501926    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0b9326a-6cca-4541-b515-b8055c577941" containerName="util"
Sep 19 15:21:27.502256 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.502008    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0b9326a-6cca-4541-b515-b8055c577941" containerName="extract"
Sep 19 15:21:27.505912 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.505876    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k"
Sep 19 15:21:27.507785 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.507760    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 19 15:21:27.507905 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.507868    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 19 15:21:27.508374 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.508357    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cmsdb\""
Sep 19 15:21:27.511656 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.511633    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k"]
Sep 19 15:21:27.516278 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.516253    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61b00ce3-a77e-4787-9274-86eddcd306f8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k\" (UID: \"61b00ce3-a77e-4787-9274-86eddcd306f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k"
Sep 19 15:21:27.516360 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.516304    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp5nc\" (UniqueName: \"kubernetes.io/projected/61b00ce3-a77e-4787-9274-86eddcd306f8-kube-api-access-tp5nc\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k\" (UID: \"61b00ce3-a77e-4787-9274-86eddcd306f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k"
Sep 19 15:21:27.516396 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.516354    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61b00ce3-a77e-4787-9274-86eddcd306f8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k\" (UID: \"61b00ce3-a77e-4787-9274-86eddcd306f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k"
Sep 19 15:21:27.617089 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.617061    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp5nc\" (UniqueName: \"kubernetes.io/projected/61b00ce3-a77e-4787-9274-86eddcd306f8-kube-api-access-tp5nc\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k\" (UID: \"61b00ce3-a77e-4787-9274-86eddcd306f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k"
Sep 19 15:21:27.617255 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.617108    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61b00ce3-a77e-4787-9274-86eddcd306f8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k\" (UID: \"61b00ce3-a77e-4787-9274-86eddcd306f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k"
Sep 19 15:21:27.617255 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.617156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61b00ce3-a77e-4787-9274-86eddcd306f8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k\" (UID: \"61b00ce3-a77e-4787-9274-86eddcd306f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k"
Sep 19 15:21:27.617559 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.617538    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61b00ce3-a77e-4787-9274-86eddcd306f8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k\" (UID: \"61b00ce3-a77e-4787-9274-86eddcd306f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k"
Sep 19 15:21:27.617637 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.617568    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61b00ce3-a77e-4787-9274-86eddcd306f8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k\" (UID: \"61b00ce3-a77e-4787-9274-86eddcd306f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k"
Sep 19 15:21:27.624361 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.624342    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp5nc\" (UniqueName: \"kubernetes.io/projected/61b00ce3-a77e-4787-9274-86eddcd306f8-kube-api-access-tp5nc\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k\" (UID: \"61b00ce3-a77e-4787-9274-86eddcd306f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k"
Sep 19 15:21:27.815436 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:27.815343    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k"
Sep 19 15:21:28.084232 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:28.084125    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k"]
Sep 19 15:21:28.086622 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:21:28.086592    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61b00ce3_a77e_4787_9274_86eddcd306f8.slice/crio-98f8394740def6162b9434551f11fdc1cfaeb6a2052d406246e6d637f8b77a3b WatchSource:0}: Error finding container 98f8394740def6162b9434551f11fdc1cfaeb6a2052d406246e6d637f8b77a3b: Status 404 returned error can't find the container with id 98f8394740def6162b9434551f11fdc1cfaeb6a2052d406246e6d637f8b77a3b
Sep 19 15:21:28.639256 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:28.639221    2563 generic.go:356] "Generic (PLEG): container finished" podID="61b00ce3-a77e-4787-9274-86eddcd306f8" containerID="206b7e9f9728a0af9785a98980b8e881003733c43a24dafb5ee18220cc7bbb80" exitCode=0
Sep 19 15:21:28.639680 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:28.639304    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k" event={"ID":"61b00ce3-a77e-4787-9274-86eddcd306f8","Type":"ContainerDied","Data":"206b7e9f9728a0af9785a98980b8e881003733c43a24dafb5ee18220cc7bbb80"}
Sep 19 15:21:28.639680 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:28.639348    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k" event={"ID":"61b00ce3-a77e-4787-9274-86eddcd306f8","Type":"ContainerStarted","Data":"98f8394740def6162b9434551f11fdc1cfaeb6a2052d406246e6d637f8b77a3b"}
Sep 19 15:21:29.645776 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:29.645680    2563 generic.go:356] "Generic (PLEG): container finished" podID="61b00ce3-a77e-4787-9274-86eddcd306f8" containerID="26097f4ce2c2b491cd93a76604b757981f03145aa0822c8940b6aa54fb2867ae" exitCode=0
Sep 19 15:21:29.645776 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:29.645740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k" event={"ID":"61b00ce3-a77e-4787-9274-86eddcd306f8","Type":"ContainerDied","Data":"26097f4ce2c2b491cd93a76604b757981f03145aa0822c8940b6aa54fb2867ae"}
Sep 19 15:21:30.653431 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:30.653392    2563 generic.go:356] "Generic (PLEG): container finished" podID="61b00ce3-a77e-4787-9274-86eddcd306f8" containerID="b8fc372d041a0258b5014782fd2b2623380587e463ac99bb10f701a2dd10689f" exitCode=0
Sep 19 15:21:30.653792 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:30.653481    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k" event={"ID":"61b00ce3-a77e-4787-9274-86eddcd306f8","Type":"ContainerDied","Data":"b8fc372d041a0258b5014782fd2b2623380587e463ac99bb10f701a2dd10689f"}
Sep 19 15:21:31.783411 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:31.783386    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k"
Sep 19 15:21:31.845958 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:31.845932    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61b00ce3-a77e-4787-9274-86eddcd306f8-bundle\") pod \"61b00ce3-a77e-4787-9274-86eddcd306f8\" (UID: \"61b00ce3-a77e-4787-9274-86eddcd306f8\") "
Sep 19 15:21:31.846146 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:31.845985    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp5nc\" (UniqueName: \"kubernetes.io/projected/61b00ce3-a77e-4787-9274-86eddcd306f8-kube-api-access-tp5nc\") pod \"61b00ce3-a77e-4787-9274-86eddcd306f8\" (UID: \"61b00ce3-a77e-4787-9274-86eddcd306f8\") "
Sep 19 15:21:31.846146 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:31.846031    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61b00ce3-a77e-4787-9274-86eddcd306f8-util\") pod \"61b00ce3-a77e-4787-9274-86eddcd306f8\" (UID: \"61b00ce3-a77e-4787-9274-86eddcd306f8\") "
Sep 19 15:21:31.846713 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:31.846679    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b00ce3-a77e-4787-9274-86eddcd306f8-bundle" (OuterVolumeSpecName: "bundle") pod "61b00ce3-a77e-4787-9274-86eddcd306f8" (UID: "61b00ce3-a77e-4787-9274-86eddcd306f8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:21:31.848202 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:31.848172    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61b00ce3-a77e-4787-9274-86eddcd306f8-kube-api-access-tp5nc" (OuterVolumeSpecName: "kube-api-access-tp5nc") pod "61b00ce3-a77e-4787-9274-86eddcd306f8" (UID: "61b00ce3-a77e-4787-9274-86eddcd306f8"). InnerVolumeSpecName "kube-api-access-tp5nc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:21:31.851442 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:31.851403    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b00ce3-a77e-4787-9274-86eddcd306f8-util" (OuterVolumeSpecName: "util") pod "61b00ce3-a77e-4787-9274-86eddcd306f8" (UID: "61b00ce3-a77e-4787-9274-86eddcd306f8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:21:31.946526 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:31.946496    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp5nc\" (UniqueName: \"kubernetes.io/projected/61b00ce3-a77e-4787-9274-86eddcd306f8-kube-api-access-tp5nc\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:21:31.946526 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:31.946526    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61b00ce3-a77e-4787-9274-86eddcd306f8-util\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:21:31.946694 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:31.946535    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61b00ce3-a77e-4787-9274-86eddcd306f8-bundle\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:21:32.663910 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:32.663868    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k" event={"ID":"61b00ce3-a77e-4787-9274-86eddcd306f8","Type":"ContainerDied","Data":"98f8394740def6162b9434551f11fdc1cfaeb6a2052d406246e6d637f8b77a3b"}
Sep 19 15:21:32.664075 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:32.663940    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7cq4k"
Sep 19 15:21:32.664075 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:32.663943    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98f8394740def6162b9434551f11fdc1cfaeb6a2052d406246e6d637f8b77a3b"
Sep 19 15:21:44.195331 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.195296    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4"]
Sep 19 15:21:44.195730 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.195575    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b00ce3-a77e-4787-9274-86eddcd306f8" containerName="util"
Sep 19 15:21:44.195730 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.195588    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b00ce3-a77e-4787-9274-86eddcd306f8" containerName="util"
Sep 19 15:21:44.195730 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.195605    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b00ce3-a77e-4787-9274-86eddcd306f8" containerName="extract"
Sep 19 15:21:44.195730 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.195610    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b00ce3-a77e-4787-9274-86eddcd306f8" containerName="extract"
Sep 19 15:21:44.195730 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.195623    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b00ce3-a77e-4787-9274-86eddcd306f8" containerName="pull"
Sep 19 15:21:44.195730 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.195629    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b00ce3-a77e-4787-9274-86eddcd306f8" containerName="pull"
Sep 19 15:21:44.195730 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.195672    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="61b00ce3-a77e-4787-9274-86eddcd306f8" containerName="extract"
Sep 19 15:21:44.201393 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.201374    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4"
Sep 19 15:21:44.203677 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.203657    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 19 15:21:44.203913 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.203874    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 19 15:21:44.204012 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.203942    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 19 15:21:44.204012 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.203986    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6pmc7\""
Sep 19 15:21:44.204138 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.204026    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 19 15:21:44.212787 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.212765    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4"]
Sep 19 15:21:44.238965 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.238939    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45bd5440-7824-4bbe-affc-ca64cf03148a-tmp\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-mhhw4\" (UID: \"45bd5440-7824-4bbe-affc-ca64cf03148a\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4"
Sep 19 15:21:44.239056 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.238980    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfd8n\" (UniqueName: \"kubernetes.io/projected/45bd5440-7824-4bbe-affc-ca64cf03148a-kube-api-access-bfd8n\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-mhhw4\" (UID: \"45bd5440-7824-4bbe-affc-ca64cf03148a\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4"
Sep 19 15:21:44.239056 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.239005    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/45bd5440-7824-4bbe-affc-ca64cf03148a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-mhhw4\" (UID: \"45bd5440-7824-4bbe-affc-ca64cf03148a\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4"
Sep 19 15:21:44.239135 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.239065    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/45bd5440-7824-4bbe-affc-ca64cf03148a-manifests\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-mhhw4\" (UID: \"45bd5440-7824-4bbe-affc-ca64cf03148a\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4"
Sep 19 15:21:44.239135 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.239084    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45bd5440-7824-4bbe-affc-ca64cf03148a-webhook-cert\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-mhhw4\" (UID: \"45bd5440-7824-4bbe-affc-ca64cf03148a\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4"
Sep 19 15:21:44.340337 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.340301    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45bd5440-7824-4bbe-affc-ca64cf03148a-tmp\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-mhhw4\" (UID: \"45bd5440-7824-4bbe-affc-ca64cf03148a\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4"
Sep 19 15:21:44.340526 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.340371    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfd8n\" (UniqueName: \"kubernetes.io/projected/45bd5440-7824-4bbe-affc-ca64cf03148a-kube-api-access-bfd8n\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-mhhw4\" (UID: \"45bd5440-7824-4bbe-affc-ca64cf03148a\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4"
Sep 19 15:21:44.340526 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.340409    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/45bd5440-7824-4bbe-affc-ca64cf03148a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-mhhw4\" (UID: \"45bd5440-7824-4bbe-affc-ca64cf03148a\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4"
Sep 19 15:21:44.340526 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.340441    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/45bd5440-7824-4bbe-affc-ca64cf03148a-manifests\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-mhhw4\" (UID: \"45bd5440-7824-4bbe-affc-ca64cf03148a\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4"
Sep 19 15:21:44.340526 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.340470    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45bd5440-7824-4bbe-affc-ca64cf03148a-webhook-cert\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-mhhw4\" (UID: \"45bd5440-7824-4bbe-affc-ca64cf03148a\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4"
Sep 19 15:21:44.340857 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.340829    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/45bd5440-7824-4bbe-affc-ca64cf03148a-manifests\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-mhhw4\" (UID: \"45bd5440-7824-4bbe-affc-ca64cf03148a\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4"
Sep 19 15:21:44.342832 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.342810    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45bd5440-7824-4bbe-affc-ca64cf03148a-tmp\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-mhhw4\" (UID: \"45bd5440-7824-4bbe-affc-ca64cf03148a\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4"
Sep 19 15:21:44.343328 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.343311    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/45bd5440-7824-4bbe-affc-ca64cf03148a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-mhhw4\" (UID: \"45bd5440-7824-4bbe-affc-ca64cf03148a\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4"
Sep 19 15:21:44.343469 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.343447    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45bd5440-7824-4bbe-affc-ca64cf03148a-webhook-cert\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-mhhw4\" (UID: \"45bd5440-7824-4bbe-affc-ca64cf03148a\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4"
Sep 19 15:21:44.348562 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.348536    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfd8n\" (UniqueName: \"kubernetes.io/projected/45bd5440-7824-4bbe-affc-ca64cf03148a-kube-api-access-bfd8n\") pod \"opendatahub-operator-controller-manager-79d8c7f66c-mhhw4\" (UID: \"45bd5440-7824-4bbe-affc-ca64cf03148a\") " pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4"
Sep 19 15:21:44.511648 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.511565    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4"
Sep 19 15:21:44.720123 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.720089    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl"]
Sep 19 15:21:44.725651 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.725634    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl"
Sep 19 15:21:44.727730 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.727702    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 19 15:21:44.728091 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.728030    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cmsdb\""
Sep 19 15:21:44.728091 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.728081    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 19 15:21:44.730615 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.730597    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl"]
Sep 19 15:21:44.744060 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.744032    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e055921-4108-4c35-b9ad-45321c218c82-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl\" (UID: \"8e055921-4108-4c35-b9ad-45321c218c82\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl"
Sep 19 15:21:44.744198 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.744071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e055921-4108-4c35-b9ad-45321c218c82-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl\" (UID: \"8e055921-4108-4c35-b9ad-45321c218c82\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl"
Sep 19 15:21:44.744259 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.744190    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6hcf\" (UniqueName: \"kubernetes.io/projected/8e055921-4108-4c35-b9ad-45321c218c82-kube-api-access-x6hcf\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl\" (UID: \"8e055921-4108-4c35-b9ad-45321c218c82\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl"
Sep 19 15:21:44.793009 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.792925    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4"]
Sep 19 15:21:44.796069 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:21:44.796044    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45bd5440_7824_4bbe_affc_ca64cf03148a.slice/crio-387d70424e342fcd97b0aeea2aa1f359c3494960dd64a735cf7775cd58e97069 WatchSource:0}: Error finding container 387d70424e342fcd97b0aeea2aa1f359c3494960dd64a735cf7775cd58e97069: Status 404 returned error can't find the container with id 387d70424e342fcd97b0aeea2aa1f359c3494960dd64a735cf7775cd58e97069
Sep 19 15:21:44.845358 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.845324    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e055921-4108-4c35-b9ad-45321c218c82-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl\" (UID: \"8e055921-4108-4c35-b9ad-45321c218c82\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl"
Sep 19 15:21:44.845512 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.845373    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e055921-4108-4c35-b9ad-45321c218c82-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl\" (UID: \"8e055921-4108-4c35-b9ad-45321c218c82\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl"
Sep 19 15:21:44.845512 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.845451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6hcf\" (UniqueName: \"kubernetes.io/projected/8e055921-4108-4c35-b9ad-45321c218c82-kube-api-access-x6hcf\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl\" (UID: \"8e055921-4108-4c35-b9ad-45321c218c82\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl"
Sep 19 15:21:44.845779 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.845756    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e055921-4108-4c35-b9ad-45321c218c82-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl\" (UID: \"8e055921-4108-4c35-b9ad-45321c218c82\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl"
Sep 19 15:21:44.845833 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.845780    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e055921-4108-4c35-b9ad-45321c218c82-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl\" (UID: \"8e055921-4108-4c35-b9ad-45321c218c82\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl"
Sep 19 15:21:44.853078 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:44.853054    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6hcf\" (UniqueName: \"kubernetes.io/projected/8e055921-4108-4c35-b9ad-45321c218c82-kube-api-access-x6hcf\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl\" (UID: \"8e055921-4108-4c35-b9ad-45321c218c82\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl"
Sep 19 15:21:45.037317 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:45.037272    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl"
Sep 19 15:21:45.322526 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:45.322446    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl"]
Sep 19 15:21:45.325827 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:21:45.325799    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e055921_4108_4c35_b9ad_45321c218c82.slice/crio-d6636c10763b9f3b72d0fae40fc6c12f7b835c3140def0d8d8c5e7dacf27f23a WatchSource:0}: Error finding container d6636c10763b9f3b72d0fae40fc6c12f7b835c3140def0d8d8c5e7dacf27f23a: Status 404 returned error can't find the container with id d6636c10763b9f3b72d0fae40fc6c12f7b835c3140def0d8d8c5e7dacf27f23a
Sep 19 15:21:45.729911 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:45.729850    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4" event={"ID":"45bd5440-7824-4bbe-affc-ca64cf03148a","Type":"ContainerStarted","Data":"387d70424e342fcd97b0aeea2aa1f359c3494960dd64a735cf7775cd58e97069"}
Sep 19 15:21:45.731702 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:45.731668    2563 generic.go:356] "Generic (PLEG): container finished" podID="8e055921-4108-4c35-b9ad-45321c218c82" containerID="8a34154ea2e384a412c302768aeb3267c8ad39de68ca72ddb37eec5be63742ac" exitCode=0
Sep 19 15:21:45.731831 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:45.731741    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl" event={"ID":"8e055921-4108-4c35-b9ad-45321c218c82","Type":"ContainerDied","Data":"8a34154ea2e384a412c302768aeb3267c8ad39de68ca72ddb37eec5be63742ac"}
Sep 19 15:21:45.731831 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:45.731780    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl" event={"ID":"8e055921-4108-4c35-b9ad-45321c218c82","Type":"ContainerStarted","Data":"d6636c10763b9f3b72d0fae40fc6c12f7b835c3140def0d8d8c5e7dacf27f23a"}
Sep 19 15:21:48.748041 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:48.748004    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4" event={"ID":"45bd5440-7824-4bbe-affc-ca64cf03148a","Type":"ContainerStarted","Data":"244d27411371ba831afd3787178f630d5809951e7baa9cdf7cbff9fef12268d6"}
Sep 19 15:21:48.749922 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:48.749875    2563 generic.go:356] "Generic (PLEG): container finished" podID="8e055921-4108-4c35-b9ad-45321c218c82" containerID="1d3fa8727388ede39ba80a3b1a77c02cc933c16bbc25c80210540d61ed4658ac" exitCode=0
Sep 19 15:21:48.750046 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:48.749923    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl" event={"ID":"8e055921-4108-4c35-b9ad-45321c218c82","Type":"ContainerDied","Data":"1d3fa8727388ede39ba80a3b1a77c02cc933c16bbc25c80210540d61ed4658ac"}
Sep 19 15:21:49.755793 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:49.755761    2563 generic.go:356] "Generic (PLEG): container finished" podID="45bd5440-7824-4bbe-affc-ca64cf03148a" containerID="244d27411371ba831afd3787178f630d5809951e7baa9cdf7cbff9fef12268d6" exitCode=0
Sep 19 15:21:49.756208 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:49.755855    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4" event={"ID":"45bd5440-7824-4bbe-affc-ca64cf03148a","Type":"ContainerDied","Data":"244d27411371ba831afd3787178f630d5809951e7baa9cdf7cbff9fef12268d6"}
Sep 19 15:21:49.758238 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:49.758215    2563 generic.go:356] "Generic (PLEG): container finished" podID="8e055921-4108-4c35-b9ad-45321c218c82" containerID="316aaaa0e05c21662eaa929ab67240f72b0b4cbdb48b36952d8216de962dfcf9" exitCode=0
Sep 19 15:21:49.758332 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:49.758250    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl" event={"ID":"8e055921-4108-4c35-b9ad-45321c218c82","Type":"ContainerDied","Data":"316aaaa0e05c21662eaa929ab67240f72b0b4cbdb48b36952d8216de962dfcf9"}
Sep 19 15:21:50.764209 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:50.764167    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4" event={"ID":"45bd5440-7824-4bbe-affc-ca64cf03148a","Type":"ContainerStarted","Data":"25ec33a0b363d8e28885c6996110173e6c835e02d129a7ffe3f239df6542d012"}
Sep 19 15:21:50.783659 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:50.783604    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4" podStartSLOduration=2.243077592 podStartE2EDuration="6.783585663s" totalImagesPullingTime="3.396898335s" totalInitContainerRuntime="1.143609736s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:21:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:21:50.782242133 +0000 UTC m=+585.671441869" watchObservedRunningTime="2026-09-19 15:21:50.783585663 +0000 UTC m=+585.672785375"
Sep 19 15:21:50.895271 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:50.895244    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl"
Sep 19 15:21:50.997598 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:50.997550    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e055921-4108-4c35-b9ad-45321c218c82-util\") pod \"8e055921-4108-4c35-b9ad-45321c218c82\" (UID: \"8e055921-4108-4c35-b9ad-45321c218c82\") "
Sep 19 15:21:50.997598 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:50.997596    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e055921-4108-4c35-b9ad-45321c218c82-bundle\") pod \"8e055921-4108-4c35-b9ad-45321c218c82\" (UID: \"8e055921-4108-4c35-b9ad-45321c218c82\") "
Sep 19 15:21:50.997812 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:50.997633    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6hcf\" (UniqueName: \"kubernetes.io/projected/8e055921-4108-4c35-b9ad-45321c218c82-kube-api-access-x6hcf\") pod \"8e055921-4108-4c35-b9ad-45321c218c82\" (UID: \"8e055921-4108-4c35-b9ad-45321c218c82\") "
Sep 19 15:21:50.998311 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:50.998279    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e055921-4108-4c35-b9ad-45321c218c82-bundle" (OuterVolumeSpecName: "bundle") pod "8e055921-4108-4c35-b9ad-45321c218c82" (UID: "8e055921-4108-4c35-b9ad-45321c218c82"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:21:50.999871 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:50.999844    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e055921-4108-4c35-b9ad-45321c218c82-kube-api-access-x6hcf" (OuterVolumeSpecName: "kube-api-access-x6hcf") pod "8e055921-4108-4c35-b9ad-45321c218c82" (UID: "8e055921-4108-4c35-b9ad-45321c218c82"). InnerVolumeSpecName "kube-api-access-x6hcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:21:51.003210 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:51.003187    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e055921-4108-4c35-b9ad-45321c218c82-util" (OuterVolumeSpecName: "util") pod "8e055921-4108-4c35-b9ad-45321c218c82" (UID: "8e055921-4108-4c35-b9ad-45321c218c82"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:21:51.098282 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:51.098192    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e055921-4108-4c35-b9ad-45321c218c82-util\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:21:51.098282 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:51.098220    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e055921-4108-4c35-b9ad-45321c218c82-bundle\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:21:51.098282 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:51.098230    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6hcf\" (UniqueName: \"kubernetes.io/projected/8e055921-4108-4c35-b9ad-45321c218c82-kube-api-access-x6hcf\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:21:51.770380 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:51.770350    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl"
Sep 19 15:21:51.770380 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:51.770374    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06x8bl" event={"ID":"8e055921-4108-4c35-b9ad-45321c218c82","Type":"ContainerDied","Data":"d6636c10763b9f3b72d0fae40fc6c12f7b835c3140def0d8d8c5e7dacf27f23a"}
Sep 19 15:21:51.770772 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:51.770418    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6636c10763b9f3b72d0fae40fc6c12f7b835c3140def0d8d8c5e7dacf27f23a"
Sep 19 15:21:51.770772 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:21:51.770471    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4"
Sep 19 15:22:02.777311 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:02.777282    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79d8c7f66c-mhhw4"
Sep 19 15:22:04.687312 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:04.687279    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-dc4565f8d-kgbgb"]
Sep 19 15:22:04.687685 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:04.687566    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e055921-4108-4c35-b9ad-45321c218c82" containerName="extract"
Sep 19 15:22:04.687685 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:04.687577    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e055921-4108-4c35-b9ad-45321c218c82" containerName="extract"
Sep 19 15:22:04.687685 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:04.687589    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e055921-4108-4c35-b9ad-45321c218c82" containerName="util"
Sep 19 15:22:04.687685 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:04.687594    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e055921-4108-4c35-b9ad-45321c218c82" containerName="util"
Sep 19 15:22:04.687685 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:04.687600    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e055921-4108-4c35-b9ad-45321c218c82" containerName="pull"
Sep 19 15:22:04.687685 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:04.687605    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e055921-4108-4c35-b9ad-45321c218c82" containerName="pull"
Sep 19 15:22:04.687685 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:04.687656    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e055921-4108-4c35-b9ad-45321c218c82" containerName="extract"
Sep 19 15:22:04.690806 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:04.690788    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-dc4565f8d-kgbgb"
Sep 19 15:22:04.692977 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:04.692953    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 19 15:22:04.693096 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:04.692956    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 19 15:22:04.693489 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:04.693471    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-r5bbd\""
Sep 19 15:22:04.703570 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:04.703549    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-dc4565f8d-kgbgb"]
Sep 19 15:22:04.807202 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:04.807173    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hbhk\" (UniqueName: \"kubernetes.io/projected/0d5f90ed-7d2d-43b1-b71d-98a44e14e056-kube-api-access-5hbhk\") pod \"kube-auth-proxy-dc4565f8d-kgbgb\" (UID: \"0d5f90ed-7d2d-43b1-b71d-98a44e14e056\") " pod="openshift-ingress/kube-auth-proxy-dc4565f8d-kgbgb"
Sep 19 15:22:04.807363 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:04.807217    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d5f90ed-7d2d-43b1-b71d-98a44e14e056-tls-certs\") pod \"kube-auth-proxy-dc4565f8d-kgbgb\" (UID: \"0d5f90ed-7d2d-43b1-b71d-98a44e14e056\") " pod="openshift-ingress/kube-auth-proxy-dc4565f8d-kgbgb"
Sep 19 15:22:04.807363 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:04.807243    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d5f90ed-7d2d-43b1-b71d-98a44e14e056-tmp\") pod \"kube-auth-proxy-dc4565f8d-kgbgb\" (UID: \"0d5f90ed-7d2d-43b1-b71d-98a44e14e056\") " pod="openshift-ingress/kube-auth-proxy-dc4565f8d-kgbgb"
Sep 19 15:22:04.907766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:04.907728    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hbhk\" (UniqueName: \"kubernetes.io/projected/0d5f90ed-7d2d-43b1-b71d-98a44e14e056-kube-api-access-5hbhk\") pod \"kube-auth-proxy-dc4565f8d-kgbgb\" (UID: \"0d5f90ed-7d2d-43b1-b71d-98a44e14e056\") " pod="openshift-ingress/kube-auth-proxy-dc4565f8d-kgbgb"
Sep 19 15:22:04.907982 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:04.907785    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d5f90ed-7d2d-43b1-b71d-98a44e14e056-tls-certs\") pod \"kube-auth-proxy-dc4565f8d-kgbgb\" (UID: \"0d5f90ed-7d2d-43b1-b71d-98a44e14e056\") " pod="openshift-ingress/kube-auth-proxy-dc4565f8d-kgbgb"
Sep 19 15:22:04.907982 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:04.907812    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d5f90ed-7d2d-43b1-b71d-98a44e14e056-tmp\") pod \"kube-auth-proxy-dc4565f8d-kgbgb\" (UID: \"0d5f90ed-7d2d-43b1-b71d-98a44e14e056\") " pod="openshift-ingress/kube-auth-proxy-dc4565f8d-kgbgb"
Sep 19 15:22:04.910124 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:04.910100    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d5f90ed-7d2d-43b1-b71d-98a44e14e056-tmp\") pod \"kube-auth-proxy-dc4565f8d-kgbgb\" (UID: \"0d5f90ed-7d2d-43b1-b71d-98a44e14e056\") " pod="openshift-ingress/kube-auth-proxy-dc4565f8d-kgbgb"
Sep 19 15:22:04.910343 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:04.910323    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d5f90ed-7d2d-43b1-b71d-98a44e14e056-tls-certs\") pod \"kube-auth-proxy-dc4565f8d-kgbgb\" (UID: \"0d5f90ed-7d2d-43b1-b71d-98a44e14e056\") " pod="openshift-ingress/kube-auth-proxy-dc4565f8d-kgbgb"
Sep 19 15:22:04.924951 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:04.924919    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hbhk\" (UniqueName: \"kubernetes.io/projected/0d5f90ed-7d2d-43b1-b71d-98a44e14e056-kube-api-access-5hbhk\") pod \"kube-auth-proxy-dc4565f8d-kgbgb\" (UID: \"0d5f90ed-7d2d-43b1-b71d-98a44e14e056\") " pod="openshift-ingress/kube-auth-proxy-dc4565f8d-kgbgb"
Sep 19 15:22:05.000107 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:05.000018    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-dc4565f8d-kgbgb"
Sep 19 15:22:05.277492 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:05.277417    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-dc4565f8d-kgbgb"]
Sep 19 15:22:05.280508 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:22:05.280480    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d5f90ed_7d2d_43b1_b71d_98a44e14e056.slice/crio-99f32db56cd3bd4260bf41703a5a7de17d0835a1e98f694e5fdf7e7d81ec2676 WatchSource:0}: Error finding container 99f32db56cd3bd4260bf41703a5a7de17d0835a1e98f694e5fdf7e7d81ec2676: Status 404 returned error can't find the container with id 99f32db56cd3bd4260bf41703a5a7de17d0835a1e98f694e5fdf7e7d81ec2676
Sep 19 15:22:05.552751 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:05.552676    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/1.log"
Sep 19 15:22:05.553707 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:05.553676    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/1.log"
Sep 19 15:22:05.834447 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:05.834373    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-dc4565f8d-kgbgb" event={"ID":"0d5f90ed-7d2d-43b1-b71d-98a44e14e056","Type":"ContainerStarted","Data":"99f32db56cd3bd4260bf41703a5a7de17d0835a1e98f694e5fdf7e7d81ec2676"}
Sep 19 15:22:05.957874 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:05.957841    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"]
Sep 19 15:22:05.961405 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:05.961379    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:05.963649 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:05.963627    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 19 15:22:05.963775 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:05.963754    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 19 15:22:05.963876 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:05.963861    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 19 15:22:05.964038 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:05.963887    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zlrsk\""
Sep 19 15:22:05.964038 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:05.963992    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 19 15:22:05.979197 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:05.979171    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"]
Sep 19 15:22:06.016683 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.016648    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-v6k5d\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:06.016841 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.016718    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5dfh\" (UniqueName: \"kubernetes.io/projected/cb146e21-5585-4119-8c4c-a23cef510a1e-kube-api-access-b5dfh\") pod \"istiod-openshift-gateway-7b7995d5cd-v6k5d\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:06.016841 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.016791    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cb146e21-5585-4119-8c4c-a23cef510a1e-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-v6k5d\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:06.017000 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.016873    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-v6k5d\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:06.017000 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.016942    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb146e21-5585-4119-8c4c-a23cef510a1e-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-v6k5d\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:06.017000 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.016965    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-v6k5d\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:06.017158 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.017003    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-v6k5d\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:06.118352 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.117715    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-v6k5d\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:06.118352 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.117756    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb146e21-5585-4119-8c4c-a23cef510a1e-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-v6k5d\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:06.118352 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.117777    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-v6k5d\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:06.118352 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.117818    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-v6k5d\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:06.118352 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.117848    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-v6k5d\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:06.118352 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.117913    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5dfh\" (UniqueName: \"kubernetes.io/projected/cb146e21-5585-4119-8c4c-a23cef510a1e-kube-api-access-b5dfh\") pod \"istiod-openshift-gateway-7b7995d5cd-v6k5d\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:06.118352 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.117933    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cb146e21-5585-4119-8c4c-a23cef510a1e-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-v6k5d\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:06.119577 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.119359    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-v6k5d\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:06.121317 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.121275    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-v6k5d\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:06.121509 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.121372    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cb146e21-5585-4119-8c4c-a23cef510a1e-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-v6k5d\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:06.121657 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.121637    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-v6k5d\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:06.122669 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.122647    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb146e21-5585-4119-8c4c-a23cef510a1e-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-v6k5d\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:06.126383 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.126355    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-v6k5d\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:06.126474 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.126435    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5dfh\" (UniqueName: \"kubernetes.io/projected/cb146e21-5585-4119-8c4c-a23cef510a1e-kube-api-access-b5dfh\") pod \"istiod-openshift-gateway-7b7995d5cd-v6k5d\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:06.274700 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.274663    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:06.563581 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.563552    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"]
Sep 19 15:22:06.568134 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:22:06.566130    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb146e21_5585_4119_8c4c_a23cef510a1e.slice/crio-10c1e6e4096b3a1773aff49e34d29f61affd62c66fed1232684769ab5e3f88f4 WatchSource:0}: Error finding container 10c1e6e4096b3a1773aff49e34d29f61affd62c66fed1232684769ab5e3f88f4: Status 404 returned error can't find the container with id 10c1e6e4096b3a1773aff49e34d29f61affd62c66fed1232684769ab5e3f88f4
Sep 19 15:22:06.841944 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:06.841849    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d" event={"ID":"cb146e21-5585-4119-8c4c-a23cef510a1e","Type":"ContainerStarted","Data":"10c1e6e4096b3a1773aff49e34d29f61affd62c66fed1232684769ab5e3f88f4"}
Sep 19 15:22:08.049945 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:08.049922    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 19 15:22:08.854274 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:08.854199    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-dc4565f8d-kgbgb" event={"ID":"0d5f90ed-7d2d-43b1-b71d-98a44e14e056","Type":"ContainerStarted","Data":"38213356fe41ea04a05f750e61715781290bda757a123db21cbafb59747344c0"}
Sep 19 15:22:08.868957 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:08.868883    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-dc4565f8d-kgbgb" podStartSLOduration=2.103444171 podStartE2EDuration="4.868863273s" totalImagesPullingTime="2.765419102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:22:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:22:08.867875305 +0000 UTC m=+603.757075029" watchObservedRunningTime="2026-09-19 15:22:08.868863273 +0000 UTC m=+603.758062987"
Sep 19 15:22:09.846928 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:09.846866    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:22:09.847180 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:09.846974    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:22:10.865581 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:10.865547    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d" event={"ID":"cb146e21-5585-4119-8c4c-a23cef510a1e","Type":"ContainerStarted","Data":"4de69580fd17b2e83d90d33a8f4e01f28dda3ea274eea6ab7e4204c0dfc94844"}
Sep 19 15:22:10.866036 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:10.865797    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:10.867763 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:10.867730    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-v6k5d container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 15:22:10.867932 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:10.867797    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d" podUID="cb146e21-5585-4119-8c4c-a23cef510a1e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 15:22:10.886670 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:10.886613    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d" podStartSLOduration=2.609608388 podStartE2EDuration="5.886592311s" totalImagesPullingTime="3.276983923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:22:10.884556365 +0000 UTC m=+605.773756077" watchObservedRunningTime="2026-09-19 15:22:10.886592311 +0000 UTC m=+605.775792024"
Sep 19 15:22:11.871421 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:11.871394    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:21.743848 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.743806    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"]
Sep 19 15:22:21.753112 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.753082    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:21.759689 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.759662    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"]
Sep 19 15:22:21.859101 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.859062    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef0a73c1-6b87-4013-a212-ff814e4e5b78-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-pcbnn\" (UID: \"ef0a73c1-6b87-4013-a212-ff814e4e5b78\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:21.859260 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.859117    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ef0a73c1-6b87-4013-a212-ff814e4e5b78-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-pcbnn\" (UID: \"ef0a73c1-6b87-4013-a212-ff814e4e5b78\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:21.859260 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.859189    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ef0a73c1-6b87-4013-a212-ff814e4e5b78-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-pcbnn\" (UID: \"ef0a73c1-6b87-4013-a212-ff814e4e5b78\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:21.859260 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.859220    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ef0a73c1-6b87-4013-a212-ff814e4e5b78-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-pcbnn\" (UID: \"ef0a73c1-6b87-4013-a212-ff814e4e5b78\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:21.859393 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.859362    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j45cw\" (UniqueName: \"kubernetes.io/projected/ef0a73c1-6b87-4013-a212-ff814e4e5b78-kube-api-access-j45cw\") pod \"istiod-openshift-gateway-5677ccb49b-pcbnn\" (UID: \"ef0a73c1-6b87-4013-a212-ff814e4e5b78\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:21.859453 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.859442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef0a73c1-6b87-4013-a212-ff814e4e5b78-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-pcbnn\" (UID: \"ef0a73c1-6b87-4013-a212-ff814e4e5b78\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:21.859489 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.859481    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ef0a73c1-6b87-4013-a212-ff814e4e5b78-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-pcbnn\" (UID: \"ef0a73c1-6b87-4013-a212-ff814e4e5b78\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:21.960490 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.960451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef0a73c1-6b87-4013-a212-ff814e4e5b78-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-pcbnn\" (UID: \"ef0a73c1-6b87-4013-a212-ff814e4e5b78\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:21.960490 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.960494    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ef0a73c1-6b87-4013-a212-ff814e4e5b78-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-pcbnn\" (UID: \"ef0a73c1-6b87-4013-a212-ff814e4e5b78\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:21.960747 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.960544    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ef0a73c1-6b87-4013-a212-ff814e4e5b78-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-pcbnn\" (UID: \"ef0a73c1-6b87-4013-a212-ff814e4e5b78\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:21.960747 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.960696    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ef0a73c1-6b87-4013-a212-ff814e4e5b78-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-pcbnn\" (UID: \"ef0a73c1-6b87-4013-a212-ff814e4e5b78\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:21.960858 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.960755    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j45cw\" (UniqueName: \"kubernetes.io/projected/ef0a73c1-6b87-4013-a212-ff814e4e5b78-kube-api-access-j45cw\") pod \"istiod-openshift-gateway-5677ccb49b-pcbnn\" (UID: \"ef0a73c1-6b87-4013-a212-ff814e4e5b78\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:21.960858 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.960806    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef0a73c1-6b87-4013-a212-ff814e4e5b78-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-pcbnn\" (UID: \"ef0a73c1-6b87-4013-a212-ff814e4e5b78\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:21.960858 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.960842    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ef0a73c1-6b87-4013-a212-ff814e4e5b78-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-pcbnn\" (UID: \"ef0a73c1-6b87-4013-a212-ff814e4e5b78\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:21.961321 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.961289    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ef0a73c1-6b87-4013-a212-ff814e4e5b78-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-pcbnn\" (UID: \"ef0a73c1-6b87-4013-a212-ff814e4e5b78\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:21.963132 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.963104    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ef0a73c1-6b87-4013-a212-ff814e4e5b78-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-pcbnn\" (UID: \"ef0a73c1-6b87-4013-a212-ff814e4e5b78\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:21.963132 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.963105    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef0a73c1-6b87-4013-a212-ff814e4e5b78-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-pcbnn\" (UID: \"ef0a73c1-6b87-4013-a212-ff814e4e5b78\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:21.963306 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.963209    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ef0a73c1-6b87-4013-a212-ff814e4e5b78-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-pcbnn\" (UID: \"ef0a73c1-6b87-4013-a212-ff814e4e5b78\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:21.963306 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.963251    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ef0a73c1-6b87-4013-a212-ff814e4e5b78-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-pcbnn\" (UID: \"ef0a73c1-6b87-4013-a212-ff814e4e5b78\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:21.973018 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.972997    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef0a73c1-6b87-4013-a212-ff814e4e5b78-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-pcbnn\" (UID: \"ef0a73c1-6b87-4013-a212-ff814e4e5b78\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:21.973396 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:21.973378    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j45cw\" (UniqueName: \"kubernetes.io/projected/ef0a73c1-6b87-4013-a212-ff814e4e5b78-kube-api-access-j45cw\") pod \"istiod-openshift-gateway-5677ccb49b-pcbnn\" (UID: \"ef0a73c1-6b87-4013-a212-ff814e4e5b78\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:22.063045 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:22.062978    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:22.339336 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:22.339309    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"]
Sep 19 15:22:22.341043 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:22:22.341011    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef0a73c1_6b87_4013_a212_ff814e4e5b78.slice/crio-75c3902f974e908c80a2c02f27a148e443db65e024a122e6bfade958aceb20d4 WatchSource:0}: Error finding container 75c3902f974e908c80a2c02f27a148e443db65e024a122e6bfade958aceb20d4: Status 404 returned error can't find the container with id 75c3902f974e908c80a2c02f27a148e443db65e024a122e6bfade958aceb20d4
Sep 19 15:22:22.344150 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:22.344112    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:22:22.344279 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:22.344174    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:22:22.920754 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:22.920718    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn" event={"ID":"ef0a73c1-6b87-4013-a212-ff814e4e5b78","Type":"ContainerStarted","Data":"d141433ee56074a3a57f89d539ef4a33fea9d74a0835bbcb055a9b18aeb361c0"}
Sep 19 15:22:22.921211 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:22.920779    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn" event={"ID":"ef0a73c1-6b87-4013-a212-ff814e4e5b78","Type":"ContainerStarted","Data":"75c3902f974e908c80a2c02f27a148e443db65e024a122e6bfade958aceb20d4"}
Sep 19 15:22:22.921211 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:22.920800    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:22.962496 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:22.962444    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn" podStartSLOduration=1.962426126 podStartE2EDuration="1.962426126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:22:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:22:22.959978242 +0000 UTC m=+617.849177955" watchObservedRunningTime="2026-09-19 15:22:22.962426126 +0000 UTC m=+617.851625838"
Sep 19 15:22:23.927838 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:23.927811    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn"
Sep 19 15:22:24.005515 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.005471    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"]
Sep 19 15:22:24.005748 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.005717    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d" podUID="cb146e21-5585-4119-8c4c-a23cef510a1e" containerName="discovery" containerID="cri-o://4de69580fd17b2e83d90d33a8f4e01f28dda3ea274eea6ab7e4204c0dfc94844" gracePeriod=30
Sep 19 15:22:24.247540 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.247509    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:24.383423 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.383393    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-csr-dns-cert\") pod \"cb146e21-5585-4119-8c4c-a23cef510a1e\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") "
Sep 19 15:22:24.383599 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.383464    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5dfh\" (UniqueName: \"kubernetes.io/projected/cb146e21-5585-4119-8c4c-a23cef510a1e-kube-api-access-b5dfh\") pod \"cb146e21-5585-4119-8c4c-a23cef510a1e\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") "
Sep 19 15:22:24.383599 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.383489    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb146e21-5585-4119-8c4c-a23cef510a1e-local-certs\") pod \"cb146e21-5585-4119-8c4c-a23cef510a1e\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") "
Sep 19 15:22:24.383718 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.383662    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-token\") pod \"cb146e21-5585-4119-8c4c-a23cef510a1e\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") "
Sep 19 15:22:24.383778 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.383719    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-csr-ca-configmap\") pod \"cb146e21-5585-4119-8c4c-a23cef510a1e\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") "
Sep 19 15:22:24.383778 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.383754    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cb146e21-5585-4119-8c4c-a23cef510a1e-cacerts\") pod \"cb146e21-5585-4119-8c4c-a23cef510a1e\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") "
Sep 19 15:22:24.383970 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.383802    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-kubeconfig\") pod \"cb146e21-5585-4119-8c4c-a23cef510a1e\" (UID: \"cb146e21-5585-4119-8c4c-a23cef510a1e\") "
Sep 19 15:22:24.384413 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.384339    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "cb146e21-5585-4119-8c4c-a23cef510a1e" (UID: "cb146e21-5585-4119-8c4c-a23cef510a1e"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:22:24.386422 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.386377    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb146e21-5585-4119-8c4c-a23cef510a1e-kube-api-access-b5dfh" (OuterVolumeSpecName: "kube-api-access-b5dfh") pod "cb146e21-5585-4119-8c4c-a23cef510a1e" (UID: "cb146e21-5585-4119-8c4c-a23cef510a1e"). InnerVolumeSpecName "kube-api-access-b5dfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:22:24.386422 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.386395    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb146e21-5585-4119-8c4c-a23cef510a1e-local-certs" (OuterVolumeSpecName: "local-certs") pod "cb146e21-5585-4119-8c4c-a23cef510a1e" (UID: "cb146e21-5585-4119-8c4c-a23cef510a1e"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:22:24.386729 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.386707    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "cb146e21-5585-4119-8c4c-a23cef510a1e" (UID: "cb146e21-5585-4119-8c4c-a23cef510a1e"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:22:24.386875 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.386851    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb146e21-5585-4119-8c4c-a23cef510a1e-cacerts" (OuterVolumeSpecName: "cacerts") pod "cb146e21-5585-4119-8c4c-a23cef510a1e" (UID: "cb146e21-5585-4119-8c4c-a23cef510a1e"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:22:24.386957 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.386880    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-token" (OuterVolumeSpecName: "istio-token") pod "cb146e21-5585-4119-8c4c-a23cef510a1e" (UID: "cb146e21-5585-4119-8c4c-a23cef510a1e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:22:24.386957 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.386910    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "cb146e21-5585-4119-8c4c-a23cef510a1e" (UID: "cb146e21-5585-4119-8c4c-a23cef510a1e"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:22:24.470010 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.469979    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-krv5g"]
Sep 19 15:22:24.470277 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.470266    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb146e21-5585-4119-8c4c-a23cef510a1e" containerName="discovery"
Sep 19 15:22:24.470326 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.470279    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb146e21-5585-4119-8c4c-a23cef510a1e" containerName="discovery"
Sep 19 15:22:24.470365 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.470342    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb146e21-5585-4119-8c4c-a23cef510a1e" containerName="discovery"
Sep 19 15:22:24.473455 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.473436    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-krv5g"
Sep 19 15:22:24.475587 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.475567    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 19 15:22:24.475699 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.475637    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-gsftm\""
Sep 19 15:22:24.485071 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.485047    2563 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-kubeconfig\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:22:24.485158 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.485076    2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-csr-dns-cert\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:22:24.485158 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.485092    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5dfh\" (UniqueName: \"kubernetes.io/projected/cb146e21-5585-4119-8c4c-a23cef510a1e-kube-api-access-b5dfh\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:22:24.485158 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.485107    2563 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb146e21-5585-4119-8c4c-a23cef510a1e-local-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:22:24.485158 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.485121    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-token\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:22:24.485158 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.485133    2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cb146e21-5585-4119-8c4c-a23cef510a1e-istio-csr-ca-configmap\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:22:24.485158 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.485145    2563 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cb146e21-5585-4119-8c4c-a23cef510a1e-cacerts\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:22:24.491322 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.491302    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-krv5g"]
Sep 19 15:22:24.586168 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.586122    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5jrc\" (UniqueName: \"kubernetes.io/projected/3279a3b7-0e88-4d97-a784-e24f87a9b0ee-kube-api-access-p5jrc\") pod \"llmisvc-controller-manager-777c6bd7d5-krv5g\" (UID: \"3279a3b7-0e88-4d97-a784-e24f87a9b0ee\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-krv5g"
Sep 19 15:22:24.586342 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.586197    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3279a3b7-0e88-4d97-a784-e24f87a9b0ee-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-krv5g\" (UID: \"3279a3b7-0e88-4d97-a784-e24f87a9b0ee\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-krv5g"
Sep 19 15:22:24.687262 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.687226    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3279a3b7-0e88-4d97-a784-e24f87a9b0ee-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-krv5g\" (UID: \"3279a3b7-0e88-4d97-a784-e24f87a9b0ee\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-krv5g"
Sep 19 15:22:24.687410 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.687303    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5jrc\" (UniqueName: \"kubernetes.io/projected/3279a3b7-0e88-4d97-a784-e24f87a9b0ee-kube-api-access-p5jrc\") pod \"llmisvc-controller-manager-777c6bd7d5-krv5g\" (UID: \"3279a3b7-0e88-4d97-a784-e24f87a9b0ee\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-krv5g"
Sep 19 15:22:24.689848 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.689818    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3279a3b7-0e88-4d97-a784-e24f87a9b0ee-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-krv5g\" (UID: \"3279a3b7-0e88-4d97-a784-e24f87a9b0ee\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-krv5g"
Sep 19 15:22:24.695274 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.695251    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5jrc\" (UniqueName: \"kubernetes.io/projected/3279a3b7-0e88-4d97-a784-e24f87a9b0ee-kube-api-access-p5jrc\") pod \"llmisvc-controller-manager-777c6bd7d5-krv5g\" (UID: \"3279a3b7-0e88-4d97-a784-e24f87a9b0ee\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-krv5g"
Sep 19 15:22:24.784164 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.784085    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-krv5g"
Sep 19 15:22:24.932586 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.932551    2563 generic.go:356] "Generic (PLEG): container finished" podID="cb146e21-5585-4119-8c4c-a23cef510a1e" containerID="4de69580fd17b2e83d90d33a8f4e01f28dda3ea274eea6ab7e4204c0dfc94844" exitCode=0
Sep 19 15:22:24.933016 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.932596    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"
Sep 19 15:22:24.933016 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.932636    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d" event={"ID":"cb146e21-5585-4119-8c4c-a23cef510a1e","Type":"ContainerDied","Data":"4de69580fd17b2e83d90d33a8f4e01f28dda3ea274eea6ab7e4204c0dfc94844"}
Sep 19 15:22:24.933016 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.932686    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d" event={"ID":"cb146e21-5585-4119-8c4c-a23cef510a1e","Type":"ContainerDied","Data":"10c1e6e4096b3a1773aff49e34d29f61affd62c66fed1232684769ab5e3f88f4"}
Sep 19 15:22:24.933016 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.932707    2563 scope.go:117] "RemoveContainer" containerID="4de69580fd17b2e83d90d33a8f4e01f28dda3ea274eea6ab7e4204c0dfc94844"
Sep 19 15:22:24.941239 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.941224    2563 scope.go:117] "RemoveContainer" containerID="4de69580fd17b2e83d90d33a8f4e01f28dda3ea274eea6ab7e4204c0dfc94844"
Sep 19 15:22:24.941494 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:22:24.941476    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4de69580fd17b2e83d90d33a8f4e01f28dda3ea274eea6ab7e4204c0dfc94844\": container with ID starting with 4de69580fd17b2e83d90d33a8f4e01f28dda3ea274eea6ab7e4204c0dfc94844 not found: ID does not exist" containerID="4de69580fd17b2e83d90d33a8f4e01f28dda3ea274eea6ab7e4204c0dfc94844"
Sep 19 15:22:24.941543 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.941497    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4de69580fd17b2e83d90d33a8f4e01f28dda3ea274eea6ab7e4204c0dfc94844"} err="failed to get container status \"4de69580fd17b2e83d90d33a8f4e01f28dda3ea274eea6ab7e4204c0dfc94844\": rpc error: code = NotFound desc = could not find container \"4de69580fd17b2e83d90d33a8f4e01f28dda3ea274eea6ab7e4204c0dfc94844\": container with ID starting with 4de69580fd17b2e83d90d33a8f4e01f28dda3ea274eea6ab7e4204c0dfc94844 not found: ID does not exist"
Sep 19 15:22:24.953129 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.953107    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"]
Sep 19 15:22:24.959600 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:24.959581    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d"]
Sep 19 15:22:25.056148 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:25.056066    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-krv5g"]
Sep 19 15:22:25.058913 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:22:25.058871    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3279a3b7_0e88_4d97_a784_e24f87a9b0ee.slice/crio-8270328d7623d46ef658c5eb20aaa28ab68a020ab7929b359fc96f59113b9a95 WatchSource:0}: Error finding container 8270328d7623d46ef658c5eb20aaa28ab68a020ab7929b359fc96f59113b9a95: Status 404 returned error can't find the container with id 8270328d7623d46ef658c5eb20aaa28ab68a020ab7929b359fc96f59113b9a95
Sep 19 15:22:25.062334 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:25.060987    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 15:22:25.646184 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:25.646153    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb146e21-5585-4119-8c4c-a23cef510a1e" path="/var/lib/kubelet/pods/cb146e21-5585-4119-8c4c-a23cef510a1e/volumes"
Sep 19 15:22:25.940590 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:25.940555    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-krv5g" event={"ID":"3279a3b7-0e88-4d97-a784-e24f87a9b0ee","Type":"ContainerStarted","Data":"8270328d7623d46ef658c5eb20aaa28ab68a020ab7929b359fc96f59113b9a95"}
Sep 19 15:22:27.953223 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:27.953191    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-krv5g" event={"ID":"3279a3b7-0e88-4d97-a784-e24f87a9b0ee","Type":"ContainerStarted","Data":"e5084a719948103a052689b6ccd166a9347b266942996be76241da3a75f78da0"}
Sep 19 15:22:27.953648 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:27.953268    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-krv5g"
Sep 19 15:22:27.967867 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:27.967821    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-krv5g" podStartSLOduration=1.630378522 podStartE2EDuration="3.967807098s" totalImagesPullingTime="2.337428576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:22:27.9666526 +0000 UTC m=+622.855852324" watchObservedRunningTime="2026-09-19 15:22:27.967807098 +0000 UTC m=+622.857006811"
Sep 19 15:22:58.959943 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:22:58.959883    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-krv5g"
Sep 19 15:23:19.999718 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:19.999678    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc"]
Sep 19 15:23:20.004208 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.004190    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc"
Sep 19 15:23:20.006232 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.006213    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cmsdb\""
Sep 19 15:23:20.006339 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.006217    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 19 15:23:20.006860 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.006843    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 19 15:23:20.010320 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.010299    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc"]
Sep 19 15:23:20.094527 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.094498    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59"]
Sep 19 15:23:20.098001 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.097984    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59"
Sep 19 15:23:20.105349 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.105327    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59"]
Sep 19 15:23:20.130784 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.130759    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc95eca8-f95b-42b4-8747-80a684914375-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc\" (UID: \"dc95eca8-f95b-42b4-8747-80a684914375\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc"
Sep 19 15:23:20.130936 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.130793    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc95eca8-f95b-42b4-8747-80a684914375-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc\" (UID: \"dc95eca8-f95b-42b4-8747-80a684914375\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc"
Sep 19 15:23:20.130936 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.130883    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxxhm\" (UniqueName: \"kubernetes.io/projected/dc95eca8-f95b-42b4-8747-80a684914375-kube-api-access-bxxhm\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc\" (UID: \"dc95eca8-f95b-42b4-8747-80a684914375\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc"
Sep 19 15:23:20.196471 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.196437    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm"]
Sep 19 15:23:20.199964 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.199947    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm"
Sep 19 15:23:20.207083 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.207060    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm"]
Sep 19 15:23:20.232314 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.232287    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc95eca8-f95b-42b4-8747-80a684914375-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc\" (UID: \"dc95eca8-f95b-42b4-8747-80a684914375\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc"
Sep 19 15:23:20.232477 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.232323    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc95eca8-f95b-42b4-8747-80a684914375-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc\" (UID: \"dc95eca8-f95b-42b4-8747-80a684914375\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc"
Sep 19 15:23:20.232477 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.232365    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbpkx\" (UniqueName: \"kubernetes.io/projected/37e65ef5-9849-4e81-b5f4-eef68ce4d53d-kube-api-access-kbpkx\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59\" (UID: \"37e65ef5-9849-4e81-b5f4-eef68ce4d53d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59"
Sep 19 15:23:20.232477 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.232450    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37e65ef5-9849-4e81-b5f4-eef68ce4d53d-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59\" (UID: \"37e65ef5-9849-4e81-b5f4-eef68ce4d53d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59"
Sep 19 15:23:20.232592 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.232485    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxxhm\" (UniqueName: \"kubernetes.io/projected/dc95eca8-f95b-42b4-8747-80a684914375-kube-api-access-bxxhm\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc\" (UID: \"dc95eca8-f95b-42b4-8747-80a684914375\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc"
Sep 19 15:23:20.232592 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.232513    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37e65ef5-9849-4e81-b5f4-eef68ce4d53d-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59\" (UID: \"37e65ef5-9849-4e81-b5f4-eef68ce4d53d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59"
Sep 19 15:23:20.232815 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.232684    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc95eca8-f95b-42b4-8747-80a684914375-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc\" (UID: \"dc95eca8-f95b-42b4-8747-80a684914375\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc"
Sep 19 15:23:20.232815 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.232693    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc95eca8-f95b-42b4-8747-80a684914375-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc\" (UID: \"dc95eca8-f95b-42b4-8747-80a684914375\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc"
Sep 19 15:23:20.239792 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.239766    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxxhm\" (UniqueName: \"kubernetes.io/projected/dc95eca8-f95b-42b4-8747-80a684914375-kube-api-access-bxxhm\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc\" (UID: \"dc95eca8-f95b-42b4-8747-80a684914375\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc"
Sep 19 15:23:20.298721 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.298644    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm"]
Sep 19 15:23:20.302191 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.302175    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm"
Sep 19 15:23:20.310536 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.310513    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm"]
Sep 19 15:23:20.313719 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.313699    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc"
Sep 19 15:23:20.333427 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.333405    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6952a5df-6a2c-4419-8fdc-151ebaa20077-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm\" (UID: \"6952a5df-6a2c-4419-8fdc-151ebaa20077\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm"
Sep 19 15:23:20.333536 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.333469    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbpkx\" (UniqueName: \"kubernetes.io/projected/37e65ef5-9849-4e81-b5f4-eef68ce4d53d-kube-api-access-kbpkx\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59\" (UID: \"37e65ef5-9849-4e81-b5f4-eef68ce4d53d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59"
Sep 19 15:23:20.333536 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.333495    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkgst\" (UniqueName: \"kubernetes.io/projected/6952a5df-6a2c-4419-8fdc-151ebaa20077-kube-api-access-kkgst\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm\" (UID: \"6952a5df-6a2c-4419-8fdc-151ebaa20077\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm"
Sep 19 15:23:20.333536 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.333512    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6952a5df-6a2c-4419-8fdc-151ebaa20077-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm\" (UID: \"6952a5df-6a2c-4419-8fdc-151ebaa20077\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm"
Sep 19 15:23:20.333693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.333562    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37e65ef5-9849-4e81-b5f4-eef68ce4d53d-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59\" (UID: \"37e65ef5-9849-4e81-b5f4-eef68ce4d53d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59"
Sep 19 15:23:20.333693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.333595    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37e65ef5-9849-4e81-b5f4-eef68ce4d53d-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59\" (UID: \"37e65ef5-9849-4e81-b5f4-eef68ce4d53d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59"
Sep 19 15:23:20.333954 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.333931    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37e65ef5-9849-4e81-b5f4-eef68ce4d53d-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59\" (UID: \"37e65ef5-9849-4e81-b5f4-eef68ce4d53d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59"
Sep 19 15:23:20.334023 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.333936    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37e65ef5-9849-4e81-b5f4-eef68ce4d53d-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59\" (UID: \"37e65ef5-9849-4e81-b5f4-eef68ce4d53d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59"
Sep 19 15:23:20.341112 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.341085    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbpkx\" (UniqueName: \"kubernetes.io/projected/37e65ef5-9849-4e81-b5f4-eef68ce4d53d-kube-api-access-kbpkx\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59\" (UID: \"37e65ef5-9849-4e81-b5f4-eef68ce4d53d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59"
Sep 19 15:23:20.407386 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.407350    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59"
Sep 19 15:23:20.434809 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.434779    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm\" (UID: \"cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm"
Sep 19 15:23:20.434972 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.434829    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm\" (UID: \"cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm"
Sep 19 15:23:20.435076 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.435050    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkgst\" (UniqueName: \"kubernetes.io/projected/6952a5df-6a2c-4419-8fdc-151ebaa20077-kube-api-access-kkgst\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm\" (UID: \"6952a5df-6a2c-4419-8fdc-151ebaa20077\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm"
Sep 19 15:23:20.435119 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.435103    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6952a5df-6a2c-4419-8fdc-151ebaa20077-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm\" (UID: \"6952a5df-6a2c-4419-8fdc-151ebaa20077\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm"
Sep 19 15:23:20.435215 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.435195    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5m5b\" (UniqueName: \"kubernetes.io/projected/cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a-kube-api-access-b5m5b\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm\" (UID: \"cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm"
Sep 19 15:23:20.435290 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.435242    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6952a5df-6a2c-4419-8fdc-151ebaa20077-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm\" (UID: \"6952a5df-6a2c-4419-8fdc-151ebaa20077\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm"
Sep 19 15:23:20.435492 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.435471    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6952a5df-6a2c-4419-8fdc-151ebaa20077-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm\" (UID: \"6952a5df-6a2c-4419-8fdc-151ebaa20077\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm"
Sep 19 15:23:20.435571 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.435520    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6952a5df-6a2c-4419-8fdc-151ebaa20077-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm\" (UID: \"6952a5df-6a2c-4419-8fdc-151ebaa20077\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm"
Sep 19 15:23:20.442602 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.442573    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkgst\" (UniqueName: \"kubernetes.io/projected/6952a5df-6a2c-4419-8fdc-151ebaa20077-kube-api-access-kkgst\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm\" (UID: \"6952a5df-6a2c-4419-8fdc-151ebaa20077\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm"
Sep 19 15:23:20.509275 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.509231    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm"
Sep 19 15:23:20.536011 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.535981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5m5b\" (UniqueName: \"kubernetes.io/projected/cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a-kube-api-access-b5m5b\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm\" (UID: \"cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm"
Sep 19 15:23:20.536172 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.536030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm\" (UID: \"cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm"
Sep 19 15:23:20.536172 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.536069    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm\" (UID: \"cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm"
Sep 19 15:23:20.536472 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.536453    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm\" (UID: \"cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm"
Sep 19 15:23:20.536547 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.536522    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm\" (UID: \"cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm"
Sep 19 15:23:20.543599 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.543577    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5m5b\" (UniqueName: \"kubernetes.io/projected/cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a-kube-api-access-b5m5b\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm\" (UID: \"cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm"
Sep 19 15:23:20.588559 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.588527    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc"]
Sep 19 15:23:20.590430 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:23:20.590406    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc95eca8_f95b_42b4_8747_80a684914375.slice/crio-bade603bc421a5f401087ef1a861907d2a32a33c802be8beabea39be8ab395ee WatchSource:0}: Error finding container bade603bc421a5f401087ef1a861907d2a32a33c802be8beabea39be8ab395ee: Status 404 returned error can't find the container with id bade603bc421a5f401087ef1a861907d2a32a33c802be8beabea39be8ab395ee
Sep 19 15:23:20.612502 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.612470    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm"
Sep 19 15:23:20.684833 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.684804    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59"]
Sep 19 15:23:20.687964 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:23:20.687935    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e65ef5_9849_4e81_b5f4_eef68ce4d53d.slice/crio-f90acf38246ceaca6dfffafa4cc9209c7d8a6140be6e8acb975cc5268d49adec WatchSource:0}: Error finding container f90acf38246ceaca6dfffafa4cc9209c7d8a6140be6e8acb975cc5268d49adec: Status 404 returned error can't find the container with id f90acf38246ceaca6dfffafa4cc9209c7d8a6140be6e8acb975cc5268d49adec
Sep 19 15:23:20.781783 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.781756    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm"]
Sep 19 15:23:20.783574 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:23:20.783552    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6952a5df_6a2c_4419_8fdc_151ebaa20077.slice/crio-8933060d4f319d20bd8991fd83a115dc95543c1d74dd54dd5be1f00114ae317b WatchSource:0}: Error finding container 8933060d4f319d20bd8991fd83a115dc95543c1d74dd54dd5be1f00114ae317b: Status 404 returned error can't find the container with id 8933060d4f319d20bd8991fd83a115dc95543c1d74dd54dd5be1f00114ae317b
Sep 19 15:23:20.887317 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:20.887271    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm"]
Sep 19 15:23:20.889463 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:23:20.889435    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcae0a9a2_a8cb_4360_8ef4_bcd78b05a50a.slice/crio-7429549cf32543a3b254ec6e995b0f38537cb392b6da9a259b1921d143973cba WatchSource:0}: Error finding container 7429549cf32543a3b254ec6e995b0f38537cb392b6da9a259b1921d143973cba: Status 404 returned error can't find the container with id 7429549cf32543a3b254ec6e995b0f38537cb392b6da9a259b1921d143973cba
Sep 19 15:23:21.205764 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:21.205728    2563 generic.go:356] "Generic (PLEG): container finished" podID="dc95eca8-f95b-42b4-8747-80a684914375" containerID="e4d8771ddb3f2929107e27091302bb720202bd929d92820c7aff7be798ba403c" exitCode=0
Sep 19 15:23:21.206185 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:21.205810    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc" event={"ID":"dc95eca8-f95b-42b4-8747-80a684914375","Type":"ContainerDied","Data":"e4d8771ddb3f2929107e27091302bb720202bd929d92820c7aff7be798ba403c"}
Sep 19 15:23:21.206185 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:21.205868    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc" event={"ID":"dc95eca8-f95b-42b4-8747-80a684914375","Type":"ContainerStarted","Data":"bade603bc421a5f401087ef1a861907d2a32a33c802be8beabea39be8ab395ee"}
Sep 19 15:23:21.207429 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:21.207381    2563 generic.go:356] "Generic (PLEG): container finished" podID="37e65ef5-9849-4e81-b5f4-eef68ce4d53d" containerID="bfb34963582454e6ae4c2a31fbf428afc6563614c448162e230de524dbccba90" exitCode=0
Sep 19 15:23:21.207500 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:21.207443    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59" event={"ID":"37e65ef5-9849-4e81-b5f4-eef68ce4d53d","Type":"ContainerDied","Data":"bfb34963582454e6ae4c2a31fbf428afc6563614c448162e230de524dbccba90"}
Sep 19 15:23:21.207549 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:21.207502    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59" event={"ID":"37e65ef5-9849-4e81-b5f4-eef68ce4d53d","Type":"ContainerStarted","Data":"f90acf38246ceaca6dfffafa4cc9209c7d8a6140be6e8acb975cc5268d49adec"}
Sep 19 15:23:21.209251 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:21.209145    2563 generic.go:356] "Generic (PLEG): container finished" podID="6952a5df-6a2c-4419-8fdc-151ebaa20077" containerID="3bc118561574ed3c4ab5ab6b4d478776a04011373f979d1572caa8022d60149f" exitCode=0
Sep 19 15:23:21.209251 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:21.209175    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm" event={"ID":"6952a5df-6a2c-4419-8fdc-151ebaa20077","Type":"ContainerDied","Data":"3bc118561574ed3c4ab5ab6b4d478776a04011373f979d1572caa8022d60149f"}
Sep 19 15:23:21.209251 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:21.209220    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm" event={"ID":"6952a5df-6a2c-4419-8fdc-151ebaa20077","Type":"ContainerStarted","Data":"8933060d4f319d20bd8991fd83a115dc95543c1d74dd54dd5be1f00114ae317b"}
Sep 19 15:23:21.211002 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:21.210972    2563 generic.go:356] "Generic (PLEG): container finished" podID="cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a" containerID="ca1fd6dbdc9c026058aba712b9028d969ae548fc3ecdcbd3721ec93c3e2b23ce" exitCode=0
Sep 19 15:23:21.211087 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:21.211001    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm" event={"ID":"cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a","Type":"ContainerDied","Data":"ca1fd6dbdc9c026058aba712b9028d969ae548fc3ecdcbd3721ec93c3e2b23ce"}
Sep 19 15:23:21.211087 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:21.211038    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm" event={"ID":"cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a","Type":"ContainerStarted","Data":"7429549cf32543a3b254ec6e995b0f38537cb392b6da9a259b1921d143973cba"}
Sep 19 15:23:22.218257 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:22.218222    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm" event={"ID":"6952a5df-6a2c-4419-8fdc-151ebaa20077","Type":"ContainerStarted","Data":"fd9df224e668f42e9048c103db81c2d001dc7dfa0d7b89a33ff5fab803420a2a"}
Sep 19 15:23:22.220318 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:22.220292    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc" event={"ID":"dc95eca8-f95b-42b4-8747-80a684914375","Type":"ContainerStarted","Data":"e9e5394cc60ee9f0814800e5d3cb6ef5cfb796e2dc138113331399df7d618968"}
Sep 19 15:23:23.228097 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:23.228059    2563 generic.go:356] "Generic (PLEG): container finished" podID="6952a5df-6a2c-4419-8fdc-151ebaa20077" containerID="fd9df224e668f42e9048c103db81c2d001dc7dfa0d7b89a33ff5fab803420a2a" exitCode=0
Sep 19 15:23:23.228097 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:23.228090    2563 generic.go:356] "Generic (PLEG): container finished" podID="6952a5df-6a2c-4419-8fdc-151ebaa20077" containerID="6e8d011964296578b69085dadd3e9f6e3b5bb348cc70787c3a442d8c403c2c11" exitCode=0
Sep 19 15:23:23.228524 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:23.228136    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm" event={"ID":"6952a5df-6a2c-4419-8fdc-151ebaa20077","Type":"ContainerDied","Data":"fd9df224e668f42e9048c103db81c2d001dc7dfa0d7b89a33ff5fab803420a2a"}
Sep 19 15:23:23.228524 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:23.228187    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm" event={"ID":"6952a5df-6a2c-4419-8fdc-151ebaa20077","Type":"ContainerDied","Data":"6e8d011964296578b69085dadd3e9f6e3b5bb348cc70787c3a442d8c403c2c11"}
Sep 19 15:23:23.229817 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:23.229792    2563 generic.go:356] "Generic (PLEG): container finished" podID="cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a" containerID="0b378385340e075b49a25617398cc12f4dde12b012460e5a0f4fb0fa62a00498" exitCode=0
Sep 19 15:23:23.229952 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:23.229868    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm" event={"ID":"cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a","Type":"ContainerDied","Data":"0b378385340e075b49a25617398cc12f4dde12b012460e5a0f4fb0fa62a00498"}
Sep 19 15:23:23.232160 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:23.232134    2563 generic.go:356] "Generic (PLEG): container finished" podID="dc95eca8-f95b-42b4-8747-80a684914375" containerID="e9e5394cc60ee9f0814800e5d3cb6ef5cfb796e2dc138113331399df7d618968" exitCode=0
Sep 19 15:23:23.232160 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:23.232149    2563 generic.go:356] "Generic (PLEG): container finished" podID="dc95eca8-f95b-42b4-8747-80a684914375" containerID="8757b5cd66833e9822e652f382d017381eea0e4495baa847c95c505c60df35f5" exitCode=0
Sep 19 15:23:23.232293 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:23.232206    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc" event={"ID":"dc95eca8-f95b-42b4-8747-80a684914375","Type":"ContainerDied","Data":"e9e5394cc60ee9f0814800e5d3cb6ef5cfb796e2dc138113331399df7d618968"}
Sep 19 15:23:23.232293 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:23.232249    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc" event={"ID":"dc95eca8-f95b-42b4-8747-80a684914375","Type":"ContainerDied","Data":"8757b5cd66833e9822e652f382d017381eea0e4495baa847c95c505c60df35f5"}
Sep 19 15:23:23.233875 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:23.233857    2563 generic.go:356] "Generic (PLEG): container finished" podID="37e65ef5-9849-4e81-b5f4-eef68ce4d53d" containerID="e9b41ea9b5110eddd232e084d08df3e40f3972368e576806da1bef998fdc037f" exitCode=0
Sep 19 15:23:23.233966 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:23.233921    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59" event={"ID":"37e65ef5-9849-4e81-b5f4-eef68ce4d53d","Type":"ContainerDied","Data":"e9b41ea9b5110eddd232e084d08df3e40f3972368e576806da1bef998fdc037f"}
Sep 19 15:23:24.240705 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.240673    2563 generic.go:356] "Generic (PLEG): container finished" podID="cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a" containerID="742990a2e7d124a8585281e496287f3aeb95635392f64c67715c12524a594c33" exitCode=0
Sep 19 15:23:24.241104 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.240753    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm" event={"ID":"cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a","Type":"ContainerDied","Data":"742990a2e7d124a8585281e496287f3aeb95635392f64c67715c12524a594c33"}
Sep 19 15:23:24.242949 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.242928    2563 generic.go:356] "Generic (PLEG): container finished" podID="37e65ef5-9849-4e81-b5f4-eef68ce4d53d" containerID="a124ae9cce645a4ce058a5febf9b7e47b27c497bdf2b91ab25fdd4d70c3ed0ce" exitCode=0
Sep 19 15:23:24.243059 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.242982    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59" event={"ID":"37e65ef5-9849-4e81-b5f4-eef68ce4d53d","Type":"ContainerDied","Data":"a124ae9cce645a4ce058a5febf9b7e47b27c497bdf2b91ab25fdd4d70c3ed0ce"}
Sep 19 15:23:24.362474 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.362450    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm"
Sep 19 15:23:24.404348 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.404326    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc"
Sep 19 15:23:24.470991 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.470962    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6952a5df-6a2c-4419-8fdc-151ebaa20077-bundle\") pod \"6952a5df-6a2c-4419-8fdc-151ebaa20077\" (UID: \"6952a5df-6a2c-4419-8fdc-151ebaa20077\") "
Sep 19 15:23:24.471159 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.471055    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkgst\" (UniqueName: \"kubernetes.io/projected/6952a5df-6a2c-4419-8fdc-151ebaa20077-kube-api-access-kkgst\") pod \"6952a5df-6a2c-4419-8fdc-151ebaa20077\" (UID: \"6952a5df-6a2c-4419-8fdc-151ebaa20077\") "
Sep 19 15:23:24.471159 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.471080    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6952a5df-6a2c-4419-8fdc-151ebaa20077-util\") pod \"6952a5df-6a2c-4419-8fdc-151ebaa20077\" (UID: \"6952a5df-6a2c-4419-8fdc-151ebaa20077\") "
Sep 19 15:23:24.472080 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.472046    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6952a5df-6a2c-4419-8fdc-151ebaa20077-bundle" (OuterVolumeSpecName: "bundle") pod "6952a5df-6a2c-4419-8fdc-151ebaa20077" (UID: "6952a5df-6a2c-4419-8fdc-151ebaa20077"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:23:24.478573 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.477557    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6952a5df-6a2c-4419-8fdc-151ebaa20077-kube-api-access-kkgst" (OuterVolumeSpecName: "kube-api-access-kkgst") pod "6952a5df-6a2c-4419-8fdc-151ebaa20077" (UID: "6952a5df-6a2c-4419-8fdc-151ebaa20077"). InnerVolumeSpecName "kube-api-access-kkgst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:23:24.479629 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.479583    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6952a5df-6a2c-4419-8fdc-151ebaa20077-util" (OuterVolumeSpecName: "util") pod "6952a5df-6a2c-4419-8fdc-151ebaa20077" (UID: "6952a5df-6a2c-4419-8fdc-151ebaa20077"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:23:24.573046 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.572959    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc95eca8-f95b-42b4-8747-80a684914375-bundle\") pod \"dc95eca8-f95b-42b4-8747-80a684914375\" (UID: \"dc95eca8-f95b-42b4-8747-80a684914375\") "
Sep 19 15:23:24.573046 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.573026    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc95eca8-f95b-42b4-8747-80a684914375-util\") pod \"dc95eca8-f95b-42b4-8747-80a684914375\" (UID: \"dc95eca8-f95b-42b4-8747-80a684914375\") "
Sep 19 15:23:24.573231 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.573065    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxxhm\" (UniqueName: \"kubernetes.io/projected/dc95eca8-f95b-42b4-8747-80a684914375-kube-api-access-bxxhm\") pod \"dc95eca8-f95b-42b4-8747-80a684914375\" (UID: \"dc95eca8-f95b-42b4-8747-80a684914375\") "
Sep 19 15:23:24.573231 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.573225    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkgst\" (UniqueName: \"kubernetes.io/projected/6952a5df-6a2c-4419-8fdc-151ebaa20077-kube-api-access-kkgst\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:23:24.573302 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.573243    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6952a5df-6a2c-4419-8fdc-151ebaa20077-util\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:23:24.573302 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.573255    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6952a5df-6a2c-4419-8fdc-151ebaa20077-bundle\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:23:24.573568 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.573539    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc95eca8-f95b-42b4-8747-80a684914375-bundle" (OuterVolumeSpecName: "bundle") pod "dc95eca8-f95b-42b4-8747-80a684914375" (UID: "dc95eca8-f95b-42b4-8747-80a684914375"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:23:24.575370 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.575348    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc95eca8-f95b-42b4-8747-80a684914375-kube-api-access-bxxhm" (OuterVolumeSpecName: "kube-api-access-bxxhm") pod "dc95eca8-f95b-42b4-8747-80a684914375" (UID: "dc95eca8-f95b-42b4-8747-80a684914375"). InnerVolumeSpecName "kube-api-access-bxxhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:23:24.578675 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.578650    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc95eca8-f95b-42b4-8747-80a684914375-util" (OuterVolumeSpecName: "util") pod "dc95eca8-f95b-42b4-8747-80a684914375" (UID: "dc95eca8-f95b-42b4-8747-80a684914375"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:23:24.674636 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.674589    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc95eca8-f95b-42b4-8747-80a684914375-bundle\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:23:24.674636 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.674630    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc95eca8-f95b-42b4-8747-80a684914375-util\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:23:24.674636 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:24.674639    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxxhm\" (UniqueName: \"kubernetes.io/projected/dc95eca8-f95b-42b4-8747-80a684914375-kube-api-access-bxxhm\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:23:25.249753 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.249719    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc"
Sep 19 15:23:25.249753 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.249731    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t66hc" event={"ID":"dc95eca8-f95b-42b4-8747-80a684914375","Type":"ContainerDied","Data":"bade603bc421a5f401087ef1a861907d2a32a33c802be8beabea39be8ab395ee"}
Sep 19 15:23:25.250286 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.249776    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bade603bc421a5f401087ef1a861907d2a32a33c802be8beabea39be8ab395ee"
Sep 19 15:23:25.251634 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.251618    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm"
Sep 19 15:23:25.251749 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.251660    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6dxdm" event={"ID":"6952a5df-6a2c-4419-8fdc-151ebaa20077","Type":"ContainerDied","Data":"8933060d4f319d20bd8991fd83a115dc95543c1d74dd54dd5be1f00114ae317b"}
Sep 19 15:23:25.251749 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.251703    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8933060d4f319d20bd8991fd83a115dc95543c1d74dd54dd5be1f00114ae317b"
Sep 19 15:23:25.387805 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.387783    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59"
Sep 19 15:23:25.422991 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.422965    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm"
Sep 19 15:23:25.480485 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.480459    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37e65ef5-9849-4e81-b5f4-eef68ce4d53d-bundle\") pod \"37e65ef5-9849-4e81-b5f4-eef68ce4d53d\" (UID: \"37e65ef5-9849-4e81-b5f4-eef68ce4d53d\") "
Sep 19 15:23:25.480643 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.480497    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbpkx\" (UniqueName: \"kubernetes.io/projected/37e65ef5-9849-4e81-b5f4-eef68ce4d53d-kube-api-access-kbpkx\") pod \"37e65ef5-9849-4e81-b5f4-eef68ce4d53d\" (UID: \"37e65ef5-9849-4e81-b5f4-eef68ce4d53d\") "
Sep 19 15:23:25.480643 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.480558    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37e65ef5-9849-4e81-b5f4-eef68ce4d53d-util\") pod \"37e65ef5-9849-4e81-b5f4-eef68ce4d53d\" (UID: \"37e65ef5-9849-4e81-b5f4-eef68ce4d53d\") "
Sep 19 15:23:25.480999 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.480967    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e65ef5-9849-4e81-b5f4-eef68ce4d53d-bundle" (OuterVolumeSpecName: "bundle") pod "37e65ef5-9849-4e81-b5f4-eef68ce4d53d" (UID: "37e65ef5-9849-4e81-b5f4-eef68ce4d53d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:23:25.482786 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.482763    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37e65ef5-9849-4e81-b5f4-eef68ce4d53d-kube-api-access-kbpkx" (OuterVolumeSpecName: "kube-api-access-kbpkx") pod "37e65ef5-9849-4e81-b5f4-eef68ce4d53d" (UID: "37e65ef5-9849-4e81-b5f4-eef68ce4d53d"). InnerVolumeSpecName "kube-api-access-kbpkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:23:25.485946 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.485908    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e65ef5-9849-4e81-b5f4-eef68ce4d53d-util" (OuterVolumeSpecName: "util") pod "37e65ef5-9849-4e81-b5f4-eef68ce4d53d" (UID: "37e65ef5-9849-4e81-b5f4-eef68ce4d53d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:23:25.581247 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.581172    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a-util\") pod \"cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a\" (UID: \"cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a\") "
Sep 19 15:23:25.581436 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.581276    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5m5b\" (UniqueName: \"kubernetes.io/projected/cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a-kube-api-access-b5m5b\") pod \"cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a\" (UID: \"cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a\") "
Sep 19 15:23:25.581436 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.581319    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a-bundle\") pod \"cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a\" (UID: \"cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a\") "
Sep 19 15:23:25.581519 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.581503    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37e65ef5-9849-4e81-b5f4-eef68ce4d53d-util\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:23:25.581553 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.581520    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37e65ef5-9849-4e81-b5f4-eef68ce4d53d-bundle\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:23:25.581553 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.581533    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbpkx\" (UniqueName: \"kubernetes.io/projected/37e65ef5-9849-4e81-b5f4-eef68ce4d53d-kube-api-access-kbpkx\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:23:25.581794 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.581769    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a-bundle" (OuterVolumeSpecName: "bundle") pod "cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a" (UID: "cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:23:25.583570 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.583548    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a-kube-api-access-b5m5b" (OuterVolumeSpecName: "kube-api-access-b5m5b") pod "cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a" (UID: "cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a"). InnerVolumeSpecName "kube-api-access-b5m5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:23:25.586633 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.586614    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a-util" (OuterVolumeSpecName: "util") pod "cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a" (UID: "cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:23:25.682826 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.682797    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5m5b\" (UniqueName: \"kubernetes.io/projected/cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a-kube-api-access-b5m5b\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:23:25.682826 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.682821    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a-bundle\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:23:25.682826 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:25.682831    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a-util\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:23:26.258675 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:26.258649    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59"
Sep 19 15:23:26.258675 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:26.258670    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx4t59" event={"ID":"37e65ef5-9849-4e81-b5f4-eef68ce4d53d","Type":"ContainerDied","Data":"f90acf38246ceaca6dfffafa4cc9209c7d8a6140be6e8acb975cc5268d49adec"}
Sep 19 15:23:26.259154 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:26.258719    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f90acf38246ceaca6dfffafa4cc9209c7d8a6140be6e8acb975cc5268d49adec"
Sep 19 15:23:26.260824 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:26.260790    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm" event={"ID":"cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a","Type":"ContainerDied","Data":"7429549cf32543a3b254ec6e995b0f38537cb392b6da9a259b1921d143973cba"}
Sep 19 15:23:26.261008 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:26.260838    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7429549cf32543a3b254ec6e995b0f38537cb392b6da9a259b1921d143973cba"
Sep 19 15:23:26.261008 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:26.260867    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jd6lm"
Sep 19 15:23:31.849513 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849483    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9"]
Sep 19 15:23:31.849888 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849774    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc95eca8-f95b-42b4-8747-80a684914375" containerName="extract"
Sep 19 15:23:31.849888 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849785    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc95eca8-f95b-42b4-8747-80a684914375" containerName="extract"
Sep 19 15:23:31.849888 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849813    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a" containerName="pull"
Sep 19 15:23:31.849888 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849818    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a" containerName="pull"
Sep 19 15:23:31.849888 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849826    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc95eca8-f95b-42b4-8747-80a684914375" containerName="pull"
Sep 19 15:23:31.849888 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849831    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc95eca8-f95b-42b4-8747-80a684914375" containerName="pull"
Sep 19 15:23:31.849888 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849837    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37e65ef5-9849-4e81-b5f4-eef68ce4d53d" containerName="pull"
Sep 19 15:23:31.849888 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849842    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="37e65ef5-9849-4e81-b5f4-eef68ce4d53d" containerName="pull"
Sep 19 15:23:31.849888 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849848    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a" containerName="extract"
Sep 19 15:23:31.849888 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849853    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a" containerName="extract"
Sep 19 15:23:31.849888 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849860    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37e65ef5-9849-4e81-b5f4-eef68ce4d53d" containerName="util"
Sep 19 15:23:31.849888 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849865    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="37e65ef5-9849-4e81-b5f4-eef68ce4d53d" containerName="util"
Sep 19 15:23:31.849888 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849874    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a" containerName="util"
Sep 19 15:23:31.849888 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849878    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a" containerName="util"
Sep 19 15:23:31.849888 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849884    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6952a5df-6a2c-4419-8fdc-151ebaa20077" containerName="pull"
Sep 19 15:23:31.849888 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849888    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6952a5df-6a2c-4419-8fdc-151ebaa20077" containerName="pull"
Sep 19 15:23:31.849888 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849912    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6952a5df-6a2c-4419-8fdc-151ebaa20077" containerName="extract"
Sep 19 15:23:31.850392 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849917    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6952a5df-6a2c-4419-8fdc-151ebaa20077" containerName="extract"
Sep 19 15:23:31.850392 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849925    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc95eca8-f95b-42b4-8747-80a684914375" containerName="util"
Sep 19 15:23:31.850392 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849930    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc95eca8-f95b-42b4-8747-80a684914375" containerName="util"
Sep 19 15:23:31.850392 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849935    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6952a5df-6a2c-4419-8fdc-151ebaa20077" containerName="util"
Sep 19 15:23:31.850392 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849939    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6952a5df-6a2c-4419-8fdc-151ebaa20077" containerName="util"
Sep 19 15:23:31.850392 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849946    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37e65ef5-9849-4e81-b5f4-eef68ce4d53d" containerName="extract"
Sep 19 15:23:31.850392 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849950    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="37e65ef5-9849-4e81-b5f4-eef68ce4d53d" containerName="extract"
Sep 19 15:23:31.850392 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.849998    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="37e65ef5-9849-4e81-b5f4-eef68ce4d53d" containerName="extract"
Sep 19 15:23:31.850392 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.850007    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6952a5df-6a2c-4419-8fdc-151ebaa20077" containerName="extract"
Sep 19 15:23:31.850392 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.850013    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc95eca8-f95b-42b4-8747-80a684914375" containerName="extract"
Sep 19 15:23:31.850392 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.850017    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cae0a9a2-a8cb-4360-8ef4-bcd78b05a50a" containerName="extract"
Sep 19 15:23:31.852946 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.852930    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9"
Sep 19 15:23:31.854839 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.854818    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 19 15:23:31.855013 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.854994    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-wxrlw\""
Sep 19 15:23:31.855564 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.855544    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 19 15:23:31.867919 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:31.867884    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9"]
Sep 19 15:23:32.038595 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:32.038556    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvntl\" (UniqueName: \"kubernetes.io/projected/c29212c3-bc91-45ee-b3c7-91222fc25e43-kube-api-access-bvntl\") pod \"limitador-operator-controller-manager-74495c69f8-m29p9\" (UID: \"c29212c3-bc91-45ee-b3c7-91222fc25e43\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9"
Sep 19 15:23:32.139529 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:32.139441    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvntl\" (UniqueName: \"kubernetes.io/projected/c29212c3-bc91-45ee-b3c7-91222fc25e43-kube-api-access-bvntl\") pod \"limitador-operator-controller-manager-74495c69f8-m29p9\" (UID: \"c29212c3-bc91-45ee-b3c7-91222fc25e43\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9"
Sep 19 15:23:32.151100 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:32.151071    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvntl\" (UniqueName: \"kubernetes.io/projected/c29212c3-bc91-45ee-b3c7-91222fc25e43-kube-api-access-bvntl\") pod \"limitador-operator-controller-manager-74495c69f8-m29p9\" (UID: \"c29212c3-bc91-45ee-b3c7-91222fc25e43\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9"
Sep 19 15:23:32.162825 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:32.162795    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9"
Sep 19 15:23:32.433807 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:32.433782    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9"]
Sep 19 15:23:32.435538 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:23:32.435507    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc29212c3_bc91_45ee_b3c7_91222fc25e43.slice/crio-e85f15c45fb183110410741a54ef73f6ba2f6c42118b0dd249b9e15793f098f1 WatchSource:0}: Error finding container e85f15c45fb183110410741a54ef73f6ba2f6c42118b0dd249b9e15793f098f1: Status 404 returned error can't find the container with id e85f15c45fb183110410741a54ef73f6ba2f6c42118b0dd249b9e15793f098f1
Sep 19 15:23:33.298725 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:33.298689    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9" event={"ID":"c29212c3-bc91-45ee-b3c7-91222fc25e43","Type":"ContainerStarted","Data":"e85f15c45fb183110410741a54ef73f6ba2f6c42118b0dd249b9e15793f098f1"}
Sep 19 15:23:36.316709 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:36.316673    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9" event={"ID":"c29212c3-bc91-45ee-b3c7-91222fc25e43","Type":"ContainerStarted","Data":"29fc3e5e48a435dba44c46dea744788b75668fd0d0cdf7b2d2d66da98cf4c266"}
Sep 19 15:23:36.317121 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:36.316854    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9"
Sep 19 15:23:36.335578 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:36.335530    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9" podStartSLOduration=2.215003048 podStartE2EDuration="5.33551513s" totalImagesPullingTime="3.120512082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:23:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:23:36.333836597 +0000 UTC m=+691.223036321" watchObservedRunningTime="2026-09-19 15:23:36.33551513 +0000 UTC m=+691.224714843"
Sep 19 15:23:38.025125 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:38.025092    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9wcr6"]
Sep 19 15:23:38.028476 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:38.028460    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9wcr6"
Sep 19 15:23:38.030553 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:38.030536    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6zgw9\""
Sep 19 15:23:38.030626 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:38.030545    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 19 15:23:38.038874 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:38.038848    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9wcr6"]
Sep 19 15:23:38.090214 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:38.090179    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-876gg\" (UniqueName: \"kubernetes.io/projected/aa149697-f733-4a71-bd29-0b3fe03670ff-kube-api-access-876gg\") pod \"dns-operator-controller-manager-7b84cd7c9c-9wcr6\" (UID: \"aa149697-f733-4a71-bd29-0b3fe03670ff\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9wcr6"
Sep 19 15:23:38.191653 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:38.191615    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-876gg\" (UniqueName: \"kubernetes.io/projected/aa149697-f733-4a71-bd29-0b3fe03670ff-kube-api-access-876gg\") pod \"dns-operator-controller-manager-7b84cd7c9c-9wcr6\" (UID: \"aa149697-f733-4a71-bd29-0b3fe03670ff\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9wcr6"
Sep 19 15:23:38.205079 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:38.205054    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-876gg\" (UniqueName: \"kubernetes.io/projected/aa149697-f733-4a71-bd29-0b3fe03670ff-kube-api-access-876gg\") pod \"dns-operator-controller-manager-7b84cd7c9c-9wcr6\" (UID: \"aa149697-f733-4a71-bd29-0b3fe03670ff\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9wcr6"
Sep 19 15:23:38.338391 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:38.338306    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9wcr6"
Sep 19 15:23:38.613203 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:38.613180    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9wcr6"]
Sep 19 15:23:38.615063 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:23:38.615036    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa149697_f733_4a71_bd29_0b3fe03670ff.slice/crio-45d0a94869b9c75b1d47853276d73bb6d650753123e9862ea3e98e727624ec99 WatchSource:0}: Error finding container 45d0a94869b9c75b1d47853276d73bb6d650753123e9862ea3e98e727624ec99: Status 404 returned error can't find the container with id 45d0a94869b9c75b1d47853276d73bb6d650753123e9862ea3e98e727624ec99
Sep 19 15:23:39.334259 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:39.334221    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9wcr6" event={"ID":"aa149697-f733-4a71-bd29-0b3fe03670ff","Type":"ContainerStarted","Data":"45d0a94869b9c75b1d47853276d73bb6d650753123e9862ea3e98e727624ec99"}
Sep 19 15:23:40.629763 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:40.629736    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-764dn"]
Sep 19 15:23:40.633160 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:40.633136    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-764dn"
Sep 19 15:23:40.635245 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:40.635223    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-px89h\""
Sep 19 15:23:40.645163 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:40.645137    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-764dn"]
Sep 19 15:23:40.709338 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:40.709309    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkj9x\" (UniqueName: \"kubernetes.io/projected/c1ebbd5b-8964-4d42-a2e2-357b609eb06f-kube-api-access-qkj9x\") pod \"authorino-operator-76b478bd78-764dn\" (UID: \"c1ebbd5b-8964-4d42-a2e2-357b609eb06f\") " pod="kuadrant-system/authorino-operator-76b478bd78-764dn"
Sep 19 15:23:40.810380 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:40.810352    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkj9x\" (UniqueName: \"kubernetes.io/projected/c1ebbd5b-8964-4d42-a2e2-357b609eb06f-kube-api-access-qkj9x\") pod \"authorino-operator-76b478bd78-764dn\" (UID: \"c1ebbd5b-8964-4d42-a2e2-357b609eb06f\") " pod="kuadrant-system/authorino-operator-76b478bd78-764dn"
Sep 19 15:23:40.819154 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:40.819098    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkj9x\" (UniqueName: \"kubernetes.io/projected/c1ebbd5b-8964-4d42-a2e2-357b609eb06f-kube-api-access-qkj9x\") pod \"authorino-operator-76b478bd78-764dn\" (UID: \"c1ebbd5b-8964-4d42-a2e2-357b609eb06f\") " pod="kuadrant-system/authorino-operator-76b478bd78-764dn"
Sep 19 15:23:40.943968 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:40.943934    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-764dn"
Sep 19 15:23:41.220080 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:41.220057    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-764dn"]
Sep 19 15:23:41.221781 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:23:41.221751    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1ebbd5b_8964_4d42_a2e2_357b609eb06f.slice/crio-a0fd563cfc091ae586e7a3c4fbbe4f1d91c9d4c7f893a23f89c16588ba467c11 WatchSource:0}: Error finding container a0fd563cfc091ae586e7a3c4fbbe4f1d91c9d4c7f893a23f89c16588ba467c11: Status 404 returned error can't find the container with id a0fd563cfc091ae586e7a3c4fbbe4f1d91c9d4c7f893a23f89c16588ba467c11
Sep 19 15:23:41.346734 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:41.346692    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9wcr6" event={"ID":"aa149697-f733-4a71-bd29-0b3fe03670ff","Type":"ContainerStarted","Data":"38dc1b2d412454e07efd3fd547d4503bfd6c9e275544a033d4078f19b5f0fc31"}
Sep 19 15:23:41.346928 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:41.346879    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9wcr6"
Sep 19 15:23:41.348083 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:41.348057    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-764dn" event={"ID":"c1ebbd5b-8964-4d42-a2e2-357b609eb06f","Type":"ContainerStarted","Data":"a0fd563cfc091ae586e7a3c4fbbe4f1d91c9d4c7f893a23f89c16588ba467c11"}
Sep 19 15:23:41.365835 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:41.365780    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9wcr6" podStartSLOduration=2.417083055 podStartE2EDuration="4.365764793s" totalImagesPullingTime="1.948681738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:23:41.363435735 +0000 UTC m=+696.252635431" watchObservedRunningTime="2026-09-19 15:23:41.365764793 +0000 UTC m=+696.254964506"
Sep 19 15:23:43.364916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:43.364858    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-764dn" event={"ID":"c1ebbd5b-8964-4d42-a2e2-357b609eb06f","Type":"ContainerStarted","Data":"1e7442ed67788a9cd26ba55a8ce0c2eafbb3b03d5f2d0554f5540813c22a258a"}
Sep 19 15:23:43.365328 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:43.364983    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-764dn"
Sep 19 15:23:43.380533 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:43.380485    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-764dn" podStartSLOduration=1.6817709280000002 podStartE2EDuration="3.380472054s" totalImagesPullingTime="1.698701126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:23:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:23:43.37945254 +0000 UTC m=+698.268652257" watchObservedRunningTime="2026-09-19 15:23:43.380472054 +0000 UTC m=+698.269671767"
Sep 19 15:23:47.324912 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:47.324867    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9"
Sep 19 15:23:52.355601 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:52.355567    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-9wcr6"
Sep 19 15:23:54.257770 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:54.257733    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9"]
Sep 19 15:23:54.258248 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:54.257969    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9" podUID="c29212c3-bc91-45ee-b3c7-91222fc25e43" containerName="manager" containerID="cri-o://29fc3e5e48a435dba44c46dea744788b75668fd0d0cdf7b2d2d66da98cf4c266" gracePeriod=2
Sep 19 15:23:54.270946 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:54.270918    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9"]
Sep 19 15:23:54.285123 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:23:54.285084    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"c29212c3-bc91-45ee-b3c7-91222fc25e43\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-m29p9\": pods \"limitador-operator-controller-manager-74495c69f8-m29p9\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9"
Sep 19 15:23:54.288443 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:54.288418    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-djbvx"]
Sep 19 15:23:54.288741 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:54.288730    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c29212c3-bc91-45ee-b3c7-91222fc25e43" containerName="manager"
Sep 19 15:23:54.288793 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:54.288743    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c29212c3-bc91-45ee-b3c7-91222fc25e43" containerName="manager"
Sep 19 15:23:54.288829 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:54.288807    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c29212c3-bc91-45ee-b3c7-91222fc25e43" containerName="manager"
Sep 19 15:23:54.291793 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:54.291774    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-djbvx"
Sep 19 15:23:54.293475 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:23:54.293453    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-m29p9\" is forbidden: User \"system:node:ip-10-0-136-237.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-237.ec2.internal' and this object" podUID="c29212c3-bc91-45ee-b3c7-91222fc25e43" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9"
Sep 19 15:23:54.301882 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:54.301855    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-djbvx"]
Sep 19 15:23:54.327165 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:54.327132    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krfzj\" (UniqueName: \"kubernetes.io/projected/806158dc-1328-47c2-b42e-b68423c266fe-kube-api-access-krfzj\") pod \"limitador-operator-controller-manager-74495c69f8-djbvx\" (UID: \"806158dc-1328-47c2-b42e-b68423c266fe\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-djbvx"
Sep 19 15:23:54.372666 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:54.372628    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-764dn"
Sep 19 15:23:54.393364 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:23:54.393325    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-m29p9\" is forbidden: User \"system:node:ip-10-0-136-237.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-237.ec2.internal' and this object" podUID="c29212c3-bc91-45ee-b3c7-91222fc25e43" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9"
Sep 19 15:23:54.424553 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:54.424523    2563 generic.go:356] "Generic (PLEG): container finished" podID="c29212c3-bc91-45ee-b3c7-91222fc25e43" containerID="29fc3e5e48a435dba44c46dea744788b75668fd0d0cdf7b2d2d66da98cf4c266" exitCode=0
Sep 19 15:23:54.427921 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:54.427874    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krfzj\" (UniqueName: \"kubernetes.io/projected/806158dc-1328-47c2-b42e-b68423c266fe-kube-api-access-krfzj\") pod \"limitador-operator-controller-manager-74495c69f8-djbvx\" (UID: \"806158dc-1328-47c2-b42e-b68423c266fe\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-djbvx"
Sep 19 15:23:54.436358 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:54.436330    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krfzj\" (UniqueName: \"kubernetes.io/projected/806158dc-1328-47c2-b42e-b68423c266fe-kube-api-access-krfzj\") pod \"limitador-operator-controller-manager-74495c69f8-djbvx\" (UID: \"806158dc-1328-47c2-b42e-b68423c266fe\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-djbvx"
Sep 19 15:23:54.507603 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:54.507577    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9"
Sep 19 15:23:54.509410 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:23:54.509329    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-m29p9\" is forbidden: User \"system:node:ip-10-0-136-237.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-237.ec2.internal' and this object" podUID="c29212c3-bc91-45ee-b3c7-91222fc25e43" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9"
Sep 19 15:23:54.629440 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:54.629391    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvntl\" (UniqueName: \"kubernetes.io/projected/c29212c3-bc91-45ee-b3c7-91222fc25e43-kube-api-access-bvntl\") pod \"c29212c3-bc91-45ee-b3c7-91222fc25e43\" (UID: \"c29212c3-bc91-45ee-b3c7-91222fc25e43\") "
Sep 19 15:23:54.631760 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:54.631733    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c29212c3-bc91-45ee-b3c7-91222fc25e43-kube-api-access-bvntl" (OuterVolumeSpecName: "kube-api-access-bvntl") pod "c29212c3-bc91-45ee-b3c7-91222fc25e43" (UID: "c29212c3-bc91-45ee-b3c7-91222fc25e43"). InnerVolumeSpecName "kube-api-access-bvntl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:23:54.640292 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:54.640274    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-djbvx"
Sep 19 15:23:54.730678 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:54.730645    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvntl\" (UniqueName: \"kubernetes.io/projected/c29212c3-bc91-45ee-b3c7-91222fc25e43-kube-api-access-bvntl\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:23:54.914988 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:54.914959    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-djbvx"]
Sep 19 15:23:54.916990 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:23:54.916965    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod806158dc_1328_47c2_b42e_b68423c266fe.slice/crio-d2e7f37e1b12c0b5a5c3fdd05989971b6f2e73b3e4249f04c6ca4745ded50bb6 WatchSource:0}: Error finding container d2e7f37e1b12c0b5a5c3fdd05989971b6f2e73b3e4249f04c6ca4745ded50bb6: Status 404 returned error can't find the container with id d2e7f37e1b12c0b5a5c3fdd05989971b6f2e73b3e4249f04c6ca4745ded50bb6
Sep 19 15:23:55.432567 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:55.432530    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-djbvx" event={"ID":"806158dc-1328-47c2-b42e-b68423c266fe","Type":"ContainerStarted","Data":"a0e66baef64460e156a729c65e7eeef1bc65486424ece4d96e62d95e6242986b"}
Sep 19 15:23:55.432990 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:55.432586    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-djbvx" event={"ID":"806158dc-1328-47c2-b42e-b68423c266fe","Type":"ContainerStarted","Data":"d2e7f37e1b12c0b5a5c3fdd05989971b6f2e73b3e4249f04c6ca4745ded50bb6"}
Sep 19 15:23:55.432990 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:55.432611    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-djbvx"
Sep 19 15:23:55.434065 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:55.434046    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9"
Sep 19 15:23:55.434164 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:55.434047    2563 scope.go:117] "RemoveContainer" containerID="29fc3e5e48a435dba44c46dea744788b75668fd0d0cdf7b2d2d66da98cf4c266"
Sep 19 15:23:55.450972 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:55.450920    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-djbvx" podStartSLOduration=1.450880508 podStartE2EDuration="1.450880508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:23:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:23:55.450455931 +0000 UTC m=+710.339655645" watchObservedRunningTime="2026-09-19 15:23:55.450880508 +0000 UTC m=+710.340080220"
Sep 19 15:23:55.452159 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:23:55.452137    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-m29p9\" is forbidden: User \"system:node:ip-10-0-136-237.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-237.ec2.internal' and this object" podUID="c29212c3-bc91-45ee-b3c7-91222fc25e43" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9"
Sep 19 15:23:55.454004 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:23:55.453982    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-m29p9\" is forbidden: User \"system:node:ip-10-0-136-237.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-237.ec2.internal' and this object" podUID="c29212c3-bc91-45ee-b3c7-91222fc25e43" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9"
Sep 19 15:23:55.639207 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:23:55.639172    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-m29p9\" is forbidden: User \"system:node:ip-10-0-136-237.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-237.ec2.internal' and this object" podUID="c29212c3-bc91-45ee-b3c7-91222fc25e43" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m29p9"
Sep 19 15:23:55.641827 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:23:55.641806    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c29212c3-bc91-45ee-b3c7-91222fc25e43" path="/var/lib/kubelet/pods/c29212c3-bc91-45ee-b3c7-91222fc25e43/volumes"
Sep 19 15:24:06.444189 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:06.444147    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-djbvx"
Sep 19 15:24:37.244479 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:37.244439    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-qctn4"]
Sep 19 15:24:37.247784 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:37.247768    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-qctn4"
Sep 19 15:24:37.249738 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:37.249715    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-x2x89\""
Sep 19 15:24:37.249867 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:37.249777    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 19 15:24:37.256501 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:37.256477    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-qctn4"]
Sep 19 15:24:37.275183 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:37.275156    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q4ln\" (UniqueName: \"kubernetes.io/projected/1c97ad54-0a66-46c6-868e-7d1436e0e208-kube-api-access-5q4ln\") pod \"limitador-limitador-8588749977-qctn4\" (UID: \"1c97ad54-0a66-46c6-868e-7d1436e0e208\") " pod="kuadrant-system/limitador-limitador-8588749977-qctn4"
Sep 19 15:24:37.275321 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:37.275215    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1c97ad54-0a66-46c6-868e-7d1436e0e208-config-file\") pod \"limitador-limitador-8588749977-qctn4\" (UID: \"1c97ad54-0a66-46c6-868e-7d1436e0e208\") " pod="kuadrant-system/limitador-limitador-8588749977-qctn4"
Sep 19 15:24:37.341277 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:37.341246    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-qctn4"]
Sep 19 15:24:37.376569 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:37.376539    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1c97ad54-0a66-46c6-868e-7d1436e0e208-config-file\") pod \"limitador-limitador-8588749977-qctn4\" (UID: \"1c97ad54-0a66-46c6-868e-7d1436e0e208\") " pod="kuadrant-system/limitador-limitador-8588749977-qctn4"
Sep 19 15:24:37.376726 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:37.376593    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q4ln\" (UniqueName: \"kubernetes.io/projected/1c97ad54-0a66-46c6-868e-7d1436e0e208-kube-api-access-5q4ln\") pod \"limitador-limitador-8588749977-qctn4\" (UID: \"1c97ad54-0a66-46c6-868e-7d1436e0e208\") " pod="kuadrant-system/limitador-limitador-8588749977-qctn4"
Sep 19 15:24:37.377250 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:37.377232    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1c97ad54-0a66-46c6-868e-7d1436e0e208-config-file\") pod \"limitador-limitador-8588749977-qctn4\" (UID: \"1c97ad54-0a66-46c6-868e-7d1436e0e208\") " pod="kuadrant-system/limitador-limitador-8588749977-qctn4"
Sep 19 15:24:37.387654 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:37.387629    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q4ln\" (UniqueName: \"kubernetes.io/projected/1c97ad54-0a66-46c6-868e-7d1436e0e208-kube-api-access-5q4ln\") pod \"limitador-limitador-8588749977-qctn4\" (UID: \"1c97ad54-0a66-46c6-868e-7d1436e0e208\") " pod="kuadrant-system/limitador-limitador-8588749977-qctn4"
Sep 19 15:24:37.559094 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:37.559003    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-qctn4"
Sep 19 15:24:37.830958 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:37.830927    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-qctn4"]
Sep 19 15:24:37.832867 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:24:37.832841    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c97ad54_0a66_46c6_868e_7d1436e0e208.slice/crio-1f8541d96f2c0ab1e9ddb7b174ca4e27183fd38bccd58f88a0d5ab088ebba89f WatchSource:0}: Error finding container 1f8541d96f2c0ab1e9ddb7b174ca4e27183fd38bccd58f88a0d5ab088ebba89f: Status 404 returned error can't find the container with id 1f8541d96f2c0ab1e9ddb7b174ca4e27183fd38bccd58f88a0d5ab088ebba89f
Sep 19 15:24:38.657770 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:38.657733    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-qctn4" event={"ID":"1c97ad54-0a66-46c6-868e-7d1436e0e208","Type":"ContainerStarted","Data":"1f8541d96f2c0ab1e9ddb7b174ca4e27183fd38bccd58f88a0d5ab088ebba89f"}
Sep 19 15:24:51.465285 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:51.465249    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-qctn4"]
Sep 19 15:24:51.728629 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:51.728544    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-qctn4" event={"ID":"1c97ad54-0a66-46c6-868e-7d1436e0e208","Type":"ContainerStarted","Data":"3887d1a60954c57449db19e1f2d8b209201393ff697708bfa224136e1e93be62"}
Sep 19 15:24:51.728629 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:51.728607    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-qctn4"
Sep 19 15:24:51.752962 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:51.752911    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-qctn4" podStartSLOduration=1.568271297 podStartE2EDuration="14.752876634s" totalImagesPullingTime="13.184605337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:24:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:24:51.751380057 +0000 UTC m=+766.640579771" watchObservedRunningTime="2026-09-19 15:24:51.752876634 +0000 UTC m=+766.642076348"
Sep 19 15:24:52.734706 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:52.734653    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-qctn4" podUID="1c97ad54-0a66-46c6-868e-7d1436e0e208" containerName="limitador" containerID="cri-o://3887d1a60954c57449db19e1f2d8b209201393ff697708bfa224136e1e93be62" gracePeriod=30
Sep 19 15:24:53.284676 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:53.284653    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-qctn4"
Sep 19 15:24:53.410541 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:53.410455    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5q4ln\" (UniqueName: \"kubernetes.io/projected/1c97ad54-0a66-46c6-868e-7d1436e0e208-kube-api-access-5q4ln\") pod \"1c97ad54-0a66-46c6-868e-7d1436e0e208\" (UID: \"1c97ad54-0a66-46c6-868e-7d1436e0e208\") "
Sep 19 15:24:53.410541 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:53.410500    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1c97ad54-0a66-46c6-868e-7d1436e0e208-config-file\") pod \"1c97ad54-0a66-46c6-868e-7d1436e0e208\" (UID: \"1c97ad54-0a66-46c6-868e-7d1436e0e208\") "
Sep 19 15:24:53.410923 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:53.410878    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c97ad54-0a66-46c6-868e-7d1436e0e208-config-file" (OuterVolumeSpecName: "config-file") pod "1c97ad54-0a66-46c6-868e-7d1436e0e208" (UID: "1c97ad54-0a66-46c6-868e-7d1436e0e208"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:24:53.413048 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:53.413022    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c97ad54-0a66-46c6-868e-7d1436e0e208-kube-api-access-5q4ln" (OuterVolumeSpecName: "kube-api-access-5q4ln") pod "1c97ad54-0a66-46c6-868e-7d1436e0e208" (UID: "1c97ad54-0a66-46c6-868e-7d1436e0e208"). InnerVolumeSpecName "kube-api-access-5q4ln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:24:53.511788 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:53.511757    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5q4ln\" (UniqueName: \"kubernetes.io/projected/1c97ad54-0a66-46c6-868e-7d1436e0e208-kube-api-access-5q4ln\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:24:53.511788 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:53.511783    2563 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1c97ad54-0a66-46c6-868e-7d1436e0e208-config-file\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:24:53.740856 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:53.740824    2563 generic.go:356] "Generic (PLEG): container finished" podID="1c97ad54-0a66-46c6-868e-7d1436e0e208" containerID="3887d1a60954c57449db19e1f2d8b209201393ff697708bfa224136e1e93be62" exitCode=0
Sep 19 15:24:53.741329 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:53.740866    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-qctn4"
Sep 19 15:24:53.741329 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:53.740938    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-qctn4" event={"ID":"1c97ad54-0a66-46c6-868e-7d1436e0e208","Type":"ContainerDied","Data":"3887d1a60954c57449db19e1f2d8b209201393ff697708bfa224136e1e93be62"}
Sep 19 15:24:53.741329 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:53.740998    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-qctn4" event={"ID":"1c97ad54-0a66-46c6-868e-7d1436e0e208","Type":"ContainerDied","Data":"1f8541d96f2c0ab1e9ddb7b174ca4e27183fd38bccd58f88a0d5ab088ebba89f"}
Sep 19 15:24:53.741329 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:53.741032    2563 scope.go:117] "RemoveContainer" containerID="3887d1a60954c57449db19e1f2d8b209201393ff697708bfa224136e1e93be62"
Sep 19 15:24:53.749775 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:53.749760    2563 scope.go:117] "RemoveContainer" containerID="3887d1a60954c57449db19e1f2d8b209201393ff697708bfa224136e1e93be62"
Sep 19 15:24:53.750073 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:24:53.750054    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3887d1a60954c57449db19e1f2d8b209201393ff697708bfa224136e1e93be62\": container with ID starting with 3887d1a60954c57449db19e1f2d8b209201393ff697708bfa224136e1e93be62 not found: ID does not exist" containerID="3887d1a60954c57449db19e1f2d8b209201393ff697708bfa224136e1e93be62"
Sep 19 15:24:53.750138 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:53.750080    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3887d1a60954c57449db19e1f2d8b209201393ff697708bfa224136e1e93be62"} err="failed to get container status \"3887d1a60954c57449db19e1f2d8b209201393ff697708bfa224136e1e93be62\": rpc error: code = NotFound desc = could not find container \"3887d1a60954c57449db19e1f2d8b209201393ff697708bfa224136e1e93be62\": container with ID starting with 3887d1a60954c57449db19e1f2d8b209201393ff697708bfa224136e1e93be62 not found: ID does not exist"
Sep 19 15:24:53.755666 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:53.755643    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-qctn4"]
Sep 19 15:24:53.760714 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:53.760693    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-qctn4"]
Sep 19 15:24:55.641120 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:55.641087    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c97ad54-0a66-46c6-868e-7d1436e0e208" path="/var/lib/kubelet/pods/1c97ad54-0a66-46c6-868e-7d1436e0e208/volumes"
Sep 19 15:24:56.135266 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:56.135235    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rqmpr"]
Sep 19 15:24:56.135580 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:56.135565    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c97ad54-0a66-46c6-868e-7d1436e0e208" containerName="limitador"
Sep 19 15:24:56.135580 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:56.135580    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c97ad54-0a66-46c6-868e-7d1436e0e208" containerName="limitador"
Sep 19 15:24:56.135711 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:56.135645    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c97ad54-0a66-46c6-868e-7d1436e0e208" containerName="limitador"
Sep 19 15:24:56.139999 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:56.139978    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rqmpr"
Sep 19 15:24:56.142074 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:56.142053    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 15:24:56.142198 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:56.142080    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-g56qn\""
Sep 19 15:24:56.142598 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:56.142578    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 19 15:24:56.142664 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:56.142645    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 19 15:24:56.145744 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:56.145723    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rqmpr"]
Sep 19 15:24:56.233960 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:56.233926    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnhfg\" (UniqueName: \"kubernetes.io/projected/dc45f96e-2139-41f0-9ef1-e2d708a894b4-kube-api-access-hnhfg\") pod \"postgres-69fb4594cf-rqmpr\" (UID: \"dc45f96e-2139-41f0-9ef1-e2d708a894b4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rqmpr"
Sep 19 15:24:56.234126 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:56.233979    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dc45f96e-2139-41f0-9ef1-e2d708a894b4-data\") pod \"postgres-69fb4594cf-rqmpr\" (UID: \"dc45f96e-2139-41f0-9ef1-e2d708a894b4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rqmpr"
Sep 19 15:24:56.335261 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:56.335227    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dc45f96e-2139-41f0-9ef1-e2d708a894b4-data\") pod \"postgres-69fb4594cf-rqmpr\" (UID: \"dc45f96e-2139-41f0-9ef1-e2d708a894b4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rqmpr"
Sep 19 15:24:56.335438 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:56.335292    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnhfg\" (UniqueName: \"kubernetes.io/projected/dc45f96e-2139-41f0-9ef1-e2d708a894b4-kube-api-access-hnhfg\") pod \"postgres-69fb4594cf-rqmpr\" (UID: \"dc45f96e-2139-41f0-9ef1-e2d708a894b4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rqmpr"
Sep 19 15:24:56.335640 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:56.335622    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dc45f96e-2139-41f0-9ef1-e2d708a894b4-data\") pod \"postgres-69fb4594cf-rqmpr\" (UID: \"dc45f96e-2139-41f0-9ef1-e2d708a894b4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rqmpr"
Sep 19 15:24:56.342627 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:56.342596    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnhfg\" (UniqueName: \"kubernetes.io/projected/dc45f96e-2139-41f0-9ef1-e2d708a894b4-kube-api-access-hnhfg\") pod \"postgres-69fb4594cf-rqmpr\" (UID: \"dc45f96e-2139-41f0-9ef1-e2d708a894b4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rqmpr"
Sep 19 15:24:56.451405 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:56.451370    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rqmpr"
Sep 19 15:24:56.724784 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:56.724752    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rqmpr"]
Sep 19 15:24:56.726273 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:24:56.726240    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc45f96e_2139_41f0_9ef1_e2d708a894b4.slice/crio-b336a659cf545118ac4931b76b91593950d729a863f620cf86f76d908992ab8e WatchSource:0}: Error finding container b336a659cf545118ac4931b76b91593950d729a863f620cf86f76d908992ab8e: Status 404 returned error can't find the container with id b336a659cf545118ac4931b76b91593950d729a863f620cf86f76d908992ab8e
Sep 19 15:24:56.759164 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:24:56.759132    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rqmpr" event={"ID":"dc45f96e-2139-41f0-9ef1-e2d708a894b4","Type":"ContainerStarted","Data":"b336a659cf545118ac4931b76b91593950d729a863f620cf86f76d908992ab8e"}
Sep 19 15:25:01.792945 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:01.792851    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rqmpr" event={"ID":"dc45f96e-2139-41f0-9ef1-e2d708a894b4","Type":"ContainerStarted","Data":"792e4ca38ddb4cc87048e21232bc0bcf5285a7cd77bc738f0b1aeda22c1b2a5c"}
Sep 19 15:25:01.793345 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:01.792944    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rqmpr"
Sep 19 15:25:01.810069 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:01.810000    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rqmpr" podStartSLOduration=1.026077701 podStartE2EDuration="5.809978583s" totalImagesPullingTime="4.783900882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:25:01.806171118 +0000 UTC m=+776.695370839" watchObservedRunningTime="2026-09-19 15:25:01.809978583 +0000 UTC m=+776.699178297"
Sep 19 15:25:07.827637 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:07.827607    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rqmpr"
Sep 19 15:25:14.483688 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.483651    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7884b58df-ttfvn"]
Sep 19 15:25:14.509663 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.509629    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7884b58df-ttfvn"]
Sep 19 15:25:14.509830 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.509743    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7884b58df-ttfvn"
Sep 19 15:25:14.512020 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.511965    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 19 15:25:14.512020 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.511999    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 19 15:25:14.512213 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.511965    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 19 15:25:14.512213 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.512182    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6lzmn\""
Sep 19 15:25:14.597682 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.597638    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48fc48c4-40e9-43ec-9dfc-cbcb5666c811-webhook-cert\") pod \"maas-controller-7884b58df-ttfvn\" (UID: \"48fc48c4-40e9-43ec-9dfc-cbcb5666c811\") " pod="opendatahub/maas-controller-7884b58df-ttfvn"
Sep 19 15:25:14.597852 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.597697    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48fc48c4-40e9-43ec-9dfc-cbcb5666c811-metrics-certs\") pod \"maas-controller-7884b58df-ttfvn\" (UID: \"48fc48c4-40e9-43ec-9dfc-cbcb5666c811\") " pod="opendatahub/maas-controller-7884b58df-ttfvn"
Sep 19 15:25:14.597852 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.597781    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd5wl\" (UniqueName: \"kubernetes.io/projected/48fc48c4-40e9-43ec-9dfc-cbcb5666c811-kube-api-access-fd5wl\") pod \"maas-controller-7884b58df-ttfvn\" (UID: \"48fc48c4-40e9-43ec-9dfc-cbcb5666c811\") " pod="opendatahub/maas-controller-7884b58df-ttfvn"
Sep 19 15:25:14.657792 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.657755    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8c69b6595-j7cbb"]
Sep 19 15:25:14.661444 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.661429    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c69b6595-j7cbb"
Sep 19 15:25:14.668684 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.668663    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8c69b6595-j7cbb"]
Sep 19 15:25:14.698309 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.698276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48fc48c4-40e9-43ec-9dfc-cbcb5666c811-metrics-certs\") pod \"maas-controller-7884b58df-ttfvn\" (UID: \"48fc48c4-40e9-43ec-9dfc-cbcb5666c811\") " pod="opendatahub/maas-controller-7884b58df-ttfvn"
Sep 19 15:25:14.698474 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.698353    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd5wl\" (UniqueName: \"kubernetes.io/projected/48fc48c4-40e9-43ec-9dfc-cbcb5666c811-kube-api-access-fd5wl\") pod \"maas-controller-7884b58df-ttfvn\" (UID: \"48fc48c4-40e9-43ec-9dfc-cbcb5666c811\") " pod="opendatahub/maas-controller-7884b58df-ttfvn"
Sep 19 15:25:14.698474 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.698412    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48fc48c4-40e9-43ec-9dfc-cbcb5666c811-webhook-cert\") pod \"maas-controller-7884b58df-ttfvn\" (UID: \"48fc48c4-40e9-43ec-9dfc-cbcb5666c811\") " pod="opendatahub/maas-controller-7884b58df-ttfvn"
Sep 19 15:25:14.698474 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:25:14.698429    2563 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 19 15:25:14.698635 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:25:14.698485    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48fc48c4-40e9-43ec-9dfc-cbcb5666c811-metrics-certs podName:48fc48c4-40e9-43ec-9dfc-cbcb5666c811 nodeName:}" failed. No retries permitted until 2026-09-19 15:25:15.198468636 +0000 UTC m=+790.087668327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/48fc48c4-40e9-43ec-9dfc-cbcb5666c811-metrics-certs") pod "maas-controller-7884b58df-ttfvn" (UID: "48fc48c4-40e9-43ec-9dfc-cbcb5666c811") : secret "maas-controller-metrics-tls" not found
Sep 19 15:25:14.701022 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.701002    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48fc48c4-40e9-43ec-9dfc-cbcb5666c811-webhook-cert\") pod \"maas-controller-7884b58df-ttfvn\" (UID: \"48fc48c4-40e9-43ec-9dfc-cbcb5666c811\") " pod="opendatahub/maas-controller-7884b58df-ttfvn"
Sep 19 15:25:14.705402 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.705383    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd5wl\" (UniqueName: \"kubernetes.io/projected/48fc48c4-40e9-43ec-9dfc-cbcb5666c811-kube-api-access-fd5wl\") pod \"maas-controller-7884b58df-ttfvn\" (UID: \"48fc48c4-40e9-43ec-9dfc-cbcb5666c811\") " pod="opendatahub/maas-controller-7884b58df-ttfvn"
Sep 19 15:25:14.798912 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.798803    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b9b9a9db-4880-4668-b9d7-2c078453c2d7-webhook-cert\") pod \"maas-controller-8c69b6595-j7cbb\" (UID: \"b9b9a9db-4880-4668-b9d7-2c078453c2d7\") " pod="opendatahub/maas-controller-8c69b6595-j7cbb"
Sep 19 15:25:14.798912 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.798858    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh7bj\" (UniqueName: \"kubernetes.io/projected/b9b9a9db-4880-4668-b9d7-2c078453c2d7-kube-api-access-kh7bj\") pod \"maas-controller-8c69b6595-j7cbb\" (UID: \"b9b9a9db-4880-4668-b9d7-2c078453c2d7\") " pod="opendatahub/maas-controller-8c69b6595-j7cbb"
Sep 19 15:25:14.799123 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.798966    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9b9a9db-4880-4668-b9d7-2c078453c2d7-metrics-certs\") pod \"maas-controller-8c69b6595-j7cbb\" (UID: \"b9b9a9db-4880-4668-b9d7-2c078453c2d7\") " pod="opendatahub/maas-controller-8c69b6595-j7cbb"
Sep 19 15:25:14.900260 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.900233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b9b9a9db-4880-4668-b9d7-2c078453c2d7-webhook-cert\") pod \"maas-controller-8c69b6595-j7cbb\" (UID: \"b9b9a9db-4880-4668-b9d7-2c078453c2d7\") " pod="opendatahub/maas-controller-8c69b6595-j7cbb"
Sep 19 15:25:14.900416 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.900288    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh7bj\" (UniqueName: \"kubernetes.io/projected/b9b9a9db-4880-4668-b9d7-2c078453c2d7-kube-api-access-kh7bj\") pod \"maas-controller-8c69b6595-j7cbb\" (UID: \"b9b9a9db-4880-4668-b9d7-2c078453c2d7\") " pod="opendatahub/maas-controller-8c69b6595-j7cbb"
Sep 19 15:25:14.900416 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.900329    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9b9a9db-4880-4668-b9d7-2c078453c2d7-metrics-certs\") pod \"maas-controller-8c69b6595-j7cbb\" (UID: \"b9b9a9db-4880-4668-b9d7-2c078453c2d7\") " pod="opendatahub/maas-controller-8c69b6595-j7cbb"
Sep 19 15:25:14.900489 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:25:14.900431    2563 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 19 15:25:14.900489 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:25:14.900485    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9b9a9db-4880-4668-b9d7-2c078453c2d7-metrics-certs podName:b9b9a9db-4880-4668-b9d7-2c078453c2d7 nodeName:}" failed. No retries permitted until 2026-09-19 15:25:15.400468767 +0000 UTC m=+790.289668461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9b9a9db-4880-4668-b9d7-2c078453c2d7-metrics-certs") pod "maas-controller-8c69b6595-j7cbb" (UID: "b9b9a9db-4880-4668-b9d7-2c078453c2d7") : secret "maas-controller-metrics-tls" not found
Sep 19 15:25:14.902697 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.902669    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b9b9a9db-4880-4668-b9d7-2c078453c2d7-webhook-cert\") pod \"maas-controller-8c69b6595-j7cbb\" (UID: \"b9b9a9db-4880-4668-b9d7-2c078453c2d7\") " pod="opendatahub/maas-controller-8c69b6595-j7cbb"
Sep 19 15:25:14.907807 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:14.907783    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh7bj\" (UniqueName: \"kubernetes.io/projected/b9b9a9db-4880-4668-b9d7-2c078453c2d7-kube-api-access-kh7bj\") pod \"maas-controller-8c69b6595-j7cbb\" (UID: \"b9b9a9db-4880-4668-b9d7-2c078453c2d7\") " pod="opendatahub/maas-controller-8c69b6595-j7cbb"
Sep 19 15:25:15.202759 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:15.202724    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48fc48c4-40e9-43ec-9dfc-cbcb5666c811-metrics-certs\") pod \"maas-controller-7884b58df-ttfvn\" (UID: \"48fc48c4-40e9-43ec-9dfc-cbcb5666c811\") " pod="opendatahub/maas-controller-7884b58df-ttfvn"
Sep 19 15:25:15.205191 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:15.205170    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48fc48c4-40e9-43ec-9dfc-cbcb5666c811-metrics-certs\") pod \"maas-controller-7884b58df-ttfvn\" (UID: \"48fc48c4-40e9-43ec-9dfc-cbcb5666c811\") " pod="opendatahub/maas-controller-7884b58df-ttfvn"
Sep 19 15:25:15.404338 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:15.404299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9b9a9db-4880-4668-b9d7-2c078453c2d7-metrics-certs\") pod \"maas-controller-8c69b6595-j7cbb\" (UID: \"b9b9a9db-4880-4668-b9d7-2c078453c2d7\") " pod="opendatahub/maas-controller-8c69b6595-j7cbb"
Sep 19 15:25:15.406798 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:15.406770    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9b9a9db-4880-4668-b9d7-2c078453c2d7-metrics-certs\") pod \"maas-controller-8c69b6595-j7cbb\" (UID: \"b9b9a9db-4880-4668-b9d7-2c078453c2d7\") " pod="opendatahub/maas-controller-8c69b6595-j7cbb"
Sep 19 15:25:15.419824 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:15.419806    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7884b58df-ttfvn"
Sep 19 15:25:15.572431 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:15.572399    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c69b6595-j7cbb"
Sep 19 15:25:15.690174 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:15.690072    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7884b58df-ttfvn"]
Sep 19 15:25:15.692837 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:25:15.692809    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48fc48c4_40e9_43ec_9dfc_cbcb5666c811.slice/crio-9449552b69b9c49dd1f5fde26f1e5ed82948a7a2b4ed6d2971c16502e401355c WatchSource:0}: Error finding container 9449552b69b9c49dd1f5fde26f1e5ed82948a7a2b4ed6d2971c16502e401355c: Status 404 returned error can't find the container with id 9449552b69b9c49dd1f5fde26f1e5ed82948a7a2b4ed6d2971c16502e401355c
Sep 19 15:25:15.846477 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:15.846443    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8c69b6595-j7cbb"]
Sep 19 15:25:15.847342 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:25:15.847317    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9b9a9db_4880_4668_b9d7_2c078453c2d7.slice/crio-2f8f225bd1adad5a0a63ab5fb5def1de2a61414c5506ef8e553d02d4f41247dd WatchSource:0}: Error finding container 2f8f225bd1adad5a0a63ab5fb5def1de2a61414c5506ef8e553d02d4f41247dd: Status 404 returned error can't find the container with id 2f8f225bd1adad5a0a63ab5fb5def1de2a61414c5506ef8e553d02d4f41247dd
Sep 19 15:25:15.868196 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:15.868162    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c69b6595-j7cbb" event={"ID":"b9b9a9db-4880-4668-b9d7-2c078453c2d7","Type":"ContainerStarted","Data":"2f8f225bd1adad5a0a63ab5fb5def1de2a61414c5506ef8e553d02d4f41247dd"}
Sep 19 15:25:15.869377 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:15.869349    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7884b58df-ttfvn" event={"ID":"48fc48c4-40e9-43ec-9dfc-cbcb5666c811","Type":"ContainerStarted","Data":"9449552b69b9c49dd1f5fde26f1e5ed82948a7a2b4ed6d2971c16502e401355c"}
Sep 19 15:25:18.892730 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:18.892692    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c69b6595-j7cbb" event={"ID":"b9b9a9db-4880-4668-b9d7-2c078453c2d7","Type":"ContainerStarted","Data":"3e197d3a152534d6c3f51134fab0e3be73de32f13b99f150618c12f184ad4135"}
Sep 19 15:25:18.893221 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:18.892787    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8c69b6595-j7cbb"
Sep 19 15:25:18.894860 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:18.894833    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7884b58df-ttfvn" event={"ID":"48fc48c4-40e9-43ec-9dfc-cbcb5666c811","Type":"ContainerStarted","Data":"66f42b2744ad4b9447d4d4d163d0600a99d38993b45396efc989a04d39adefe7"}
Sep 19 15:25:18.895007 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:18.894928    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7884b58df-ttfvn"
Sep 19 15:25:18.910596 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:18.910555    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8c69b6595-j7cbb" podStartSLOduration=2.524203099 podStartE2EDuration="4.910541157s" totalImagesPullingTime="2.386338058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:25:18.909363961 +0000 UTC m=+793.798563668" watchObservedRunningTime="2026-09-19 15:25:18.910541157 +0000 UTC m=+793.799740870"
Sep 19 15:25:18.926416 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:18.926363    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7884b58df-ttfvn" podStartSLOduration=2.395476201 podStartE2EDuration="4.926344122s" totalImagesPullingTime="2.530867921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:25:18.926140234 +0000 UTC m=+793.815339947" watchObservedRunningTime="2026-09-19 15:25:18.926344122 +0000 UTC m=+793.815543836"
Sep 19 15:25:29.904648 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:29.904578    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8c69b6595-j7cbb"
Sep 19 15:25:29.905085 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:29.904649    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7884b58df-ttfvn"
Sep 19 15:25:29.977115 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:29.976966    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7884b58df-ttfvn"]
Sep 19 15:25:29.977881 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:29.977612    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7884b58df-ttfvn" podUID="48fc48c4-40e9-43ec-9dfc-cbcb5666c811" containerName="manager" containerID="cri-o://66f42b2744ad4b9447d4d4d163d0600a99d38993b45396efc989a04d39adefe7" gracePeriod=30
Sep 19 15:25:30.223549 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:30.223522    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7884b58df-ttfvn"
Sep 19 15:25:30.332225 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:30.332191    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48fc48c4-40e9-43ec-9dfc-cbcb5666c811-webhook-cert\") pod \"48fc48c4-40e9-43ec-9dfc-cbcb5666c811\" (UID: \"48fc48c4-40e9-43ec-9dfc-cbcb5666c811\") "
Sep 19 15:25:30.332225 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:30.332230    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd5wl\" (UniqueName: \"kubernetes.io/projected/48fc48c4-40e9-43ec-9dfc-cbcb5666c811-kube-api-access-fd5wl\") pod \"48fc48c4-40e9-43ec-9dfc-cbcb5666c811\" (UID: \"48fc48c4-40e9-43ec-9dfc-cbcb5666c811\") "
Sep 19 15:25:30.332449 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:30.332263    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48fc48c4-40e9-43ec-9dfc-cbcb5666c811-metrics-certs\") pod \"48fc48c4-40e9-43ec-9dfc-cbcb5666c811\" (UID: \"48fc48c4-40e9-43ec-9dfc-cbcb5666c811\") "
Sep 19 15:25:30.334667 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:30.334629    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48fc48c4-40e9-43ec-9dfc-cbcb5666c811-kube-api-access-fd5wl" (OuterVolumeSpecName: "kube-api-access-fd5wl") pod "48fc48c4-40e9-43ec-9dfc-cbcb5666c811" (UID: "48fc48c4-40e9-43ec-9dfc-cbcb5666c811"). InnerVolumeSpecName "kube-api-access-fd5wl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:25:30.334667 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:30.334644    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48fc48c4-40e9-43ec-9dfc-cbcb5666c811-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "48fc48c4-40e9-43ec-9dfc-cbcb5666c811" (UID: "48fc48c4-40e9-43ec-9dfc-cbcb5666c811"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:25:30.334831 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:30.334671    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48fc48c4-40e9-43ec-9dfc-cbcb5666c811-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "48fc48c4-40e9-43ec-9dfc-cbcb5666c811" (UID: "48fc48c4-40e9-43ec-9dfc-cbcb5666c811"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:25:30.433650 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:30.433617    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48fc48c4-40e9-43ec-9dfc-cbcb5666c811-webhook-cert\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:25:30.433650 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:30.433645    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd5wl\" (UniqueName: \"kubernetes.io/projected/48fc48c4-40e9-43ec-9dfc-cbcb5666c811-kube-api-access-fd5wl\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:25:30.433650 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:30.433658    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48fc48c4-40e9-43ec-9dfc-cbcb5666c811-metrics-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:25:30.962484 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:30.962446    2563 generic.go:356] "Generic (PLEG): container finished" podID="48fc48c4-40e9-43ec-9dfc-cbcb5666c811" containerID="66f42b2744ad4b9447d4d4d163d0600a99d38993b45396efc989a04d39adefe7" exitCode=0
Sep 19 15:25:30.962998 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:30.962491    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7884b58df-ttfvn"
Sep 19 15:25:30.962998 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:30.962531    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7884b58df-ttfvn" event={"ID":"48fc48c4-40e9-43ec-9dfc-cbcb5666c811","Type":"ContainerDied","Data":"66f42b2744ad4b9447d4d4d163d0600a99d38993b45396efc989a04d39adefe7"}
Sep 19 15:25:30.962998 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:30.962584    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7884b58df-ttfvn" event={"ID":"48fc48c4-40e9-43ec-9dfc-cbcb5666c811","Type":"ContainerDied","Data":"9449552b69b9c49dd1f5fde26f1e5ed82948a7a2b4ed6d2971c16502e401355c"}
Sep 19 15:25:30.962998 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:30.962613    2563 scope.go:117] "RemoveContainer" containerID="66f42b2744ad4b9447d4d4d163d0600a99d38993b45396efc989a04d39adefe7"
Sep 19 15:25:30.971846 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:30.971830    2563 scope.go:117] "RemoveContainer" containerID="66f42b2744ad4b9447d4d4d163d0600a99d38993b45396efc989a04d39adefe7"
Sep 19 15:25:30.972116 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:25:30.972099    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66f42b2744ad4b9447d4d4d163d0600a99d38993b45396efc989a04d39adefe7\": container with ID starting with 66f42b2744ad4b9447d4d4d163d0600a99d38993b45396efc989a04d39adefe7 not found: ID does not exist" containerID="66f42b2744ad4b9447d4d4d163d0600a99d38993b45396efc989a04d39adefe7"
Sep 19 15:25:30.972166 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:30.972124    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66f42b2744ad4b9447d4d4d163d0600a99d38993b45396efc989a04d39adefe7"} err="failed to get container status \"66f42b2744ad4b9447d4d4d163d0600a99d38993b45396efc989a04d39adefe7\": rpc error: code = NotFound desc = could not find container \"66f42b2744ad4b9447d4d4d163d0600a99d38993b45396efc989a04d39adefe7\": container with ID starting with 66f42b2744ad4b9447d4d4d163d0600a99d38993b45396efc989a04d39adefe7 not found: ID does not exist"
Sep 19 15:25:30.981370 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:30.981347    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7884b58df-ttfvn"]
Sep 19 15:25:30.984676 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:30.984657    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7884b58df-ttfvn"]
Sep 19 15:25:31.640069 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:31.640037    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48fc48c4-40e9-43ec-9dfc-cbcb5666c811" path="/var/lib/kubelet/pods/48fc48c4-40e9-43ec-9dfc-cbcb5666c811/volumes"
Sep 19 15:25:51.565138 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:51.565104    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-f47b4794c-k624k"]
Sep 19 15:25:51.565561 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:51.565440    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48fc48c4-40e9-43ec-9dfc-cbcb5666c811" containerName="manager"
Sep 19 15:25:51.565561 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:51.565450    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="48fc48c4-40e9-43ec-9dfc-cbcb5666c811" containerName="manager"
Sep 19 15:25:51.565561 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:51.565531    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="48fc48c4-40e9-43ec-9dfc-cbcb5666c811" containerName="manager"
Sep 19 15:25:51.571719 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:51.571701    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k"
Sep 19 15:25:51.574494 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:51.574475    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zhfqt\""
Sep 19 15:25:51.574631 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:51.574474    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 19 15:25:51.574631 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:51.574475    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 19 15:25:51.579430 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:51.579351    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f47b4794c-k624k"]
Sep 19 15:25:51.716719 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:51.716683    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b24be02-6567-471e-bea5-6acd600d0a07-openshift-service-ca\") pod \"maas-api-f47b4794c-k624k\" (UID: \"6b24be02-6567-471e-bea5-6acd600d0a07\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k"
Sep 19 15:25:51.716719 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:51.716721    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b24be02-6567-471e-bea5-6acd600d0a07-metrics-certs\") pod \"maas-api-f47b4794c-k624k\" (UID: \"6b24be02-6567-471e-bea5-6acd600d0a07\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k"
Sep 19 15:25:51.717017 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:51.716742    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rvhl\" (UniqueName: \"kubernetes.io/projected/6b24be02-6567-471e-bea5-6acd600d0a07-kube-api-access-5rvhl\") pod \"maas-api-f47b4794c-k624k\" (UID: \"6b24be02-6567-471e-bea5-6acd600d0a07\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k"
Sep 19 15:25:51.717017 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:51.716842    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b24be02-6567-471e-bea5-6acd600d0a07-maas-api-tls\") pod \"maas-api-f47b4794c-k624k\" (UID: \"6b24be02-6567-471e-bea5-6acd600d0a07\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k"
Sep 19 15:25:51.817906 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:51.817811    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b24be02-6567-471e-bea5-6acd600d0a07-openshift-service-ca\") pod \"maas-api-f47b4794c-k624k\" (UID: \"6b24be02-6567-471e-bea5-6acd600d0a07\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k"
Sep 19 15:25:51.817906 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:51.817858    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b24be02-6567-471e-bea5-6acd600d0a07-metrics-certs\") pod \"maas-api-f47b4794c-k624k\" (UID: \"6b24be02-6567-471e-bea5-6acd600d0a07\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k"
Sep 19 15:25:51.817906 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:51.817885    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rvhl\" (UniqueName: \"kubernetes.io/projected/6b24be02-6567-471e-bea5-6acd600d0a07-kube-api-access-5rvhl\") pod \"maas-api-f47b4794c-k624k\" (UID: \"6b24be02-6567-471e-bea5-6acd600d0a07\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k"
Sep 19 15:25:51.818149 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:51.817950    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b24be02-6567-471e-bea5-6acd600d0a07-maas-api-tls\") pod \"maas-api-f47b4794c-k624k\" (UID: \"6b24be02-6567-471e-bea5-6acd600d0a07\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k"
Sep 19 15:25:51.818645 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:51.818620    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b24be02-6567-471e-bea5-6acd600d0a07-openshift-service-ca\") pod \"maas-api-f47b4794c-k624k\" (UID: \"6b24be02-6567-471e-bea5-6acd600d0a07\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k"
Sep 19 15:25:51.821294 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:51.821271    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b24be02-6567-471e-bea5-6acd600d0a07-metrics-certs\") pod \"maas-api-f47b4794c-k624k\" (UID: \"6b24be02-6567-471e-bea5-6acd600d0a07\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k"
Sep 19 15:25:51.821387 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:51.821271    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b24be02-6567-471e-bea5-6acd600d0a07-maas-api-tls\") pod \"maas-api-f47b4794c-k624k\" (UID: \"6b24be02-6567-471e-bea5-6acd600d0a07\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k"
Sep 19 15:25:51.825274 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:51.825254    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rvhl\" (UniqueName: \"kubernetes.io/projected/6b24be02-6567-471e-bea5-6acd600d0a07-kube-api-access-5rvhl\") pod \"maas-api-f47b4794c-k624k\" (UID: \"6b24be02-6567-471e-bea5-6acd600d0a07\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k"
Sep 19 15:25:51.883022 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:51.882993    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k"
Sep 19 15:25:52.078589 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:52.078508    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx"]
Sep 19 15:25:52.082129 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:52.082109    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx"
Sep 19 15:25:52.084230 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:52.084209    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jkrrr\""
Sep 19 15:25:52.084383 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:52.084365    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 19 15:25:52.092251 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:52.092227    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx"]
Sep 19 15:25:52.158470 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:52.158445    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f47b4794c-k624k"]
Sep 19 15:25:52.160305 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:25:52.160280    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b24be02_6567_471e_bea5_6acd600d0a07.slice/crio-97d3c675930d76d91fe7a41c150b3fabba3c91da5492cfe4dccd7077615832a7 WatchSource:0}: Error finding container 97d3c675930d76d91fe7a41c150b3fabba3c91da5492cfe4dccd7077615832a7: Status 404 returned error can't find the container with id 97d3c675930d76d91fe7a41c150b3fabba3c91da5492cfe4dccd7077615832a7
Sep 19 15:25:52.222402 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:52.222367    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c451f886-cf40-4056-8dee-eaff5fa7f9e7-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-wwcqx\" (UID: \"c451f886-cf40-4056-8dee-eaff5fa7f9e7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx"
Sep 19 15:25:52.222596 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:52.222420    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp5lc\" (UniqueName: \"kubernetes.io/projected/c451f886-cf40-4056-8dee-eaff5fa7f9e7-kube-api-access-lp5lc\") pod \"payload-pre-processing-59fbc47bf8-wwcqx\" (UID: \"c451f886-cf40-4056-8dee-eaff5fa7f9e7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx"
Sep 19 15:25:52.323200 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:52.323168    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c451f886-cf40-4056-8dee-eaff5fa7f9e7-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-wwcqx\" (UID: \"c451f886-cf40-4056-8dee-eaff5fa7f9e7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx"
Sep 19 15:25:52.323348 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:52.323227    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp5lc\" (UniqueName: \"kubernetes.io/projected/c451f886-cf40-4056-8dee-eaff5fa7f9e7-kube-api-access-lp5lc\") pod \"payload-pre-processing-59fbc47bf8-wwcqx\" (UID: \"c451f886-cf40-4056-8dee-eaff5fa7f9e7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx"
Sep 19 15:25:52.323961 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:52.323938    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c451f886-cf40-4056-8dee-eaff5fa7f9e7-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-wwcqx\" (UID: \"c451f886-cf40-4056-8dee-eaff5fa7f9e7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx"
Sep 19 15:25:52.332677 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:52.332623    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp5lc\" (UniqueName: \"kubernetes.io/projected/c451f886-cf40-4056-8dee-eaff5fa7f9e7-kube-api-access-lp5lc\") pod \"payload-pre-processing-59fbc47bf8-wwcqx\" (UID: \"c451f886-cf40-4056-8dee-eaff5fa7f9e7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx"
Sep 19 15:25:52.394044 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:52.394016    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx"
Sep 19 15:25:52.672180 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:52.668656    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx"]
Sep 19 15:25:52.673995 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:25:52.673964    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc451f886_cf40_4056_8dee_eaff5fa7f9e7.slice/crio-444807d5b79e3b753f3627c31480dbb068b638647ed075617cf5b578d471c545 WatchSource:0}: Error finding container 444807d5b79e3b753f3627c31480dbb068b638647ed075617cf5b578d471c545: Status 404 returned error can't find the container with id 444807d5b79e3b753f3627c31480dbb068b638647ed075617cf5b578d471c545
Sep 19 15:25:53.084221 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:53.084175    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k" event={"ID":"6b24be02-6567-471e-bea5-6acd600d0a07","Type":"ContainerStarted","Data":"97d3c675930d76d91fe7a41c150b3fabba3c91da5492cfe4dccd7077615832a7"}
Sep 19 15:25:53.085437 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:53.085408    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx" event={"ID":"c451f886-cf40-4056-8dee-eaff5fa7f9e7","Type":"ContainerStarted","Data":"444807d5b79e3b753f3627c31480dbb068b638647ed075617cf5b578d471c545"}
Sep 19 15:25:55.099655 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:55.099603    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k" event={"ID":"6b24be02-6567-471e-bea5-6acd600d0a07","Type":"ContainerStarted","Data":"d03da3bae6f58c9c4996bedfffd9191a1d186d33f001eb3ddf5a01bb491539f6"}
Sep 19 15:25:55.100154 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:55.099669    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k"
Sep 19 15:25:55.101391 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:55.101355    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx" event={"ID":"c451f886-cf40-4056-8dee-eaff5fa7f9e7","Type":"ContainerStarted","Data":"21ed05359f91b30e4e78b8d2dc481ca9b316dd8105509360acea8fd05aae0f67"}
Sep 19 15:25:55.101499 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:55.101418    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx"
Sep 19 15:25:55.116029 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:55.115969    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k" podStartSLOduration=1.997857328 podStartE2EDuration="4.115950372s" totalImagesPullingTime="2.118093044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:25:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:25:55.113860954 +0000 UTC m=+830.003060680" watchObservedRunningTime="2026-09-19 15:25:55.115950372 +0000 UTC m=+830.005150087"
Sep 19 15:25:55.127325 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:25:55.127269    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx" podStartSLOduration=1.5212346 podStartE2EDuration="3.127249094s" totalImagesPullingTime="1.606014494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:25:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:25:55.126202918 +0000 UTC m=+830.015402641" watchObservedRunningTime="2026-09-19 15:25:55.127249094 +0000 UTC m=+830.016448808"
Sep 19 15:26:01.112042 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:01.112009    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k"
Sep 19 15:26:06.108651 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:06.108609    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx"
Sep 19 15:26:44.025765 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.025725    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"]
Sep 19 15:26:44.029653 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.029631    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:44.032434 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.032404    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mqcwz\""
Sep 19 15:26:44.032434 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.032419    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 19 15:26:44.032612 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.032418    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 19 15:26:44.032612 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.032441    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 19 15:26:44.039688 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.039654    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"]
Sep 19 15:26:44.171920 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.171863    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0eed00e0-c460-4dc9-8fbf-e481d74339be-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pv4k\" (UID: \"0eed00e0-c460-4dc9-8fbf-e481d74339be\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:44.172074 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.171938    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0eed00e0-c460-4dc9-8fbf-e481d74339be-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pv4k\" (UID: \"0eed00e0-c460-4dc9-8fbf-e481d74339be\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:44.172074 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.171968    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0eed00e0-c460-4dc9-8fbf-e481d74339be-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pv4k\" (UID: \"0eed00e0-c460-4dc9-8fbf-e481d74339be\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:44.172074 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.171988    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0eed00e0-c460-4dc9-8fbf-e481d74339be-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pv4k\" (UID: \"0eed00e0-c460-4dc9-8fbf-e481d74339be\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:44.172074 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.172037    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0eed00e0-c460-4dc9-8fbf-e481d74339be-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pv4k\" (UID: \"0eed00e0-c460-4dc9-8fbf-e481d74339be\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:44.172212 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.172095    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfnnx\" (UniqueName: \"kubernetes.io/projected/0eed00e0-c460-4dc9-8fbf-e481d74339be-kube-api-access-jfnnx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pv4k\" (UID: \"0eed00e0-c460-4dc9-8fbf-e481d74339be\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:44.273237 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.273188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfnnx\" (UniqueName: \"kubernetes.io/projected/0eed00e0-c460-4dc9-8fbf-e481d74339be-kube-api-access-jfnnx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pv4k\" (UID: \"0eed00e0-c460-4dc9-8fbf-e481d74339be\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:44.273438 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.273273    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0eed00e0-c460-4dc9-8fbf-e481d74339be-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pv4k\" (UID: \"0eed00e0-c460-4dc9-8fbf-e481d74339be\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:44.273438 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.273297    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0eed00e0-c460-4dc9-8fbf-e481d74339be-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pv4k\" (UID: \"0eed00e0-c460-4dc9-8fbf-e481d74339be\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:44.273438 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.273315    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0eed00e0-c460-4dc9-8fbf-e481d74339be-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pv4k\" (UID: \"0eed00e0-c460-4dc9-8fbf-e481d74339be\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:44.273438 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.273334    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0eed00e0-c460-4dc9-8fbf-e481d74339be-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pv4k\" (UID: \"0eed00e0-c460-4dc9-8fbf-e481d74339be\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:44.273438 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.273360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0eed00e0-c460-4dc9-8fbf-e481d74339be-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pv4k\" (UID: \"0eed00e0-c460-4dc9-8fbf-e481d74339be\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:44.273783 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.273759    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0eed00e0-c460-4dc9-8fbf-e481d74339be-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pv4k\" (UID: \"0eed00e0-c460-4dc9-8fbf-e481d74339be\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:44.273783 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.273775    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0eed00e0-c460-4dc9-8fbf-e481d74339be-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pv4k\" (UID: \"0eed00e0-c460-4dc9-8fbf-e481d74339be\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:44.273875 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.273822    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0eed00e0-c460-4dc9-8fbf-e481d74339be-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pv4k\" (UID: \"0eed00e0-c460-4dc9-8fbf-e481d74339be\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:44.275708 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.275685    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0eed00e0-c460-4dc9-8fbf-e481d74339be-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pv4k\" (UID: \"0eed00e0-c460-4dc9-8fbf-e481d74339be\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:44.275946 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.275883    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0eed00e0-c460-4dc9-8fbf-e481d74339be-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pv4k\" (UID: \"0eed00e0-c460-4dc9-8fbf-e481d74339be\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:44.281230 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.281201    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfnnx\" (UniqueName: \"kubernetes.io/projected/0eed00e0-c460-4dc9-8fbf-e481d74339be-kube-api-access-jfnnx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pv4k\" (UID: \"0eed00e0-c460-4dc9-8fbf-e481d74339be\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:44.342952 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.342909    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:44.615112 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:44.615080    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"]
Sep 19 15:26:44.616447 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:26:44.616419    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eed00e0_c460_4dc9_8fbf_e481d74339be.slice/crio-5df64ffee376b75a06ee79659d0f4efe6336e9f09aa6de4bbd9a291d96bb022a WatchSource:0}: Error finding container 5df64ffee376b75a06ee79659d0f4efe6336e9f09aa6de4bbd9a291d96bb022a: Status 404 returned error can't find the container with id 5df64ffee376b75a06ee79659d0f4efe6336e9f09aa6de4bbd9a291d96bb022a
Sep 19 15:26:45.377324 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:45.377286    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k" event={"ID":"0eed00e0-c460-4dc9-8fbf-e481d74339be","Type":"ContainerStarted","Data":"5df64ffee376b75a06ee79659d0f4efe6336e9f09aa6de4bbd9a291d96bb022a"}
Sep 19 15:26:46.385435 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:46.385403    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k" event={"ID":"0eed00e0-c460-4dc9-8fbf-e481d74339be","Type":"ContainerStarted","Data":"30e29f3aaf0cd473a8e785339c8a39928d1384b3101ae13e168a95f41c8f89a6"}
Sep 19 15:26:46.402644 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:46.402596    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k" podStartSLOduration=1.457997494 podStartE2EDuration="2.402581823s" totalImagesPullingTime="944.584329ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:26:46.400257103 +0000 UTC m=+881.289456843" watchObservedRunningTime="2026-09-19 15:26:46.402581823 +0000 UTC m=+881.291781535"
Sep 19 15:26:54.343198 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:54.343158    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:54.343642 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:54.343238    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:54.356103 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:54.356081    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:26:54.442978 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:26:54.442952    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pv4k"
Sep 19 15:27:05.590763 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:05.590729    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/1.log"
Sep 19 15:27:05.591176 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:05.590729    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/1.log"
Sep 19 15:27:25.223501 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.223470    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"]
Sep 19 15:27:25.226939 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.226923    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:25.229050 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.229024    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 19 15:27:25.236183 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.236159    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"]
Sep 19 15:27:25.319798 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.319764    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1767d542-ecff-439c-98fc-c45374c228ec-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxll6\" (UID: \"1767d542-ecff-439c-98fc-c45374c228ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:25.319798 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.319802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1767d542-ecff-439c-98fc-c45374c228ec-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxll6\" (UID: \"1767d542-ecff-439c-98fc-c45374c228ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:25.320037 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.319890    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1767d542-ecff-439c-98fc-c45374c228ec-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxll6\" (UID: \"1767d542-ecff-439c-98fc-c45374c228ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:25.320037 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.319948    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1767d542-ecff-439c-98fc-c45374c228ec-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxll6\" (UID: \"1767d542-ecff-439c-98fc-c45374c228ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:25.320037 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.319968    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1767d542-ecff-439c-98fc-c45374c228ec-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxll6\" (UID: \"1767d542-ecff-439c-98fc-c45374c228ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:25.320037 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.319994    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsqhk\" (UniqueName: \"kubernetes.io/projected/1767d542-ecff-439c-98fc-c45374c228ec-kube-api-access-wsqhk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxll6\" (UID: \"1767d542-ecff-439c-98fc-c45374c228ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:25.421272 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.421229    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1767d542-ecff-439c-98fc-c45374c228ec-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxll6\" (UID: \"1767d542-ecff-439c-98fc-c45374c228ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:25.421272 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.421274    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1767d542-ecff-439c-98fc-c45374c228ec-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxll6\" (UID: \"1767d542-ecff-439c-98fc-c45374c228ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:25.421604 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.421292    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1767d542-ecff-439c-98fc-c45374c228ec-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxll6\" (UID: \"1767d542-ecff-439c-98fc-c45374c228ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:25.421604 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.421418    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsqhk\" (UniqueName: \"kubernetes.io/projected/1767d542-ecff-439c-98fc-c45374c228ec-kube-api-access-wsqhk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxll6\" (UID: \"1767d542-ecff-439c-98fc-c45374c228ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:25.421604 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.421533    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1767d542-ecff-439c-98fc-c45374c228ec-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxll6\" (UID: \"1767d542-ecff-439c-98fc-c45374c228ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:25.421604 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.421568    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1767d542-ecff-439c-98fc-c45374c228ec-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxll6\" (UID: \"1767d542-ecff-439c-98fc-c45374c228ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:25.421798 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.421709    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1767d542-ecff-439c-98fc-c45374c228ec-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxll6\" (UID: \"1767d542-ecff-439c-98fc-c45374c228ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:25.421952 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.421923    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1767d542-ecff-439c-98fc-c45374c228ec-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxll6\" (UID: \"1767d542-ecff-439c-98fc-c45374c228ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:25.422020 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.421932    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1767d542-ecff-439c-98fc-c45374c228ec-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxll6\" (UID: \"1767d542-ecff-439c-98fc-c45374c228ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:25.423717 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.423699    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1767d542-ecff-439c-98fc-c45374c228ec-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxll6\" (UID: \"1767d542-ecff-439c-98fc-c45374c228ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:25.424014 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.423994    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1767d542-ecff-439c-98fc-c45374c228ec-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxll6\" (UID: \"1767d542-ecff-439c-98fc-c45374c228ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:25.429702 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.429673    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsqhk\" (UniqueName: \"kubernetes.io/projected/1767d542-ecff-439c-98fc-c45374c228ec-kube-api-access-wsqhk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxll6\" (UID: \"1767d542-ecff-439c-98fc-c45374c228ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:25.539970 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.539848    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:25.812396 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.812373    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"]
Sep 19 15:27:25.814755 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:27:25.814720    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1767d542_ecff_439c_98fc_c45374c228ec.slice/crio-b218e1b7c65fae1b372917364e2259214688f5a13a14ada404ed3a833ca61fb5 WatchSource:0}: Error finding container b218e1b7c65fae1b372917364e2259214688f5a13a14ada404ed3a833ca61fb5: Status 404 returned error can't find the container with id b218e1b7c65fae1b372917364e2259214688f5a13a14ada404ed3a833ca61fb5
Sep 19 15:27:25.816161 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:25.816138    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 15:27:26.614756 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:26.614719    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6" event={"ID":"1767d542-ecff-439c-98fc-c45374c228ec","Type":"ContainerStarted","Data":"4d30d131a2aafc79a6a00e428a502983ae8dbcc88ba9bd4b3852df7166c0463e"}
Sep 19 15:27:26.615221 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:26.614775    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6" event={"ID":"1767d542-ecff-439c-98fc-c45374c228ec","Type":"ContainerStarted","Data":"b218e1b7c65fae1b372917364e2259214688f5a13a14ada404ed3a833ca61fb5"}
Sep 19 15:27:26.631223 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:26.631160    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6" podStartSLOduration=1.458269228 podStartE2EDuration="1.631143185s" totalImagesPullingTime="172.873957ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:27:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:27:26.62863483 +0000 UTC m=+921.517834581" watchObservedRunningTime="2026-09-19 15:27:26.631143185 +0000 UTC m=+921.520342899"
Sep 19 15:27:35.540349 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:35.540306    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:35.540848 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:35.540389    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:35.553042 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:35.553010    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:27:35.672854 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:27:35.672822    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxll6"
Sep 19 15:29:00.123238 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:00.123200    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-764945cb74-dlhf4"]
Sep 19 15:29:00.127097 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:00.127075    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-764945cb74-dlhf4"
Sep 19 15:29:00.129027 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:00.129009    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\""
Sep 19 15:29:00.129138 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:00.129103    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-5xl2v\""
Sep 19 15:29:00.133797 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:00.133771    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-764945cb74-dlhf4"]
Sep 19 15:29:00.258203 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:00.258163    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crzjd\" (UniqueName: \"kubernetes.io/projected/4225b952-e418-4f40-abb1-4384f408d33c-kube-api-access-crzjd\") pod \"ai-gateway-controller-764945cb74-dlhf4\" (UID: \"4225b952-e418-4f40-abb1-4384f408d33c\") " pod="opendatahub/ai-gateway-controller-764945cb74-dlhf4"
Sep 19 15:29:00.359624 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:00.359577    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crzjd\" (UniqueName: \"kubernetes.io/projected/4225b952-e418-4f40-abb1-4384f408d33c-kube-api-access-crzjd\") pod \"ai-gateway-controller-764945cb74-dlhf4\" (UID: \"4225b952-e418-4f40-abb1-4384f408d33c\") " pod="opendatahub/ai-gateway-controller-764945cb74-dlhf4"
Sep 19 15:29:00.367074 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:00.367044    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crzjd\" (UniqueName: \"kubernetes.io/projected/4225b952-e418-4f40-abb1-4384f408d33c-kube-api-access-crzjd\") pod \"ai-gateway-controller-764945cb74-dlhf4\" (UID: \"4225b952-e418-4f40-abb1-4384f408d33c\") " pod="opendatahub/ai-gateway-controller-764945cb74-dlhf4"
Sep 19 15:29:00.438638 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:00.438608    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-764945cb74-dlhf4"
Sep 19 15:29:00.708728 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:00.708698    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-764945cb74-dlhf4"]
Sep 19 15:29:00.709736 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:29:00.709704    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4225b952_e418_4f40_abb1_4384f408d33c.slice/crio-bd9162ae942a3f70dc20bee47a9a7548cb5cec3e6f3f1c24feb10ce295b3daf9 WatchSource:0}: Error finding container bd9162ae942a3f70dc20bee47a9a7548cb5cec3e6f3f1c24feb10ce295b3daf9: Status 404 returned error can't find the container with id bd9162ae942a3f70dc20bee47a9a7548cb5cec3e6f3f1c24feb10ce295b3daf9
Sep 19 15:29:01.117029 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:01.116948    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-764945cb74-dlhf4" event={"ID":"4225b952-e418-4f40-abb1-4384f408d33c","Type":"ContainerStarted","Data":"bd9162ae942a3f70dc20bee47a9a7548cb5cec3e6f3f1c24feb10ce295b3daf9"}
Sep 19 15:29:02.124902 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:02.124863    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-764945cb74-dlhf4" event={"ID":"4225b952-e418-4f40-abb1-4384f408d33c","Type":"ContainerStarted","Data":"709892108baa6a543a442d887c9135d8661483dbf77a984aaaf75e698e556e9a"}
Sep 19 15:29:02.125307 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:02.125027    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-764945cb74-dlhf4"
Sep 19 15:29:02.139456 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:02.139408    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-764945cb74-dlhf4" podStartSLOduration=0.808952658 podStartE2EDuration="2.139382596s" totalImagesPullingTime="1.330429938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:29:02.138412835 +0000 UTC m=+1017.027612547" watchObservedRunningTime="2026-09-19 15:29:02.139382596 +0000 UTC m=+1017.028582308"
Sep 19 15:29:13.132791 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:13.132756    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-764945cb74-dlhf4"
Sep 19 15:29:13.310598 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:13.310559    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-654f84df5-5lqml"]
Sep 19 15:29:13.314188 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:13.314172    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-654f84df5-5lqml"
Sep 19 15:29:13.320367 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:13.320244    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-654f84df5-5lqml"]
Sep 19 15:29:13.476381 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:13.476351    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcb7x\" (UniqueName: \"kubernetes.io/projected/3b5c7338-dd99-4112-a139-b8cacae92730-kube-api-access-xcb7x\") pod \"ai-gateway-controller-654f84df5-5lqml\" (UID: \"3b5c7338-dd99-4112-a139-b8cacae92730\") " pod="opendatahub/ai-gateway-controller-654f84df5-5lqml"
Sep 19 15:29:13.577643 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:13.577605    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcb7x\" (UniqueName: \"kubernetes.io/projected/3b5c7338-dd99-4112-a139-b8cacae92730-kube-api-access-xcb7x\") pod \"ai-gateway-controller-654f84df5-5lqml\" (UID: \"3b5c7338-dd99-4112-a139-b8cacae92730\") " pod="opendatahub/ai-gateway-controller-654f84df5-5lqml"
Sep 19 15:29:13.585390 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:13.585361    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcb7x\" (UniqueName: \"kubernetes.io/projected/3b5c7338-dd99-4112-a139-b8cacae92730-kube-api-access-xcb7x\") pod \"ai-gateway-controller-654f84df5-5lqml\" (UID: \"3b5c7338-dd99-4112-a139-b8cacae92730\") " pod="opendatahub/ai-gateway-controller-654f84df5-5lqml"
Sep 19 15:29:13.626181 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:13.626154    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-654f84df5-5lqml"
Sep 19 15:29:13.896525 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:13.896499    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-654f84df5-5lqml"]
Sep 19 15:29:13.897629 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:29:13.897601    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b5c7338_dd99_4112_a139_b8cacae92730.slice/crio-665ad4940ecab50808d5cbabd71cc86f66524e24e963d3bf9573e63961f193bb WatchSource:0}: Error finding container 665ad4940ecab50808d5cbabd71cc86f66524e24e963d3bf9573e63961f193bb: Status 404 returned error can't find the container with id 665ad4940ecab50808d5cbabd71cc86f66524e24e963d3bf9573e63961f193bb
Sep 19 15:29:14.192612 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:14.192578    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-654f84df5-5lqml" event={"ID":"3b5c7338-dd99-4112-a139-b8cacae92730","Type":"ContainerStarted","Data":"665ad4940ecab50808d5cbabd71cc86f66524e24e963d3bf9573e63961f193bb"}
Sep 19 15:29:15.200502 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:15.200462    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-654f84df5-5lqml" event={"ID":"3b5c7338-dd99-4112-a139-b8cacae92730","Type":"ContainerStarted","Data":"fd66251e565b75e161508d1a96d332558bf63ef322cc315e4f1ad4d05dd85ddb"}
Sep 19 15:29:15.200909 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:15.200533    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-654f84df5-5lqml"
Sep 19 15:29:15.213706 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:15.213662    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-654f84df5-5lqml" podStartSLOduration=1.9103131 podStartE2EDuration="2.213621163s" totalImagesPullingTime="303.308063ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:29:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:29:15.212722831 +0000 UTC m=+1030.101922540" watchObservedRunningTime="2026-09-19 15:29:15.213621163 +0000 UTC m=+1030.102820922"
Sep 19 15:29:26.209439 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:26.209404    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-654f84df5-5lqml"
Sep 19 15:29:26.246766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:26.246736    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-764945cb74-dlhf4"]
Sep 19 15:29:26.246974 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:26.246946    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-764945cb74-dlhf4" podUID="4225b952-e418-4f40-abb1-4384f408d33c" containerName="manager" containerID="cri-o://709892108baa6a543a442d887c9135d8661483dbf77a984aaaf75e698e556e9a" gracePeriod=30
Sep 19 15:29:26.500646 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:26.500612    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-764945cb74-dlhf4"
Sep 19 15:29:26.690207 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:26.690155    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crzjd\" (UniqueName: \"kubernetes.io/projected/4225b952-e418-4f40-abb1-4384f408d33c-kube-api-access-crzjd\") pod \"4225b952-e418-4f40-abb1-4384f408d33c\" (UID: \"4225b952-e418-4f40-abb1-4384f408d33c\") "
Sep 19 15:29:26.692459 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:26.692430    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4225b952-e418-4f40-abb1-4384f408d33c-kube-api-access-crzjd" (OuterVolumeSpecName: "kube-api-access-crzjd") pod "4225b952-e418-4f40-abb1-4384f408d33c" (UID: "4225b952-e418-4f40-abb1-4384f408d33c"). InnerVolumeSpecName "kube-api-access-crzjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:29:26.790869 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:26.790783    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crzjd\" (UniqueName: \"kubernetes.io/projected/4225b952-e418-4f40-abb1-4384f408d33c-kube-api-access-crzjd\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:29:27.101240 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:27.101159    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx"]
Sep 19 15:29:27.101414 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:27.101388    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx" podUID="c451f886-cf40-4056-8dee-eaff5fa7f9e7" containerName="payload-pre-processing" containerID="cri-o://21ed05359f91b30e4e78b8d2dc481ca9b316dd8105509360acea8fd05aae0f67" gracePeriod=30
Sep 19 15:29:27.272464 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:27.272429    2563 generic.go:356] "Generic (PLEG): container finished" podID="4225b952-e418-4f40-abb1-4384f408d33c" containerID="709892108baa6a543a442d887c9135d8661483dbf77a984aaaf75e698e556e9a" exitCode=0
Sep 19 15:29:27.272923 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:27.272478    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-764945cb74-dlhf4"
Sep 19 15:29:27.272923 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:27.272507    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-764945cb74-dlhf4" event={"ID":"4225b952-e418-4f40-abb1-4384f408d33c","Type":"ContainerDied","Data":"709892108baa6a543a442d887c9135d8661483dbf77a984aaaf75e698e556e9a"}
Sep 19 15:29:27.272923 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:27.272563    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-764945cb74-dlhf4" event={"ID":"4225b952-e418-4f40-abb1-4384f408d33c","Type":"ContainerDied","Data":"bd9162ae942a3f70dc20bee47a9a7548cb5cec3e6f3f1c24feb10ce295b3daf9"}
Sep 19 15:29:27.272923 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:27.272590    2563 scope.go:117] "RemoveContainer" containerID="709892108baa6a543a442d887c9135d8661483dbf77a984aaaf75e698e556e9a"
Sep 19 15:29:27.275031 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:27.274965    2563 generic.go:356] "Generic (PLEG): container finished" podID="c451f886-cf40-4056-8dee-eaff5fa7f9e7" containerID="21ed05359f91b30e4e78b8d2dc481ca9b316dd8105509360acea8fd05aae0f67" exitCode=0
Sep 19 15:29:27.275109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:27.275034    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx" event={"ID":"c451f886-cf40-4056-8dee-eaff5fa7f9e7","Type":"ContainerDied","Data":"21ed05359f91b30e4e78b8d2dc481ca9b316dd8105509360acea8fd05aae0f67"}
Sep 19 15:29:27.285090 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:27.284985    2563 scope.go:117] "RemoveContainer" containerID="709892108baa6a543a442d887c9135d8661483dbf77a984aaaf75e698e556e9a"
Sep 19 15:29:27.285385 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:29:27.285352    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"709892108baa6a543a442d887c9135d8661483dbf77a984aaaf75e698e556e9a\": container with ID starting with 709892108baa6a543a442d887c9135d8661483dbf77a984aaaf75e698e556e9a not found: ID does not exist" containerID="709892108baa6a543a442d887c9135d8661483dbf77a984aaaf75e698e556e9a"
Sep 19 15:29:27.285455 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:27.285388    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"709892108baa6a543a442d887c9135d8661483dbf77a984aaaf75e698e556e9a"} err="failed to get container status \"709892108baa6a543a442d887c9135d8661483dbf77a984aaaf75e698e556e9a\": rpc error: code = NotFound desc = could not find container \"709892108baa6a543a442d887c9135d8661483dbf77a984aaaf75e698e556e9a\": container with ID starting with 709892108baa6a543a442d887c9135d8661483dbf77a984aaaf75e698e556e9a not found: ID does not exist"
Sep 19 15:29:27.295084 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:27.295061    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-764945cb74-dlhf4"]
Sep 19 15:29:27.298775 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:27.298752    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-764945cb74-dlhf4"]
Sep 19 15:29:27.363946 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:27.363863    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx"
Sep 19 15:29:27.497269 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:27.497241    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c451f886-cf40-4056-8dee-eaff5fa7f9e7-plugins-config-volume\") pod \"c451f886-cf40-4056-8dee-eaff5fa7f9e7\" (UID: \"c451f886-cf40-4056-8dee-eaff5fa7f9e7\") "
Sep 19 15:29:27.497443 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:27.497342    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lp5lc\" (UniqueName: \"kubernetes.io/projected/c451f886-cf40-4056-8dee-eaff5fa7f9e7-kube-api-access-lp5lc\") pod \"c451f886-cf40-4056-8dee-eaff5fa7f9e7\" (UID: \"c451f886-cf40-4056-8dee-eaff5fa7f9e7\") "
Sep 19 15:29:27.497698 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:27.497673    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c451f886-cf40-4056-8dee-eaff5fa7f9e7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c451f886-cf40-4056-8dee-eaff5fa7f9e7" (UID: "c451f886-cf40-4056-8dee-eaff5fa7f9e7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:29:27.499533 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:27.499511    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c451f886-cf40-4056-8dee-eaff5fa7f9e7-kube-api-access-lp5lc" (OuterVolumeSpecName: "kube-api-access-lp5lc") pod "c451f886-cf40-4056-8dee-eaff5fa7f9e7" (UID: "c451f886-cf40-4056-8dee-eaff5fa7f9e7"). InnerVolumeSpecName "kube-api-access-lp5lc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:29:27.598620 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:27.598593    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lp5lc\" (UniqueName: \"kubernetes.io/projected/c451f886-cf40-4056-8dee-eaff5fa7f9e7-kube-api-access-lp5lc\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:29:27.598620 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:27.598617    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c451f886-cf40-4056-8dee-eaff5fa7f9e7-plugins-config-volume\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:29:27.647597 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:27.647518    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4225b952-e418-4f40-abb1-4384f408d33c" path="/var/lib/kubelet/pods/4225b952-e418-4f40-abb1-4384f408d33c/volumes"
Sep 19 15:29:28.281832 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:28.281801    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx"
Sep 19 15:29:28.282346 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:28.281832    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx" event={"ID":"c451f886-cf40-4056-8dee-eaff5fa7f9e7","Type":"ContainerDied","Data":"444807d5b79e3b753f3627c31480dbb068b638647ed075617cf5b578d471c545"}
Sep 19 15:29:28.282346 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:28.281923    2563 scope.go:117] "RemoveContainer" containerID="21ed05359f91b30e4e78b8d2dc481ca9b316dd8105509360acea8fd05aae0f67"
Sep 19 15:29:28.296817 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:28.296792    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx"]
Sep 19 15:29:28.300007 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:28.299984    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx"]
Sep 19 15:29:29.640923 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:29.640877    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c451f886-cf40-4056-8dee-eaff5fa7f9e7" path="/var/lib/kubelet/pods/c451f886-cf40-4056-8dee-eaff5fa7f9e7/volumes"
Sep 19 15:29:46.555723 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.555686    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-85fd65c94c-d9qjb"]
Sep 19 15:29:46.556342 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.556322    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4225b952-e418-4f40-abb1-4384f408d33c" containerName="manager"
Sep 19 15:29:46.556389 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.556348    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4225b952-e418-4f40-abb1-4384f408d33c" containerName="manager"
Sep 19 15:29:46.556389 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.556364    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c451f886-cf40-4056-8dee-eaff5fa7f9e7" containerName="payload-pre-processing"
Sep 19 15:29:46.556389 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.556373    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c451f886-cf40-4056-8dee-eaff5fa7f9e7" containerName="payload-pre-processing"
Sep 19 15:29:46.556509 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.556497    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4225b952-e418-4f40-abb1-4384f408d33c" containerName="manager"
Sep 19 15:29:46.556544 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.556518    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c451f886-cf40-4056-8dee-eaff5fa7f9e7" containerName="payload-pre-processing"
Sep 19 15:29:46.560164 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.560145    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-85fd65c94c-d9qjb"
Sep 19 15:29:46.562232 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.562211    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jkrrr\""
Sep 19 15:29:46.562549 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.562280    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 19 15:29:46.563950 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.563924    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-85fd65c94c-d9qjb"]
Sep 19 15:29:46.590185 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.590152    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-76f657cdc4-797pq"]
Sep 19 15:29:46.593595 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.593574    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-76f657cdc4-797pq"
Sep 19 15:29:46.604839 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.604811    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-76f657cdc4-797pq"]
Sep 19 15:29:46.655245 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.655207    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn8kj\" (UniqueName: \"kubernetes.io/projected/84b17b0d-760c-4abd-a213-03033d4ddab7-kube-api-access-xn8kj\") pod \"payload-processing-85fd65c94c-d9qjb\" (UID: \"84b17b0d-760c-4abd-a213-03033d4ddab7\") " pod="openshift-ingress/payload-processing-85fd65c94c-d9qjb"
Sep 19 15:29:46.655448 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.655255    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84b17b0d-760c-4abd-a213-03033d4ddab7-plugins-config-volume\") pod \"payload-processing-85fd65c94c-d9qjb\" (UID: \"84b17b0d-760c-4abd-a213-03033d4ddab7\") " pod="openshift-ingress/payload-processing-85fd65c94c-d9qjb"
Sep 19 15:29:46.655448 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.655309    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db8p5\" (UniqueName: \"kubernetes.io/projected/2aceba6c-8f11-4a56-8f0c-26a686fec108-kube-api-access-db8p5\") pod \"payload-pre-processing-76f657cdc4-797pq\" (UID: \"2aceba6c-8f11-4a56-8f0c-26a686fec108\") " pod="openshift-ingress/payload-pre-processing-76f657cdc4-797pq"
Sep 19 15:29:46.655448 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.655340    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2aceba6c-8f11-4a56-8f0c-26a686fec108-plugins-config-volume\") pod \"payload-pre-processing-76f657cdc4-797pq\" (UID: \"2aceba6c-8f11-4a56-8f0c-26a686fec108\") " pod="openshift-ingress/payload-pre-processing-76f657cdc4-797pq"
Sep 19 15:29:46.756266 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.756232    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn8kj\" (UniqueName: \"kubernetes.io/projected/84b17b0d-760c-4abd-a213-03033d4ddab7-kube-api-access-xn8kj\") pod \"payload-processing-85fd65c94c-d9qjb\" (UID: \"84b17b0d-760c-4abd-a213-03033d4ddab7\") " pod="openshift-ingress/payload-processing-85fd65c94c-d9qjb"
Sep 19 15:29:46.756429 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.756279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84b17b0d-760c-4abd-a213-03033d4ddab7-plugins-config-volume\") pod \"payload-processing-85fd65c94c-d9qjb\" (UID: \"84b17b0d-760c-4abd-a213-03033d4ddab7\") " pod="openshift-ingress/payload-processing-85fd65c94c-d9qjb"
Sep 19 15:29:46.756429 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.756306    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db8p5\" (UniqueName: \"kubernetes.io/projected/2aceba6c-8f11-4a56-8f0c-26a686fec108-kube-api-access-db8p5\") pod \"payload-pre-processing-76f657cdc4-797pq\" (UID: \"2aceba6c-8f11-4a56-8f0c-26a686fec108\") " pod="openshift-ingress/payload-pre-processing-76f657cdc4-797pq"
Sep 19 15:29:46.756429 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.756335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2aceba6c-8f11-4a56-8f0c-26a686fec108-plugins-config-volume\") pod \"payload-pre-processing-76f657cdc4-797pq\" (UID: \"2aceba6c-8f11-4a56-8f0c-26a686fec108\") " pod="openshift-ingress/payload-pre-processing-76f657cdc4-797pq"
Sep 19 15:29:46.757219 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.757201    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84b17b0d-760c-4abd-a213-03033d4ddab7-plugins-config-volume\") pod \"payload-processing-85fd65c94c-d9qjb\" (UID: \"84b17b0d-760c-4abd-a213-03033d4ddab7\") " pod="openshift-ingress/payload-processing-85fd65c94c-d9qjb"
Sep 19 15:29:46.757269 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.757202    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2aceba6c-8f11-4a56-8f0c-26a686fec108-plugins-config-volume\") pod \"payload-pre-processing-76f657cdc4-797pq\" (UID: \"2aceba6c-8f11-4a56-8f0c-26a686fec108\") " pod="openshift-ingress/payload-pre-processing-76f657cdc4-797pq"
Sep 19 15:29:46.763370 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.763344    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn8kj\" (UniqueName: \"kubernetes.io/projected/84b17b0d-760c-4abd-a213-03033d4ddab7-kube-api-access-xn8kj\") pod \"payload-processing-85fd65c94c-d9qjb\" (UID: \"84b17b0d-760c-4abd-a213-03033d4ddab7\") " pod="openshift-ingress/payload-processing-85fd65c94c-d9qjb"
Sep 19 15:29:46.763504 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.763441    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db8p5\" (UniqueName: \"kubernetes.io/projected/2aceba6c-8f11-4a56-8f0c-26a686fec108-kube-api-access-db8p5\") pod \"payload-pre-processing-76f657cdc4-797pq\" (UID: \"2aceba6c-8f11-4a56-8f0c-26a686fec108\") " pod="openshift-ingress/payload-pre-processing-76f657cdc4-797pq"
Sep 19 15:29:46.872251 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.872155    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-85fd65c94c-d9qjb"
Sep 19 15:29:46.906170 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:46.906138    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-76f657cdc4-797pq"
Sep 19 15:29:47.146881 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:47.146851    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-85fd65c94c-d9qjb"]
Sep 19 15:29:47.148066 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:29:47.148032    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84b17b0d_760c_4abd_a213_03033d4ddab7.slice/crio-534c34de12c6ce30d10659c7708563e08b5146042478164d004d0f0f7c347fca WatchSource:0}: Error finding container 534c34de12c6ce30d10659c7708563e08b5146042478164d004d0f0f7c347fca: Status 404 returned error can't find the container with id 534c34de12c6ce30d10659c7708563e08b5146042478164d004d0f0f7c347fca
Sep 19 15:29:47.189070 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:47.189046    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-76f657cdc4-797pq"]
Sep 19 15:29:47.190354 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:29:47.190335    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aceba6c_8f11_4a56_8f0c_26a686fec108.slice/crio-b20b67077fb2f92907f72c58fa3d1bda4278d8ac4b5ee0c3dbdcfbbd614a6334 WatchSource:0}: Error finding container b20b67077fb2f92907f72c58fa3d1bda4278d8ac4b5ee0c3dbdcfbbd614a6334: Status 404 returned error can't find the container with id b20b67077fb2f92907f72c58fa3d1bda4278d8ac4b5ee0c3dbdcfbbd614a6334
Sep 19 15:29:47.390358 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:47.390323    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-76f657cdc4-797pq" event={"ID":"2aceba6c-8f11-4a56-8f0c-26a686fec108","Type":"ContainerStarted","Data":"b20b67077fb2f92907f72c58fa3d1bda4278d8ac4b5ee0c3dbdcfbbd614a6334"}
Sep 19 15:29:47.391854 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:47.391826    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-85fd65c94c-d9qjb" event={"ID":"84b17b0d-760c-4abd-a213-03033d4ddab7","Type":"ContainerStarted","Data":"534c34de12c6ce30d10659c7708563e08b5146042478164d004d0f0f7c347fca"}
Sep 19 15:29:48.398928 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:48.398872    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-85fd65c94c-d9qjb" event={"ID":"84b17b0d-760c-4abd-a213-03033d4ddab7","Type":"ContainerStarted","Data":"9fbed2d5f06650a25835256c96dd06f28b9f137f250ab2a7ce819a331240c721"}
Sep 19 15:29:48.400600 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:48.400575    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-76f657cdc4-797pq" event={"ID":"2aceba6c-8f11-4a56-8f0c-26a686fec108","Type":"ContainerStarted","Data":"d8686d1d6c1f1f155c076ebcc9e93370ab1e35f22df6dbfc9d952622accce27e"}
Sep 19 15:29:48.400722 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:48.400622    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-76f657cdc4-797pq"
Sep 19 15:29:48.414436 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:48.414394    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-85fd65c94c-d9qjb" podStartSLOduration=1.320234785 podStartE2EDuration="2.414380038s" totalImagesPullingTime="1.094145253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:29:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:29:48.413119663 +0000 UTC m=+1063.302319375" watchObservedRunningTime="2026-09-19 15:29:48.414380038 +0000 UTC m=+1063.303579750"
Sep 19 15:29:48.433924 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:48.429696    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-76f657cdc4-797pq" podStartSLOduration=1.379996509 podStartE2EDuration="2.42967607s" totalImagesPullingTime="1.049679561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:29:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:29:48.426510699 +0000 UTC m=+1063.315710412" watchObservedRunningTime="2026-09-19 15:29:48.42967607 +0000 UTC m=+1063.318875784"
Sep 19 15:29:49.406129 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:49.406098    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-85fd65c94c-d9qjb"
Sep 19 15:29:59.408086 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:29:59.408056    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-76f657cdc4-797pq"
Sep 19 15:30:00.414977 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:00.414947    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-85fd65c94c-d9qjb"
Sep 19 15:30:24.453715 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:24.453676    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"]
Sep 19 15:30:24.460017 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:24.459997    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"
Sep 19 15:30:24.461886 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:24.461862    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-21d2a4-serving-cert\""
Sep 19 15:30:24.467244 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:24.467221    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"]
Sep 19 15:30:24.494730 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:24.494699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/955a87c9-c90e-4034-b0ea-a52666760677-maas-api-tls\") pod \"maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk\" (UID: \"955a87c9-c90e-4034-b0ea-a52666760677\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"
Sep 19 15:30:24.494879 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:24.494746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/955a87c9-c90e-4034-b0ea-a52666760677-openshift-service-ca\") pod \"maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk\" (UID: \"955a87c9-c90e-4034-b0ea-a52666760677\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"
Sep 19 15:30:24.494879 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:24.494844    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m49jc\" (UniqueName: \"kubernetes.io/projected/955a87c9-c90e-4034-b0ea-a52666760677-kube-api-access-m49jc\") pod \"maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk\" (UID: \"955a87c9-c90e-4034-b0ea-a52666760677\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"
Sep 19 15:30:24.495008 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:24.494924    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/955a87c9-c90e-4034-b0ea-a52666760677-metrics-certs\") pod \"maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk\" (UID: \"955a87c9-c90e-4034-b0ea-a52666760677\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"
Sep 19 15:30:24.596043 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:24.596013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m49jc\" (UniqueName: \"kubernetes.io/projected/955a87c9-c90e-4034-b0ea-a52666760677-kube-api-access-m49jc\") pod \"maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk\" (UID: \"955a87c9-c90e-4034-b0ea-a52666760677\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"
Sep 19 15:30:24.596043 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:24.596050    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/955a87c9-c90e-4034-b0ea-a52666760677-metrics-certs\") pod \"maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk\" (UID: \"955a87c9-c90e-4034-b0ea-a52666760677\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"
Sep 19 15:30:24.596283 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:24.596093    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/955a87c9-c90e-4034-b0ea-a52666760677-maas-api-tls\") pod \"maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk\" (UID: \"955a87c9-c90e-4034-b0ea-a52666760677\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"
Sep 19 15:30:24.596283 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:24.596111    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/955a87c9-c90e-4034-b0ea-a52666760677-openshift-service-ca\") pod \"maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk\" (UID: \"955a87c9-c90e-4034-b0ea-a52666760677\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"
Sep 19 15:30:24.596283 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:30:24.596236    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-serving-cert: secret "maas-api-e2e-inf-a-21d2a4-serving-cert" not found
Sep 19 15:30:24.596468 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:30:24.596309    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/955a87c9-c90e-4034-b0ea-a52666760677-maas-api-tls podName:955a87c9-c90e-4034-b0ea-a52666760677 nodeName:}" failed. No retries permitted until 2026-09-19 15:30:25.096293623 +0000 UTC m=+1099.985493314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/955a87c9-c90e-4034-b0ea-a52666760677-maas-api-tls") pod "maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk" (UID: "955a87c9-c90e-4034-b0ea-a52666760677") : secret "maas-api-e2e-inf-a-21d2a4-serving-cert" not found
Sep 19 15:30:24.596699 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:24.596674    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/955a87c9-c90e-4034-b0ea-a52666760677-openshift-service-ca\") pod \"maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk\" (UID: \"955a87c9-c90e-4034-b0ea-a52666760677\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"
Sep 19 15:30:24.598739 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:24.598714    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/955a87c9-c90e-4034-b0ea-a52666760677-metrics-certs\") pod \"maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk\" (UID: \"955a87c9-c90e-4034-b0ea-a52666760677\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"
Sep 19 15:30:24.604402 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:24.604374    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m49jc\" (UniqueName: \"kubernetes.io/projected/955a87c9-c90e-4034-b0ea-a52666760677-kube-api-access-m49jc\") pod \"maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk\" (UID: \"955a87c9-c90e-4034-b0ea-a52666760677\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"
Sep 19 15:30:25.099760 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.099726    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/955a87c9-c90e-4034-b0ea-a52666760677-maas-api-tls\") pod \"maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk\" (UID: \"955a87c9-c90e-4034-b0ea-a52666760677\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"
Sep 19 15:30:25.102479 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.102453    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/955a87c9-c90e-4034-b0ea-a52666760677-maas-api-tls\") pod \"maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk\" (UID: \"955a87c9-c90e-4034-b0ea-a52666760677\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"
Sep 19 15:30:25.170773 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.170721    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd"]
Sep 19 15:30:25.175818 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.175794    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd"
Sep 19 15:30:25.177764 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.177743    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-21d2a4-dockercfg-9ckhk\""
Sep 19 15:30:25.177884 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.177798    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-21d2a4\""
Sep 19 15:30:25.182354 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.182332    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd"]
Sep 19 15:30:25.200349 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.200327    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd\" (UID: \"96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd"
Sep 19 15:30:25.200467 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.200379    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4kgf\" (UniqueName: \"kubernetes.io/projected/96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0-kube-api-access-g4kgf\") pod \"payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd\" (UID: \"96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd"
Sep 19 15:30:25.301310 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.301273    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd\" (UID: \"96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd"
Sep 19 15:30:25.301470 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.301339    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4kgf\" (UniqueName: \"kubernetes.io/projected/96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0-kube-api-access-g4kgf\") pod \"payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd\" (UID: \"96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd"
Sep 19 15:30:25.302019 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.301998    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd\" (UID: \"96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd"
Sep 19 15:30:25.309374 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.309351    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4kgf\" (UniqueName: \"kubernetes.io/projected/96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0-kube-api-access-g4kgf\") pod \"payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd\" (UID: \"96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd"
Sep 19 15:30:25.372556 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.372477    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"
Sep 19 15:30:25.490651 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.490617    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd"
Sep 19 15:30:25.536519 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.536486    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"]
Sep 19 15:30:25.541094 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.541070    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"
Sep 19 15:30:25.543157 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.543101    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-15949d-serving-cert\""
Sep 19 15:30:25.558825 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.551820    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"]
Sep 19 15:30:25.604095 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.604066    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91d03d2d-7d14-4f0b-b601-0a47321048f2-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5\" (UID: \"91d03d2d-7d14-4f0b-b601-0a47321048f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"
Sep 19 15:30:25.604259 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.604242    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb2k8\" (UniqueName: \"kubernetes.io/projected/91d03d2d-7d14-4f0b-b601-0a47321048f2-kube-api-access-cb2k8\") pod \"maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5\" (UID: \"91d03d2d-7d14-4f0b-b601-0a47321048f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"
Sep 19 15:30:25.604328 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.604311    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91d03d2d-7d14-4f0b-b601-0a47321048f2-maas-api-tls\") pod \"maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5\" (UID: \"91d03d2d-7d14-4f0b-b601-0a47321048f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"
Sep 19 15:30:25.604372 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.604339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91d03d2d-7d14-4f0b-b601-0a47321048f2-metrics-certs\") pod \"maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5\" (UID: \"91d03d2d-7d14-4f0b-b601-0a47321048f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"
Sep 19 15:30:25.651314 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.651288    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"]
Sep 19 15:30:25.654156 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:30:25.654123    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod955a87c9_c90e_4034_b0ea_a52666760677.slice/crio-08418e5c4e8e57075717fbcfb38811d6133536d02cfb3d64b76794264ab700c0 WatchSource:0}: Error finding container 08418e5c4e8e57075717fbcfb38811d6133536d02cfb3d64b76794264ab700c0: Status 404 returned error can't find the container with id 08418e5c4e8e57075717fbcfb38811d6133536d02cfb3d64b76794264ab700c0
Sep 19 15:30:25.705257 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.705217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb2k8\" (UniqueName: \"kubernetes.io/projected/91d03d2d-7d14-4f0b-b601-0a47321048f2-kube-api-access-cb2k8\") pod \"maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5\" (UID: \"91d03d2d-7d14-4f0b-b601-0a47321048f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"
Sep 19 15:30:25.705585 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.705551    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91d03d2d-7d14-4f0b-b601-0a47321048f2-maas-api-tls\") pod \"maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5\" (UID: \"91d03d2d-7d14-4f0b-b601-0a47321048f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"
Sep 19 15:30:25.705700 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.705595    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91d03d2d-7d14-4f0b-b601-0a47321048f2-metrics-certs\") pod \"maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5\" (UID: \"91d03d2d-7d14-4f0b-b601-0a47321048f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"
Sep 19 15:30:25.705700 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.705651    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91d03d2d-7d14-4f0b-b601-0a47321048f2-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5\" (UID: \"91d03d2d-7d14-4f0b-b601-0a47321048f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"
Sep 19 15:30:25.705700 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:30:25.705671    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-serving-cert: secret "maas-api-e2e-worker-w0-15949d-serving-cert" not found
Sep 19 15:30:25.705871 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:30:25.705748    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91d03d2d-7d14-4f0b-b601-0a47321048f2-maas-api-tls podName:91d03d2d-7d14-4f0b-b601-0a47321048f2 nodeName:}" failed. No retries permitted until 2026-09-19 15:30:26.205726292 +0000 UTC m=+1101.094925997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/91d03d2d-7d14-4f0b-b601-0a47321048f2-maas-api-tls") pod "maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5" (UID: "91d03d2d-7d14-4f0b-b601-0a47321048f2") : secret "maas-api-e2e-worker-w0-15949d-serving-cert" not found
Sep 19 15:30:25.706413 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.706394    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91d03d2d-7d14-4f0b-b601-0a47321048f2-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5\" (UID: \"91d03d2d-7d14-4f0b-b601-0a47321048f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"
Sep 19 15:30:25.708114 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.708099    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91d03d2d-7d14-4f0b-b601-0a47321048f2-metrics-certs\") pod \"maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5\" (UID: \"91d03d2d-7d14-4f0b-b601-0a47321048f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"
Sep 19 15:30:25.715496 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.715471    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb2k8\" (UniqueName: \"kubernetes.io/projected/91d03d2d-7d14-4f0b-b601-0a47321048f2-kube-api-access-cb2k8\") pod \"maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5\" (UID: \"91d03d2d-7d14-4f0b-b601-0a47321048f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"
Sep 19 15:30:25.780113 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:25.780082    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd"]
Sep 19 15:30:25.781193 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:30:25.781168    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d4dcc8_4ddc_41f1_a3d2_b8cba3b825d0.slice/crio-859d21d55c71439a4cef59161ab35a1c631fb45eee8db4777915d394c06765cf WatchSource:0}: Error finding container 859d21d55c71439a4cef59161ab35a1c631fb45eee8db4777915d394c06765cf: Status 404 returned error can't find the container with id 859d21d55c71439a4cef59161ab35a1c631fb45eee8db4777915d394c06765cf
Sep 19 15:30:26.211008 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.210981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91d03d2d-7d14-4f0b-b601-0a47321048f2-maas-api-tls\") pod \"maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5\" (UID: \"91d03d2d-7d14-4f0b-b601-0a47321048f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"
Sep 19 15:30:26.213574 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.213551    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91d03d2d-7d14-4f0b-b601-0a47321048f2-maas-api-tls\") pod \"maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5\" (UID: \"91d03d2d-7d14-4f0b-b601-0a47321048f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"
Sep 19 15:30:26.456469 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.456427    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"
Sep 19 15:30:26.615979 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.615941    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk" event={"ID":"955a87c9-c90e-4034-b0ea-a52666760677","Type":"ContainerStarted","Data":"0d9a907fc4f6550fb630f27b47569cfe6c610be830fa5af8c941ceb78c4d5086"}
Sep 19 15:30:26.616414 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.616005    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk" event={"ID":"955a87c9-c90e-4034-b0ea-a52666760677","Type":"ContainerStarted","Data":"08418e5c4e8e57075717fbcfb38811d6133536d02cfb3d64b76794264ab700c0"}
Sep 19 15:30:26.616414 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.616033    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"
Sep 19 15:30:26.617835 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.617802    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd" event={"ID":"96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0","Type":"ContainerStarted","Data":"3ca011158c4fc2e6ed8d0b95b973f99d811dcdb6eae153e5dd4b4ed385dd2c3f"}
Sep 19 15:30:26.617977 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.617856    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd" event={"ID":"96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0","Type":"ContainerStarted","Data":"859d21d55c71439a4cef59161ab35a1c631fb45eee8db4777915d394c06765cf"}
Sep 19 15:30:26.617977 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.617920    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd"
Sep 19 15:30:26.636130 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.636081    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk" podStartSLOduration=2.183179273 podStartE2EDuration="2.636061749s" totalImagesPullingTime="452.882476ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:30:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:30:26.63397947 +0000 UTC m=+1101.523179182" watchObservedRunningTime="2026-09-19 15:30:26.636061749 +0000 UTC m=+1101.525261462"
Sep 19 15:30:26.649404 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.649372    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"]
Sep 19 15:30:26.653726 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.653683    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd" podStartSLOduration=1.653666097 podStartE2EDuration="1.653666097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:30:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:30:26.651286315 +0000 UTC m=+1101.540486035" watchObservedRunningTime="2026-09-19 15:30:26.653666097 +0000 UTC m=+1101.542865810"
Sep 19 15:30:26.655578 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.655559    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"
Sep 19 15:30:26.657606 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.657581    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-33737b-serving-cert\""
Sep 19 15:30:26.662657 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.662634    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"]
Sep 19 15:30:26.715668 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.715589    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b256d5e4-9b2a-4298-b322-648735dd34bd-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj\" (UID: \"b256d5e4-9b2a-4298-b322-648735dd34bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"
Sep 19 15:30:26.715668 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.715627    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49qqj\" (UniqueName: \"kubernetes.io/projected/b256d5e4-9b2a-4298-b322-648735dd34bd-kube-api-access-49qqj\") pod \"maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj\" (UID: \"b256d5e4-9b2a-4298-b322-648735dd34bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"
Sep 19 15:30:26.715909 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.715775    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b256d5e4-9b2a-4298-b322-648735dd34bd-maas-api-tls\") pod \"maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj\" (UID: \"b256d5e4-9b2a-4298-b322-648735dd34bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"
Sep 19 15:30:26.715909 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.715857    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b256d5e4-9b2a-4298-b322-648735dd34bd-metrics-certs\") pod \"maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj\" (UID: \"b256d5e4-9b2a-4298-b322-648735dd34bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"
Sep 19 15:30:26.736489 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.736462    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"]
Sep 19 15:30:26.738359 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:30:26.738333    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91d03d2d_7d14_4f0b_b601_0a47321048f2.slice/crio-72d80660ea5e58fb8abb576e6db641d4d92af5ea91c72c4d50700f29a629df12 WatchSource:0}: Error finding container 72d80660ea5e58fb8abb576e6db641d4d92af5ea91c72c4d50700f29a629df12: Status 404 returned error can't find the container with id 72d80660ea5e58fb8abb576e6db641d4d92af5ea91c72c4d50700f29a629df12
Sep 19 15:30:26.816392 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.816356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b256d5e4-9b2a-4298-b322-648735dd34bd-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj\" (UID: \"b256d5e4-9b2a-4298-b322-648735dd34bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"
Sep 19 15:30:26.816392 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.816391    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49qqj\" (UniqueName: \"kubernetes.io/projected/b256d5e4-9b2a-4298-b322-648735dd34bd-kube-api-access-49qqj\") pod \"maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj\" (UID: \"b256d5e4-9b2a-4298-b322-648735dd34bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"
Sep 19 15:30:26.816609 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.816439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b256d5e4-9b2a-4298-b322-648735dd34bd-maas-api-tls\") pod \"maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj\" (UID: \"b256d5e4-9b2a-4298-b322-648735dd34bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"
Sep 19 15:30:26.816609 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.816471    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b256d5e4-9b2a-4298-b322-648735dd34bd-metrics-certs\") pod \"maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj\" (UID: \"b256d5e4-9b2a-4298-b322-648735dd34bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"
Sep 19 15:30:26.816609 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:30:26.816565    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-serving-cert: secret "maas-api-e2e-worker-w3-33737b-serving-cert" not found
Sep 19 15:30:26.816728 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:30:26.816637    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b256d5e4-9b2a-4298-b322-648735dd34bd-maas-api-tls podName:b256d5e4-9b2a-4298-b322-648735dd34bd nodeName:}" failed. No retries permitted until 2026-09-19 15:30:27.316617894 +0000 UTC m=+1102.205817603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b256d5e4-9b2a-4298-b322-648735dd34bd-maas-api-tls") pod "maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj" (UID: "b256d5e4-9b2a-4298-b322-648735dd34bd") : secret "maas-api-e2e-worker-w3-33737b-serving-cert" not found
Sep 19 15:30:26.817152 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.817131    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b256d5e4-9b2a-4298-b322-648735dd34bd-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj\" (UID: \"b256d5e4-9b2a-4298-b322-648735dd34bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"
Sep 19 15:30:26.819087 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.819063    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b256d5e4-9b2a-4298-b322-648735dd34bd-metrics-certs\") pod \"maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj\" (UID: \"b256d5e4-9b2a-4298-b322-648735dd34bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"
Sep 19 15:30:26.824359 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:26.824333    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49qqj\" (UniqueName: \"kubernetes.io/projected/b256d5e4-9b2a-4298-b322-648735dd34bd-kube-api-access-49qqj\") pod \"maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj\" (UID: \"b256d5e4-9b2a-4298-b322-648735dd34bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"
Sep 19 15:30:27.320452 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:27.320364    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b256d5e4-9b2a-4298-b322-648735dd34bd-maas-api-tls\") pod \"maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj\" (UID: \"b256d5e4-9b2a-4298-b322-648735dd34bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"
Sep 19 15:30:27.323075 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:27.323050    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b256d5e4-9b2a-4298-b322-648735dd34bd-maas-api-tls\") pod \"maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj\" (UID: \"b256d5e4-9b2a-4298-b322-648735dd34bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"
Sep 19 15:30:27.569931 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:27.569871    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"
Sep 19 15:30:27.649586 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:27.649561    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"
Sep 19 15:30:27.650024 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:27.649611    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5" event={"ID":"91d03d2d-7d14-4f0b-b601-0a47321048f2","Type":"ContainerStarted","Data":"ddfbd69435c6f6d25b9e26eb6ef451ffa871a1ce5f094932d7d0a99b0d62f1c7"}
Sep 19 15:30:27.650024 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:27.649632    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5" event={"ID":"91d03d2d-7d14-4f0b-b601-0a47321048f2","Type":"ContainerStarted","Data":"72d80660ea5e58fb8abb576e6db641d4d92af5ea91c72c4d50700f29a629df12"}
Sep 19 15:30:27.670459 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:27.670402    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5" podStartSLOduration=2.3540916 podStartE2EDuration="2.670388037s" totalImagesPullingTime="316.296437ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:30:27.668328776 +0000 UTC m=+1102.557528505" watchObservedRunningTime="2026-09-19 15:30:27.670388037 +0000 UTC m=+1102.559587750"
Sep 19 15:30:27.849033 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:27.849004    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"]
Sep 19 15:30:27.850727 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:30:27.850700    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb256d5e4_9b2a_4298_b322_648735dd34bd.slice/crio-e117c500a94487cba6e52aa69a641109bab700432ef04ce18363a97503ca8c80 WatchSource:0}: Error finding container e117c500a94487cba6e52aa69a641109bab700432ef04ce18363a97503ca8c80: Status 404 returned error can't find the container with id e117c500a94487cba6e52aa69a641109bab700432ef04ce18363a97503ca8c80
Sep 19 15:30:28.647422 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:28.647315    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj" event={"ID":"b256d5e4-9b2a-4298-b322-648735dd34bd","Type":"ContainerStarted","Data":"baa869bb11531432e89f4b0a173e058b6e4ee24224afc6ae937a92d80d34d526"}
Sep 19 15:30:28.647422 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:28.647405    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj" event={"ID":"b256d5e4-9b2a-4298-b322-648735dd34bd","Type":"ContainerStarted","Data":"e117c500a94487cba6e52aa69a641109bab700432ef04ce18363a97503ca8c80"}
Sep 19 15:30:28.647619 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:28.647434    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"
Sep 19 15:30:28.665637 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:28.665588    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj" podStartSLOduration=2.311186816 podStartE2EDuration="2.665571214s" totalImagesPullingTime="354.384398ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:30:28.663120076 +0000 UTC m=+1103.552319790" watchObservedRunningTime="2026-09-19 15:30:28.665571214 +0000 UTC m=+1103.554770927"
Sep 19 15:30:32.647581 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:32.647548    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"
Sep 19 15:30:33.653298 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:33.653274    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"
Sep 19 15:30:34.649029 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:34.648998    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"]
Sep 19 15:30:34.652738 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:34.652719    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"
Sep 19 15:30:34.654395 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:34.654363    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e86b6784-serving-cert\""
Sep 19 15:30:34.659109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:34.659086    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"
Sep 19 15:30:34.660800 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:34.660777    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"]
Sep 19 15:30:34.690203 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:34.690166    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-maas-api-tls\") pod \"maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq\" (UID: \"332a637b-b2e8-4f4c-b1d3-45f80b556f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"
Sep 19 15:30:34.690366 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:34.690345    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-openshift-service-ca\") pod \"maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq\" (UID: \"332a637b-b2e8-4f4c-b1d3-45f80b556f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"
Sep 19 15:30:34.690424 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:34.690375    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-metrics-certs\") pod \"maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq\" (UID: \"332a637b-b2e8-4f4c-b1d3-45f80b556f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"
Sep 19 15:30:34.690523 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:34.690500    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2mzq\" (UniqueName: \"kubernetes.io/projected/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-kube-api-access-f2mzq\") pod \"maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq\" (UID: \"332a637b-b2e8-4f4c-b1d3-45f80b556f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"
Sep 19 15:30:34.791209 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:34.791179    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-maas-api-tls\") pod \"maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq\" (UID: \"332a637b-b2e8-4f4c-b1d3-45f80b556f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"
Sep 19 15:30:34.791367 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:34.791253    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-openshift-service-ca\") pod \"maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq\" (UID: \"332a637b-b2e8-4f4c-b1d3-45f80b556f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"
Sep 19 15:30:34.791367 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:34.791280    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-metrics-certs\") pod \"maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq\" (UID: \"332a637b-b2e8-4f4c-b1d3-45f80b556f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"
Sep 19 15:30:34.791367 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:34.791334    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2mzq\" (UniqueName: \"kubernetes.io/projected/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-kube-api-access-f2mzq\") pod \"maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq\" (UID: \"332a637b-b2e8-4f4c-b1d3-45f80b556f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"
Sep 19 15:30:34.791886 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:34.791864    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-openshift-service-ca\") pod \"maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq\" (UID: \"332a637b-b2e8-4f4c-b1d3-45f80b556f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"
Sep 19 15:30:34.794032 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:34.794005    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-metrics-certs\") pod \"maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq\" (UID: \"332a637b-b2e8-4f4c-b1d3-45f80b556f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"
Sep 19 15:30:34.794145 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:34.794084    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-maas-api-tls\") pod \"maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq\" (UID: \"332a637b-b2e8-4f4c-b1d3-45f80b556f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"
Sep 19 15:30:34.798798 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:34.798775    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2mzq\" (UniqueName: \"kubernetes.io/projected/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-kube-api-access-f2mzq\") pod \"maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq\" (UID: \"332a637b-b2e8-4f4c-b1d3-45f80b556f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"
Sep 19 15:30:34.965885 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:34.965848    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"
Sep 19 15:30:35.241815 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:35.241784    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"]
Sep 19 15:30:35.243344 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:30:35.243308    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod332a637b_b2e8_4f4c_b1d3_45f80b556f2d.slice/crio-4232eab530d23bbec81a51d825720e63aee4b7a2349fd23029e0e30cd05f800d WatchSource:0}: Error finding container 4232eab530d23bbec81a51d825720e63aee4b7a2349fd23029e0e30cd05f800d: Status 404 returned error can't find the container with id 4232eab530d23bbec81a51d825720e63aee4b7a2349fd23029e0e30cd05f800d
Sep 19 15:30:35.699283 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:35.699252    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq" event={"ID":"332a637b-b2e8-4f4c-b1d3-45f80b556f2d","Type":"ContainerStarted","Data":"4232eab530d23bbec81a51d825720e63aee4b7a2349fd23029e0e30cd05f800d"}
Sep 19 15:30:36.706691 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:36.706660    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq" event={"ID":"332a637b-b2e8-4f4c-b1d3-45f80b556f2d","Type":"ContainerStarted","Data":"818aeb4b9fa7bcd71d67e054e3eb830db7237763f34a9220da6bab7ab9033bc3"}
Sep 19 15:30:36.707094 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:36.706848    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"
Sep 19 15:30:36.722764 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:36.722718    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq" podStartSLOduration=2.293312401 podStartE2EDuration="2.722703297s" totalImagesPullingTime="429.390896ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:30:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:30:36.720574572 +0000 UTC m=+1111.609774313" watchObservedRunningTime="2026-09-19 15:30:36.722703297 +0000 UTC m=+1111.611903009"
Sep 19 15:30:37.644616 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:37.644585    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd"
Sep 19 15:30:42.718330 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:42.718298    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"
Sep 19 15:30:42.848140 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:42.848108    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"]
Sep 19 15:30:42.852255 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:42.852233    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"
Sep 19 15:30:42.854141 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:42.854117    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-e93f57-serving-cert\""
Sep 19 15:30:42.862737 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:42.862709    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"]
Sep 19 15:30:42.969002 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:42.968882    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-maas-api-tls\") pod \"maas-api-e2e-inf-b-e93f57-7b799b565-h5mql\" (UID: \"ab8c2c57-ce62-4335-b53a-ad3f73fbee51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"
Sep 19 15:30:42.969002 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:42.968954    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e93f57-7b799b565-h5mql\" (UID: \"ab8c2c57-ce62-4335-b53a-ad3f73fbee51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"
Sep 19 15:30:42.969002 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:42.968992    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnqfg\" (UniqueName: \"kubernetes.io/projected/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-kube-api-access-jnqfg\") pod \"maas-api-e2e-inf-b-e93f57-7b799b565-h5mql\" (UID: \"ab8c2c57-ce62-4335-b53a-ad3f73fbee51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"
Sep 19 15:30:42.969223 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:42.969071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-metrics-certs\") pod \"maas-api-e2e-inf-b-e93f57-7b799b565-h5mql\" (UID: \"ab8c2c57-ce62-4335-b53a-ad3f73fbee51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"
Sep 19 15:30:43.070201 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:43.070165    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-maas-api-tls\") pod \"maas-api-e2e-inf-b-e93f57-7b799b565-h5mql\" (UID: \"ab8c2c57-ce62-4335-b53a-ad3f73fbee51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"
Sep 19 15:30:43.070201 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:43.070201    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e93f57-7b799b565-h5mql\" (UID: \"ab8c2c57-ce62-4335-b53a-ad3f73fbee51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"
Sep 19 15:30:43.070408 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:43.070286    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnqfg\" (UniqueName: \"kubernetes.io/projected/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-kube-api-access-jnqfg\") pod \"maas-api-e2e-inf-b-e93f57-7b799b565-h5mql\" (UID: \"ab8c2c57-ce62-4335-b53a-ad3f73fbee51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"
Sep 19 15:30:43.070408 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:43.070368    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-metrics-certs\") pod \"maas-api-e2e-inf-b-e93f57-7b799b565-h5mql\" (UID: \"ab8c2c57-ce62-4335-b53a-ad3f73fbee51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"
Sep 19 15:30:43.070984 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:43.070960    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e93f57-7b799b565-h5mql\" (UID: \"ab8c2c57-ce62-4335-b53a-ad3f73fbee51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"
Sep 19 15:30:43.073046 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:43.073024    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-maas-api-tls\") pod \"maas-api-e2e-inf-b-e93f57-7b799b565-h5mql\" (UID: \"ab8c2c57-ce62-4335-b53a-ad3f73fbee51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"
Sep 19 15:30:43.073142 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:43.073026    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-metrics-certs\") pod \"maas-api-e2e-inf-b-e93f57-7b799b565-h5mql\" (UID: \"ab8c2c57-ce62-4335-b53a-ad3f73fbee51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"
Sep 19 15:30:43.077264 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:43.077240    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnqfg\" (UniqueName: \"kubernetes.io/projected/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-kube-api-access-jnqfg\") pod \"maas-api-e2e-inf-b-e93f57-7b799b565-h5mql\" (UID: \"ab8c2c57-ce62-4335-b53a-ad3f73fbee51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"
Sep 19 15:30:43.165345 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:43.165311    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"
Sep 19 15:30:43.442848 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:43.442820    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"]
Sep 19 15:30:43.444537 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:30:43.444512    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab8c2c57_ce62_4335_b53a_ad3f73fbee51.slice/crio-6ba0e175c661768a1c04a4aac103ad01cd2b06416c52e6b55beeefabc8552024 WatchSource:0}: Error finding container 6ba0e175c661768a1c04a4aac103ad01cd2b06416c52e6b55beeefabc8552024: Status 404 returned error can't find the container with id 6ba0e175c661768a1c04a4aac103ad01cd2b06416c52e6b55beeefabc8552024
Sep 19 15:30:43.751101 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:43.751061    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql" event={"ID":"ab8c2c57-ce62-4335-b53a-ad3f73fbee51","Type":"ContainerStarted","Data":"6ba0e175c661768a1c04a4aac103ad01cd2b06416c52e6b55beeefabc8552024"}
Sep 19 15:30:44.758441 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:44.758404    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql" event={"ID":"ab8c2c57-ce62-4335-b53a-ad3f73fbee51","Type":"ContainerStarted","Data":"50f9be21f3eeff52e24e8b15a9dbbb4f98023366caebc2887ea9a78999540020"}
Sep 19 15:30:44.758855 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:44.758604    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"
Sep 19 15:30:44.773722 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:44.773670    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql" podStartSLOduration=2.491533181 podStartE2EDuration="2.773654017s" totalImagesPullingTime="282.120836ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:30:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:30:44.772274133 +0000 UTC m=+1119.661473848" watchObservedRunningTime="2026-09-19 15:30:44.773654017 +0000 UTC m=+1119.662853729"
Sep 19 15:30:50.770082 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:30:50.770026    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"
Sep 19 15:31:13.533505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.533465    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"]
Sep 19 15:31:13.534095 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.533785    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq" podUID="332a637b-b2e8-4f4c-b1d3-45f80b556f2d" containerName="maas-api" containerID="cri-o://818aeb4b9fa7bcd71d67e054e3eb830db7237763f34a9220da6bab7ab9033bc3" gracePeriod=30
Sep 19 15:31:13.786672 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.786612    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"
Sep 19 15:31:13.859220 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.859188    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-openshift-service-ca\") pod \"332a637b-b2e8-4f4c-b1d3-45f80b556f2d\" (UID: \"332a637b-b2e8-4f4c-b1d3-45f80b556f2d\") "
Sep 19 15:31:13.859435 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.859291    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-maas-api-tls\") pod \"332a637b-b2e8-4f4c-b1d3-45f80b556f2d\" (UID: \"332a637b-b2e8-4f4c-b1d3-45f80b556f2d\") "
Sep 19 15:31:13.859435 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.859342    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-metrics-certs\") pod \"332a637b-b2e8-4f4c-b1d3-45f80b556f2d\" (UID: \"332a637b-b2e8-4f4c-b1d3-45f80b556f2d\") "
Sep 19 15:31:13.859578 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.859442    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2mzq\" (UniqueName: \"kubernetes.io/projected/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-kube-api-access-f2mzq\") pod \"332a637b-b2e8-4f4c-b1d3-45f80b556f2d\" (UID: \"332a637b-b2e8-4f4c-b1d3-45f80b556f2d\") "
Sep 19 15:31:13.859934 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.859621    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "332a637b-b2e8-4f4c-b1d3-45f80b556f2d" (UID: "332a637b-b2e8-4f4c-b1d3-45f80b556f2d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:31:13.859934 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.859712    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-openshift-service-ca\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:31:13.862741 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.862715    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-kube-api-access-f2mzq" (OuterVolumeSpecName: "kube-api-access-f2mzq") pod "332a637b-b2e8-4f4c-b1d3-45f80b556f2d" (UID: "332a637b-b2e8-4f4c-b1d3-45f80b556f2d"). InnerVolumeSpecName "kube-api-access-f2mzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:31:13.864142 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.864116    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "332a637b-b2e8-4f4c-b1d3-45f80b556f2d" (UID: "332a637b-b2e8-4f4c-b1d3-45f80b556f2d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:31:13.864464 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.864439    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "332a637b-b2e8-4f4c-b1d3-45f80b556f2d" (UID: "332a637b-b2e8-4f4c-b1d3-45f80b556f2d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:31:13.947530 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.942955    2563 generic.go:356] "Generic (PLEG): container finished" podID="332a637b-b2e8-4f4c-b1d3-45f80b556f2d" containerID="818aeb4b9fa7bcd71d67e054e3eb830db7237763f34a9220da6bab7ab9033bc3" exitCode=0
Sep 19 15:31:13.947530 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.943277    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq" event={"ID":"332a637b-b2e8-4f4c-b1d3-45f80b556f2d","Type":"ContainerDied","Data":"818aeb4b9fa7bcd71d67e054e3eb830db7237763f34a9220da6bab7ab9033bc3"}
Sep 19 15:31:13.947530 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.943336    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq" event={"ID":"332a637b-b2e8-4f4c-b1d3-45f80b556f2d","Type":"ContainerDied","Data":"4232eab530d23bbec81a51d825720e63aee4b7a2349fd23029e0e30cd05f800d"}
Sep 19 15:31:13.947530 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.943370    2563 scope.go:117] "RemoveContainer" containerID="818aeb4b9fa7bcd71d67e054e3eb830db7237763f34a9220da6bab7ab9033bc3"
Sep 19 15:31:13.947530 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.943571    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"
Sep 19 15:31:13.957599 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.957575    2563 scope.go:117] "RemoveContainer" containerID="818aeb4b9fa7bcd71d67e054e3eb830db7237763f34a9220da6bab7ab9033bc3"
Sep 19 15:31:13.957979 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:31:13.957947    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"818aeb4b9fa7bcd71d67e054e3eb830db7237763f34a9220da6bab7ab9033bc3\": container with ID starting with 818aeb4b9fa7bcd71d67e054e3eb830db7237763f34a9220da6bab7ab9033bc3 not found: ID does not exist" containerID="818aeb4b9fa7bcd71d67e054e3eb830db7237763f34a9220da6bab7ab9033bc3"
Sep 19 15:31:13.958111 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.958023    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"818aeb4b9fa7bcd71d67e054e3eb830db7237763f34a9220da6bab7ab9033bc3"} err="failed to get container status \"818aeb4b9fa7bcd71d67e054e3eb830db7237763f34a9220da6bab7ab9033bc3\": rpc error: code = NotFound desc = could not find container \"818aeb4b9fa7bcd71d67e054e3eb830db7237763f34a9220da6bab7ab9033bc3\": container with ID starting with 818aeb4b9fa7bcd71d67e054e3eb830db7237763f34a9220da6bab7ab9033bc3 not found: ID does not exist"
Sep 19 15:31:13.960642 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.960619    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2mzq\" (UniqueName: \"kubernetes.io/projected/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-kube-api-access-f2mzq\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:31:13.960642 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.960642    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-maas-api-tls\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:31:13.960783 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.960650    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/332a637b-b2e8-4f4c-b1d3-45f80b556f2d-metrics-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:31:13.967730 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.967706    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"]
Sep 19 15:31:13.972431 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:13.972403    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e86b6784-846f4bf6cb-g94qq"]
Sep 19 15:31:15.642282 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:15.642251    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="332a637b-b2e8-4f4c-b1d3-45f80b556f2d" path="/var/lib/kubelet/pods/332a637b-b2e8-4f4c-b1d3-45f80b556f2d/volumes"
Sep 19 15:31:17.958767 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:17.958732    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"]
Sep 19 15:31:17.959250 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:17.959194    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="332a637b-b2e8-4f4c-b1d3-45f80b556f2d" containerName="maas-api"
Sep 19 15:31:17.959250 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:17.959206    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="332a637b-b2e8-4f4c-b1d3-45f80b556f2d" containerName="maas-api"
Sep 19 15:31:17.959379 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:17.959290    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="332a637b-b2e8-4f4c-b1d3-45f80b556f2d" containerName="maas-api"
Sep 19 15:31:17.963773 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:17.963745    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"
Sep 19 15:31:17.965875 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:17.965852    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-a95f496f-serving-cert\""
Sep 19 15:31:17.973022 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:17.972998    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"]
Sep 19 15:31:17.999949 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:17.999919    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e11de20d-b148-4d58-be7b-afeed5d3ae31-openshift-service-ca\") pod \"maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth\" (UID: \"e11de20d-b148-4d58-be7b-afeed5d3ae31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"
Sep 19 15:31:18.000072 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:17.999967    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e11de20d-b148-4d58-be7b-afeed5d3ae31-metrics-certs\") pod \"maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth\" (UID: \"e11de20d-b148-4d58-be7b-afeed5d3ae31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"
Sep 19 15:31:18.000115 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:18.000066    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwdbg\" (UniqueName: \"kubernetes.io/projected/e11de20d-b148-4d58-be7b-afeed5d3ae31-kube-api-access-nwdbg\") pod \"maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth\" (UID: \"e11de20d-b148-4d58-be7b-afeed5d3ae31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"
Sep 19 15:31:18.000151 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:18.000129    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e11de20d-b148-4d58-be7b-afeed5d3ae31-maas-api-tls\") pod \"maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth\" (UID: \"e11de20d-b148-4d58-be7b-afeed5d3ae31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"
Sep 19 15:31:18.100969 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:18.100930    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e11de20d-b148-4d58-be7b-afeed5d3ae31-maas-api-tls\") pod \"maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth\" (UID: \"e11de20d-b148-4d58-be7b-afeed5d3ae31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"
Sep 19 15:31:18.101155 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:18.100981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e11de20d-b148-4d58-be7b-afeed5d3ae31-openshift-service-ca\") pod \"maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth\" (UID: \"e11de20d-b148-4d58-be7b-afeed5d3ae31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"
Sep 19 15:31:18.101155 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:18.101014    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e11de20d-b148-4d58-be7b-afeed5d3ae31-metrics-certs\") pod \"maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth\" (UID: \"e11de20d-b148-4d58-be7b-afeed5d3ae31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"
Sep 19 15:31:18.101155 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:31:18.101055    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-serving-cert: secret "maas-api-e2e-migrate-a95f496f-serving-cert" not found
Sep 19 15:31:18.101155 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:18.101070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwdbg\" (UniqueName: \"kubernetes.io/projected/e11de20d-b148-4d58-be7b-afeed5d3ae31-kube-api-access-nwdbg\") pod \"maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth\" (UID: \"e11de20d-b148-4d58-be7b-afeed5d3ae31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"
Sep 19 15:31:18.101155 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:31:18.101127    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e11de20d-b148-4d58-be7b-afeed5d3ae31-maas-api-tls podName:e11de20d-b148-4d58-be7b-afeed5d3ae31 nodeName:}" failed. No retries permitted until 2026-09-19 15:31:18.6011065 +0000 UTC m=+1153.490306216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e11de20d-b148-4d58-be7b-afeed5d3ae31-maas-api-tls") pod "maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth" (UID: "e11de20d-b148-4d58-be7b-afeed5d3ae31") : secret "maas-api-e2e-migrate-a95f496f-serving-cert" not found
Sep 19 15:31:18.101826 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:18.101805    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e11de20d-b148-4d58-be7b-afeed5d3ae31-openshift-service-ca\") pod \"maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth\" (UID: \"e11de20d-b148-4d58-be7b-afeed5d3ae31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"
Sep 19 15:31:18.103727 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:18.103708    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e11de20d-b148-4d58-be7b-afeed5d3ae31-metrics-certs\") pod \"maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth\" (UID: \"e11de20d-b148-4d58-be7b-afeed5d3ae31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"
Sep 19 15:31:18.108815 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:18.108792    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwdbg\" (UniqueName: \"kubernetes.io/projected/e11de20d-b148-4d58-be7b-afeed5d3ae31-kube-api-access-nwdbg\") pod \"maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth\" (UID: \"e11de20d-b148-4d58-be7b-afeed5d3ae31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"
Sep 19 15:31:18.605636 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:18.605589    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e11de20d-b148-4d58-be7b-afeed5d3ae31-maas-api-tls\") pod \"maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth\" (UID: \"e11de20d-b148-4d58-be7b-afeed5d3ae31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"
Sep 19 15:31:18.608214 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:18.608191    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e11de20d-b148-4d58-be7b-afeed5d3ae31-maas-api-tls\") pod \"maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth\" (UID: \"e11de20d-b148-4d58-be7b-afeed5d3ae31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"
Sep 19 15:31:18.878417 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:18.878326    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"
Sep 19 15:31:19.150257 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:19.150225    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"]
Sep 19 15:31:19.151933 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:31:19.151879    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode11de20d_b148_4d58_be7b_afeed5d3ae31.slice/crio-a3a3661d4aa6078930810bece8c079f74078844526085573984e4b40b6ee7fa4 WatchSource:0}: Error finding container a3a3661d4aa6078930810bece8c079f74078844526085573984e4b40b6ee7fa4: Status 404 returned error can't find the container with id a3a3661d4aa6078930810bece8c079f74078844526085573984e4b40b6ee7fa4
Sep 19 15:31:19.984598 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:19.984563    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth" event={"ID":"e11de20d-b148-4d58-be7b-afeed5d3ae31","Type":"ContainerStarted","Data":"c30fa2d9df32a3bfe8ac919d36934b42bc3927052d4be87b2314bfd11b9b520c"}
Sep 19 15:31:19.984791 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:19.984642    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth" event={"ID":"e11de20d-b148-4d58-be7b-afeed5d3ae31","Type":"ContainerStarted","Data":"a3a3661d4aa6078930810bece8c079f74078844526085573984e4b40b6ee7fa4"}
Sep 19 15:31:19.984791 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:19.984780    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"
Sep 19 15:31:19.999853 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:19.999801    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth" podStartSLOduration=2.666538457 podStartE2EDuration="2.999785141s" totalImagesPullingTime="333.246684ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:31:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:31:19.998228523 +0000 UTC m=+1154.887428247" watchObservedRunningTime="2026-09-19 15:31:19.999785141 +0000 UTC m=+1154.888984854"
Sep 19 15:31:25.995876 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:25.995847    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"
Sep 19 15:31:58.720346 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:58.720306    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"]
Sep 19 15:31:58.720978 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:58.720552    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth" podUID="e11de20d-b148-4d58-be7b-afeed5d3ae31" containerName="maas-api" containerID="cri-o://c30fa2d9df32a3bfe8ac919d36934b42bc3927052d4be87b2314bfd11b9b520c" gracePeriod=30
Sep 19 15:31:58.979195 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:58.979125    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"
Sep 19 15:31:59.074627 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.074530    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e11de20d-b148-4d58-be7b-afeed5d3ae31-maas-api-tls\") pod \"e11de20d-b148-4d58-be7b-afeed5d3ae31\" (UID: \"e11de20d-b148-4d58-be7b-afeed5d3ae31\") "
Sep 19 15:31:59.074769 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.074672    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwdbg\" (UniqueName: \"kubernetes.io/projected/e11de20d-b148-4d58-be7b-afeed5d3ae31-kube-api-access-nwdbg\") pod \"e11de20d-b148-4d58-be7b-afeed5d3ae31\" (UID: \"e11de20d-b148-4d58-be7b-afeed5d3ae31\") "
Sep 19 15:31:59.074821 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.074770    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e11de20d-b148-4d58-be7b-afeed5d3ae31-openshift-service-ca\") pod \"e11de20d-b148-4d58-be7b-afeed5d3ae31\" (UID: \"e11de20d-b148-4d58-be7b-afeed5d3ae31\") "
Sep 19 15:31:59.074821 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.074802    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e11de20d-b148-4d58-be7b-afeed5d3ae31-metrics-certs\") pod \"e11de20d-b148-4d58-be7b-afeed5d3ae31\" (UID: \"e11de20d-b148-4d58-be7b-afeed5d3ae31\") "
Sep 19 15:31:59.075120 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.075090    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e11de20d-b148-4d58-be7b-afeed5d3ae31-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e11de20d-b148-4d58-be7b-afeed5d3ae31" (UID: "e11de20d-b148-4d58-be7b-afeed5d3ae31"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:31:59.076949 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.076920    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e11de20d-b148-4d58-be7b-afeed5d3ae31-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e11de20d-b148-4d58-be7b-afeed5d3ae31" (UID: "e11de20d-b148-4d58-be7b-afeed5d3ae31"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:31:59.077408 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.077381    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e11de20d-b148-4d58-be7b-afeed5d3ae31-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e11de20d-b148-4d58-be7b-afeed5d3ae31" (UID: "e11de20d-b148-4d58-be7b-afeed5d3ae31"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:31:59.077991 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.077963    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e11de20d-b148-4d58-be7b-afeed5d3ae31-kube-api-access-nwdbg" (OuterVolumeSpecName: "kube-api-access-nwdbg") pod "e11de20d-b148-4d58-be7b-afeed5d3ae31" (UID: "e11de20d-b148-4d58-be7b-afeed5d3ae31"). InnerVolumeSpecName "kube-api-access-nwdbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:31:59.176572 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.176538    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e11de20d-b148-4d58-be7b-afeed5d3ae31-maas-api-tls\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:31:59.176572 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.176570    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwdbg\" (UniqueName: \"kubernetes.io/projected/e11de20d-b148-4d58-be7b-afeed5d3ae31-kube-api-access-nwdbg\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:31:59.176572 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.176583    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e11de20d-b148-4d58-be7b-afeed5d3ae31-openshift-service-ca\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:31:59.176812 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.176591    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e11de20d-b148-4d58-be7b-afeed5d3ae31-metrics-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:31:59.209784 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.209754    2563 generic.go:356] "Generic (PLEG): container finished" podID="e11de20d-b148-4d58-be7b-afeed5d3ae31" containerID="c30fa2d9df32a3bfe8ac919d36934b42bc3927052d4be87b2314bfd11b9b520c" exitCode=0
Sep 19 15:31:59.210016 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.209799    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"
Sep 19 15:31:59.210016 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.209842    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth" event={"ID":"e11de20d-b148-4d58-be7b-afeed5d3ae31","Type":"ContainerDied","Data":"c30fa2d9df32a3bfe8ac919d36934b42bc3927052d4be87b2314bfd11b9b520c"}
Sep 19 15:31:59.210016 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.209982    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth" event={"ID":"e11de20d-b148-4d58-be7b-afeed5d3ae31","Type":"ContainerDied","Data":"a3a3661d4aa6078930810bece8c079f74078844526085573984e4b40b6ee7fa4"}
Sep 19 15:31:59.210205 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.210019    2563 scope.go:117] "RemoveContainer" containerID="c30fa2d9df32a3bfe8ac919d36934b42bc3927052d4be87b2314bfd11b9b520c"
Sep 19 15:31:59.219974 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.219955    2563 scope.go:117] "RemoveContainer" containerID="c30fa2d9df32a3bfe8ac919d36934b42bc3927052d4be87b2314bfd11b9b520c"
Sep 19 15:31:59.220253 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:31:59.220230    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c30fa2d9df32a3bfe8ac919d36934b42bc3927052d4be87b2314bfd11b9b520c\": container with ID starting with c30fa2d9df32a3bfe8ac919d36934b42bc3927052d4be87b2314bfd11b9b520c not found: ID does not exist" containerID="c30fa2d9df32a3bfe8ac919d36934b42bc3927052d4be87b2314bfd11b9b520c"
Sep 19 15:31:59.220309 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.220263    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c30fa2d9df32a3bfe8ac919d36934b42bc3927052d4be87b2314bfd11b9b520c"} err="failed to get container status \"c30fa2d9df32a3bfe8ac919d36934b42bc3927052d4be87b2314bfd11b9b520c\": rpc error: code = NotFound desc = could not find container \"c30fa2d9df32a3bfe8ac919d36934b42bc3927052d4be87b2314bfd11b9b520c\": container with ID starting with c30fa2d9df32a3bfe8ac919d36934b42bc3927052d4be87b2314bfd11b9b520c not found: ID does not exist"
Sep 19 15:31:59.230034 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.229979    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"]
Sep 19 15:31:59.233193 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.233169    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a95f496f-5ddf69c749-w5pth"]
Sep 19 15:31:59.642526 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.642449    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e11de20d-b148-4d58-be7b-afeed5d3ae31" path="/var/lib/kubelet/pods/e11de20d-b148-4d58-be7b-afeed5d3ae31/volumes"
Sep 19 15:31:59.759861 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.759826    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"]
Sep 19 15:31:59.760531 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.760508    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e11de20d-b148-4d58-be7b-afeed5d3ae31" containerName="maas-api"
Sep 19 15:31:59.760531 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.760531    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e11de20d-b148-4d58-be7b-afeed5d3ae31" containerName="maas-api"
Sep 19 15:31:59.760725 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.760657    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e11de20d-b148-4d58-be7b-afeed5d3ae31" containerName="maas-api"
Sep 19 15:31:59.765191 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.765172    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.767197 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.767177    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-63d8f735-openshift-default-dockercfg-2wrk9\""
Sep 19 15:31:59.774857 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.774827    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"]
Sep 19 15:31:59.782206 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.782179    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-credential-socket\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.782337 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.782229    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/128a50a2-b867-486f-8e80-6d00879d3160-istio-podinfo\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.782412 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.782334    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v89p5\" (UniqueName: \"kubernetes.io/projected/128a50a2-b867-486f-8e80-6d00879d3160-kube-api-access-v89p5\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.782412 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.782374    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-istio-data\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.782516 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.782418    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-workload-certs\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.782516 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.782469    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-workload-socket\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.782599 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.782514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/128a50a2-b867-486f-8e80-6d00879d3160-istio-token\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.782599 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.782538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/128a50a2-b867-486f-8e80-6d00879d3160-istiod-ca-cert\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.782599 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.782588    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-istio-envoy\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.883416 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.883380    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v89p5\" (UniqueName: \"kubernetes.io/projected/128a50a2-b867-486f-8e80-6d00879d3160-kube-api-access-v89p5\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.883619 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.883432    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-istio-data\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.883619 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.883458    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-workload-certs\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.883619 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.883493    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-workload-socket\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.883619 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.883515    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/128a50a2-b867-486f-8e80-6d00879d3160-istio-token\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.883619 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.883532    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/128a50a2-b867-486f-8e80-6d00879d3160-istiod-ca-cert\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.883619 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.883557    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-istio-envoy\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.883619 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.883598    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-credential-socket\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.883619 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.883620    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/128a50a2-b867-486f-8e80-6d00879d3160-istio-podinfo\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.884185 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.884163    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-workload-socket\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.884282 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.884259    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-credential-socket\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.884364 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.884345    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-workload-certs\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.884530 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.884509    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-istio-data\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.884888 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.884865    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/128a50a2-b867-486f-8e80-6d00879d3160-istiod-ca-cert\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.886263 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.886243    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-istio-envoy\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.886520 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.886498    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/128a50a2-b867-486f-8e80-6d00879d3160-istio-podinfo\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.891594 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.891573    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/128a50a2-b867-486f-8e80-6d00879d3160-istio-token\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:31:59.891694 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:31:59.891656    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v89p5\" (UniqueName: \"kubernetes.io/projected/128a50a2-b867-486f-8e80-6d00879d3160-kube-api-access-v89p5\") pod \"e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") " pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:32:00.079103 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:00.079067    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:32:00.359374 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:00.359335    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"]
Sep 19 15:32:00.360739 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:32:00.360713    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod128a50a2_b867_486f_8e80_6d00879d3160.slice/crio-bd7dcebfd6911b2ab8f2f267a84dd7de3993f45df689713b1010748462b54fa0 WatchSource:0}: Error finding container bd7dcebfd6911b2ab8f2f267a84dd7de3993f45df689713b1010748462b54fa0: Status 404 returned error can't find the container with id bd7dcebfd6911b2ab8f2f267a84dd7de3993f45df689713b1010748462b54fa0
Sep 19 15:32:01.223341 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:01.223307    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8" event={"ID":"128a50a2-b867-486f-8e80-6d00879d3160","Type":"ContainerStarted","Data":"bd7dcebfd6911b2ab8f2f267a84dd7de3993f45df689713b1010748462b54fa0"}
Sep 19 15:32:03.265781 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:03.265742    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:32:03.266095 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:03.265822    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:32:03.266095 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:03.265854    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:32:04.243542 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:04.243503    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8" event={"ID":"128a50a2-b867-486f-8e80-6d00879d3160","Type":"ContainerStarted","Data":"b7d18efe1a28f42594bec53cba1b0ad4ec1d1309136524a47fa8b170cd74d61a"}
Sep 19 15:32:04.263043 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:04.262989    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8" podStartSLOduration=2.360857122 podStartE2EDuration="5.262971562s" totalImagesPullingTime="2.90211444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:31:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:32:04.259971989 +0000 UTC m=+1199.149171706" watchObservedRunningTime="2026-09-19 15:32:04.262971562 +0000 UTC m=+1199.152171274"
Sep 19 15:32:05.079971 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:05.079930    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:32:05.086018 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:05.085993    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:32:05.249297 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:05.249264    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:32:05.250320 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:05.250295    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:32:05.631851 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:05.631823    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/1.log"
Sep 19 15:32:05.633300 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:05.633281    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/1.log"
Sep 19 15:32:08.244218 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:08.244167    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"]
Sep 19 15:32:08.250019 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:08.249994    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"
Sep 19 15:32:08.251800 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:08.251780    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-63d8f735-serving-cert\""
Sep 19 15:32:08.258705 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:08.258503    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"]
Sep 19 15:32:08.369279 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:08.369242    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7119d60f-2620-4496-850b-1e4cf6adc787-openshift-service-ca\") pod \"maas-api-e2e-ait-63d8f735-85884b9f58-bldm5\" (UID: \"7119d60f-2620-4496-850b-1e4cf6adc787\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"
Sep 19 15:32:08.369472 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:08.369288    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f8pn\" (UniqueName: \"kubernetes.io/projected/7119d60f-2620-4496-850b-1e4cf6adc787-kube-api-access-2f8pn\") pod \"maas-api-e2e-ait-63d8f735-85884b9f58-bldm5\" (UID: \"7119d60f-2620-4496-850b-1e4cf6adc787\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"
Sep 19 15:32:08.369472 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:08.369378    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7119d60f-2620-4496-850b-1e4cf6adc787-maas-api-tls\") pod \"maas-api-e2e-ait-63d8f735-85884b9f58-bldm5\" (UID: \"7119d60f-2620-4496-850b-1e4cf6adc787\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"
Sep 19 15:32:08.369472 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:08.369424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7119d60f-2620-4496-850b-1e4cf6adc787-metrics-certs\") pod \"maas-api-e2e-ait-63d8f735-85884b9f58-bldm5\" (UID: \"7119d60f-2620-4496-850b-1e4cf6adc787\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"
Sep 19 15:32:08.470052 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:08.470019    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f8pn\" (UniqueName: \"kubernetes.io/projected/7119d60f-2620-4496-850b-1e4cf6adc787-kube-api-access-2f8pn\") pod \"maas-api-e2e-ait-63d8f735-85884b9f58-bldm5\" (UID: \"7119d60f-2620-4496-850b-1e4cf6adc787\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"
Sep 19 15:32:08.470253 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:08.470074    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7119d60f-2620-4496-850b-1e4cf6adc787-maas-api-tls\") pod \"maas-api-e2e-ait-63d8f735-85884b9f58-bldm5\" (UID: \"7119d60f-2620-4496-850b-1e4cf6adc787\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"
Sep 19 15:32:08.470253 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:08.470098    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7119d60f-2620-4496-850b-1e4cf6adc787-metrics-certs\") pod \"maas-api-e2e-ait-63d8f735-85884b9f58-bldm5\" (UID: \"7119d60f-2620-4496-850b-1e4cf6adc787\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"
Sep 19 15:32:08.470253 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:08.470182    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7119d60f-2620-4496-850b-1e4cf6adc787-openshift-service-ca\") pod \"maas-api-e2e-ait-63d8f735-85884b9f58-bldm5\" (UID: \"7119d60f-2620-4496-850b-1e4cf6adc787\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"
Sep 19 15:32:08.470811 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:08.470781    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7119d60f-2620-4496-850b-1e4cf6adc787-openshift-service-ca\") pod \"maas-api-e2e-ait-63d8f735-85884b9f58-bldm5\" (UID: \"7119d60f-2620-4496-850b-1e4cf6adc787\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"
Sep 19 15:32:08.472742 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:08.472720    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7119d60f-2620-4496-850b-1e4cf6adc787-maas-api-tls\") pod \"maas-api-e2e-ait-63d8f735-85884b9f58-bldm5\" (UID: \"7119d60f-2620-4496-850b-1e4cf6adc787\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"
Sep 19 15:32:08.472848 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:08.472787    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7119d60f-2620-4496-850b-1e4cf6adc787-metrics-certs\") pod \"maas-api-e2e-ait-63d8f735-85884b9f58-bldm5\" (UID: \"7119d60f-2620-4496-850b-1e4cf6adc787\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"
Sep 19 15:32:08.477073 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:08.477044    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f8pn\" (UniqueName: \"kubernetes.io/projected/7119d60f-2620-4496-850b-1e4cf6adc787-kube-api-access-2f8pn\") pod \"maas-api-e2e-ait-63d8f735-85884b9f58-bldm5\" (UID: \"7119d60f-2620-4496-850b-1e4cf6adc787\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"
Sep 19 15:32:08.563133 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:08.563049    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"
Sep 19 15:32:08.841666 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:08.841637    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"]
Sep 19 15:32:08.843612 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:32:08.843585    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7119d60f_2620_4496_850b_1e4cf6adc787.slice/crio-efc6e9523bca45325e021d8e3e87316fb2c1b08ccc32cb97abe9dea4fd1bd587 WatchSource:0}: Error finding container efc6e9523bca45325e021d8e3e87316fb2c1b08ccc32cb97abe9dea4fd1bd587: Status 404 returned error can't find the container with id efc6e9523bca45325e021d8e3e87316fb2c1b08ccc32cb97abe9dea4fd1bd587
Sep 19 15:32:09.276262 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:09.276233    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5" event={"ID":"7119d60f-2620-4496-850b-1e4cf6adc787","Type":"ContainerStarted","Data":"efc6e9523bca45325e021d8e3e87316fb2c1b08ccc32cb97abe9dea4fd1bd587"}
Sep 19 15:32:10.286439 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:10.286394    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5" event={"ID":"7119d60f-2620-4496-850b-1e4cf6adc787","Type":"ContainerStarted","Data":"a7af8289c5e8ca25058c562dd629b93913840b00e05af572015763388818b92a"}
Sep 19 15:32:10.286799 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:10.286474    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"
Sep 19 15:32:10.301664 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:10.301613    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5" podStartSLOduration=1.9192143270000002 podStartE2EDuration="2.301593149s" totalImagesPullingTime="382.378822ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:32:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:32:10.300929719 +0000 UTC m=+1205.190129444" watchObservedRunningTime="2026-09-19 15:32:10.301593149 +0000 UTC m=+1205.190792862"
Sep 19 15:32:16.299035 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:16.299008    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"
Sep 19 15:32:31.414632 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:31.414593    2563 generic.go:356] "Generic (PLEG): container finished" podID="128a50a2-b867-486f-8e80-6d00879d3160" containerID="b7d18efe1a28f42594bec53cba1b0ad4ec1d1309136524a47fa8b170cd74d61a" exitCode=0
Sep 19 15:32:31.415058 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:31.414658    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8" event={"ID":"128a50a2-b867-486f-8e80-6d00879d3160","Type":"ContainerDied","Data":"b7d18efe1a28f42594bec53cba1b0ad4ec1d1309136524a47fa8b170cd74d61a"}
Sep 19 15:32:31.415102 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:31.415080    2563 scope.go:117] "RemoveContainer" containerID="b7d18efe1a28f42594bec53cba1b0ad4ec1d1309136524a47fa8b170cd74d61a"
Sep 19 15:32:31.416302 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:31.416274    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:32:31.416390 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:31.416341    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:32:31.416390 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:31.416371    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:32:32.422358 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:32.422324    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8" event={"ID":"128a50a2-b867-486f-8e80-6d00879d3160","Type":"ContainerStarted","Data":"67fc7a2b80df5460e382f9c8cc1c86b5111da4bc75acd299e756e39cda8ad943"}
Sep 19 15:32:33.080466 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:33.080427    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:32:33.086673 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:33.086640    2563 patch_prober.go:28] interesting pod/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 19 15:32:33.086960 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:33.086926    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8" podUID="128a50a2-b867-486f-8e80-6d00879d3160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 19 15:32:34.080414 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:34.080372    2563 patch_prober.go:28] interesting pod/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 19 15:32:34.080928 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:34.080462    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8" podUID="128a50a2-b867-486f-8e80-6d00879d3160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 19 15:32:35.079800 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:35.079764    2563 patch_prober.go:28] interesting pod/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 19 15:32:35.080130 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:35.080100    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8" podUID="128a50a2-b867-486f-8e80-6d00879d3160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 19 15:32:35.250229 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:35.250193    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:32:36.080202 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:36.080161    2563 patch_prober.go:28] interesting pod/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 19 15:32:36.080564 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:36.080532    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8" podUID="128a50a2-b867-486f-8e80-6d00879d3160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 19 15:32:37.080345 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:37.080307    2563 patch_prober.go:28] interesting pod/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 19 15:32:37.080973 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:37.080936    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8" podUID="128a50a2-b867-486f-8e80-6d00879d3160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 19 15:32:38.083726 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:38.083694    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:32:38.084794 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:38.084777    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:32:47.209134 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.209095    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"]
Sep 19 15:32:47.209518 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.209368    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5" podUID="7119d60f-2620-4496-850b-1e4cf6adc787" containerName="maas-api" containerID="cri-o://a7af8289c5e8ca25058c562dd629b93913840b00e05af572015763388818b92a" gracePeriod=30
Sep 19 15:32:47.478613 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.478583    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"
Sep 19 15:32:47.514822 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.514776    2563 generic.go:356] "Generic (PLEG): container finished" podID="7119d60f-2620-4496-850b-1e4cf6adc787" containerID="a7af8289c5e8ca25058c562dd629b93913840b00e05af572015763388818b92a" exitCode=0
Sep 19 15:32:47.515053 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.514839    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"
Sep 19 15:32:47.515053 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.514962    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5" event={"ID":"7119d60f-2620-4496-850b-1e4cf6adc787","Type":"ContainerDied","Data":"a7af8289c5e8ca25058c562dd629b93913840b00e05af572015763388818b92a"}
Sep 19 15:32:47.515053 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.515007    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5" event={"ID":"7119d60f-2620-4496-850b-1e4cf6adc787","Type":"ContainerDied","Data":"efc6e9523bca45325e021d8e3e87316fb2c1b08ccc32cb97abe9dea4fd1bd587"}
Sep 19 15:32:47.515053 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.515029    2563 scope.go:117] "RemoveContainer" containerID="a7af8289c5e8ca25058c562dd629b93913840b00e05af572015763388818b92a"
Sep 19 15:32:47.527218 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.527191    2563 scope.go:117] "RemoveContainer" containerID="a7af8289c5e8ca25058c562dd629b93913840b00e05af572015763388818b92a"
Sep 19 15:32:47.527551 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:32:47.527529    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7af8289c5e8ca25058c562dd629b93913840b00e05af572015763388818b92a\": container with ID starting with a7af8289c5e8ca25058c562dd629b93913840b00e05af572015763388818b92a not found: ID does not exist" containerID="a7af8289c5e8ca25058c562dd629b93913840b00e05af572015763388818b92a"
Sep 19 15:32:47.527670 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.527561    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7af8289c5e8ca25058c562dd629b93913840b00e05af572015763388818b92a"} err="failed to get container status \"a7af8289c5e8ca25058c562dd629b93913840b00e05af572015763388818b92a\": rpc error: code = NotFound desc = could not find container \"a7af8289c5e8ca25058c562dd629b93913840b00e05af572015763388818b92a\": container with ID starting with a7af8289c5e8ca25058c562dd629b93913840b00e05af572015763388818b92a not found: ID does not exist"
Sep 19 15:32:47.551965 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.551931    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7119d60f-2620-4496-850b-1e4cf6adc787-openshift-service-ca\") pod \"7119d60f-2620-4496-850b-1e4cf6adc787\" (UID: \"7119d60f-2620-4496-850b-1e4cf6adc787\") "
Sep 19 15:32:47.552138 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.552037    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7119d60f-2620-4496-850b-1e4cf6adc787-maas-api-tls\") pod \"7119d60f-2620-4496-850b-1e4cf6adc787\" (UID: \"7119d60f-2620-4496-850b-1e4cf6adc787\") "
Sep 19 15:32:47.552138 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.552093    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7119d60f-2620-4496-850b-1e4cf6adc787-metrics-certs\") pod \"7119d60f-2620-4496-850b-1e4cf6adc787\" (UID: \"7119d60f-2620-4496-850b-1e4cf6adc787\") "
Sep 19 15:32:47.552138 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.552134    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2f8pn\" (UniqueName: \"kubernetes.io/projected/7119d60f-2620-4496-850b-1e4cf6adc787-kube-api-access-2f8pn\") pod \"7119d60f-2620-4496-850b-1e4cf6adc787\" (UID: \"7119d60f-2620-4496-850b-1e4cf6adc787\") "
Sep 19 15:32:47.552365 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.552341    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7119d60f-2620-4496-850b-1e4cf6adc787-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7119d60f-2620-4496-850b-1e4cf6adc787" (UID: "7119d60f-2620-4496-850b-1e4cf6adc787"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:32:47.552521 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.552494    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7119d60f-2620-4496-850b-1e4cf6adc787-openshift-service-ca\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:32:47.554411 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.554378    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7119d60f-2620-4496-850b-1e4cf6adc787-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7119d60f-2620-4496-850b-1e4cf6adc787" (UID: "7119d60f-2620-4496-850b-1e4cf6adc787"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:32:47.554503 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.554463    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7119d60f-2620-4496-850b-1e4cf6adc787-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7119d60f-2620-4496-850b-1e4cf6adc787" (UID: "7119d60f-2620-4496-850b-1e4cf6adc787"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:32:47.554823 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.554798    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7119d60f-2620-4496-850b-1e4cf6adc787-kube-api-access-2f8pn" (OuterVolumeSpecName: "kube-api-access-2f8pn") pod "7119d60f-2620-4496-850b-1e4cf6adc787" (UID: "7119d60f-2620-4496-850b-1e4cf6adc787"). InnerVolumeSpecName "kube-api-access-2f8pn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:32:47.653294 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.653265    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7119d60f-2620-4496-850b-1e4cf6adc787-maas-api-tls\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:32:47.653294 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.653291    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7119d60f-2620-4496-850b-1e4cf6adc787-metrics-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:32:47.653294 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.653300    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2f8pn\" (UniqueName: \"kubernetes.io/projected/7119d60f-2620-4496-850b-1e4cf6adc787-kube-api-access-2f8pn\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:32:47.831502 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.831418    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"]
Sep 19 15:32:47.833837 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:47.833815    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-63d8f735-85884b9f58-bldm5"]
Sep 19 15:32:48.503744 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:48.503702    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"]
Sep 19 15:32:48.504237 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:48.503958    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8" podUID="128a50a2-b867-486f-8e80-6d00879d3160" containerName="istio-proxy" containerID="cri-o://67fc7a2b80df5460e382f9c8cc1c86b5111da4bc75acd299e756e39cda8ad943" gracePeriod=30
Sep 19 15:32:49.192515 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.192483    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"]
Sep 19 15:32:49.193010 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.192996    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7119d60f-2620-4496-850b-1e4cf6adc787" containerName="maas-api"
Sep 19 15:32:49.193068 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.193013    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7119d60f-2620-4496-850b-1e4cf6adc787" containerName="maas-api"
Sep 19 15:32:49.193117 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.193105    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7119d60f-2620-4496-850b-1e4cf6adc787" containerName="maas-api"
Sep 19 15:32:49.198100 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.198080    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.200214 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.200189    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-24d51017-openshift-default-dockercfg-5rx87\""
Sep 19 15:32:49.210127 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.210057    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"]
Sep 19 15:32:49.270561 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.270526    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-workload-socket\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.270717 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.270572    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q54v\" (UniqueName: \"kubernetes.io/projected/258119f8-09f8-4919-8179-7bdff41bc8c1-kube-api-access-6q54v\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.270717 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.270611    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-credential-socket\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.270717 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.270652    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-envoy\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.270717 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.270682    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-podinfo\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.270875 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.270729    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-workload-certs\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.270875 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.270745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/258119f8-09f8-4919-8179-7bdff41bc8c1-istiod-ca-cert\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.270875 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.270774    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-token\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.270875 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.270808    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-data\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.372402 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.372366    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q54v\" (UniqueName: \"kubernetes.io/projected/258119f8-09f8-4919-8179-7bdff41bc8c1-kube-api-access-6q54v\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.372578 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.372421    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-credential-socket\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.372642 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.372596    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-envoy\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.372696 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.372659    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-podinfo\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.372757 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.372719    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-workload-certs\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.372757 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.372744    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-credential-socket\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.372757 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.372750    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/258119f8-09f8-4919-8179-7bdff41bc8c1-istiod-ca-cert\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.372934 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.372804    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-token\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.372934 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.372856    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-data\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.373066 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.372952    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-workload-socket\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.373066 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.373049    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-workload-certs\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.373330 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.373294    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-workload-socket\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.373482 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.373463    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/258119f8-09f8-4919-8179-7bdff41bc8c1-istiod-ca-cert\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.373543 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.373494    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-data\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.375035 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.375008    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-envoy\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.375665 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.375647    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-podinfo\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.384009 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.383979    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-token\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.384149 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.384133    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q54v\" (UniqueName: \"kubernetes.io/projected/258119f8-09f8-4919-8179-7bdff41bc8c1-kube-api-access-6q54v\") pod \"e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") " pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.511435 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.511342    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:49.642287 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.642253    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7119d60f-2620-4496-850b-1e4cf6adc787" path="/var/lib/kubelet/pods/7119d60f-2620-4496-850b-1e4cf6adc787/volumes"
Sep 19 15:32:49.790055 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.790025    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"]
Sep 19 15:32:49.794969 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:32:49.794886    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod258119f8_09f8_4919_8179_7bdff41bc8c1.slice/crio-85e0af8805d65b756f90bf957deb64d10095ec3a0cc908279de7ad1aa760d809 WatchSource:0}: Error finding container 85e0af8805d65b756f90bf957deb64d10095ec3a0cc908279de7ad1aa760d809: Status 404 returned error can't find the container with id 85e0af8805d65b756f90bf957deb64d10095ec3a0cc908279de7ad1aa760d809
Sep 19 15:32:49.796817 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.796782    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:32:49.796931 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.796856    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:32:49.796931 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:49.796888    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:32:50.537661 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:50.537620    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6" event={"ID":"258119f8-09f8-4919-8179-7bdff41bc8c1","Type":"ContainerStarted","Data":"2984949c26dcd01fa7c24747e09d5d99225e1f19a44279da1ec798e44e6952c1"}
Sep 19 15:32:50.538065 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:50.537670    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6" event={"ID":"258119f8-09f8-4919-8179-7bdff41bc8c1","Type":"ContainerStarted","Data":"85e0af8805d65b756f90bf957deb64d10095ec3a0cc908279de7ad1aa760d809"}
Sep 19 15:32:50.556743 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:50.556677    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6" podStartSLOduration=1.556659454 podStartE2EDuration="1.556659454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:32:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:32:50.556344764 +0000 UTC m=+1245.445544479" watchObservedRunningTime="2026-09-19 15:32:50.556659454 +0000 UTC m=+1245.445859169"
Sep 19 15:32:51.512330 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:51.512300    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:51.517389 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:51.517362    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:51.544473 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:51.544448    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:51.545452 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:51.545434    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:32:53.085881 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.085848    2563 patch_prober.go:28] interesting pod/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 15:32:53.086301 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.085930    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8" podUID="128a50a2-b867-486f-8e80-6d00879d3160" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 15:32:53.757477 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.757452    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:32:53.818496 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.818404    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v89p5\" (UniqueName: \"kubernetes.io/projected/128a50a2-b867-486f-8e80-6d00879d3160-kube-api-access-v89p5\") pod \"128a50a2-b867-486f-8e80-6d00879d3160\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") "
Sep 19 15:32:53.818496 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.818489    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-credential-socket\") pod \"128a50a2-b867-486f-8e80-6d00879d3160\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") "
Sep 19 15:32:53.818719 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.818520    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/128a50a2-b867-486f-8e80-6d00879d3160-istio-token\") pod \"128a50a2-b867-486f-8e80-6d00879d3160\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") "
Sep 19 15:32:53.818719 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.818556    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/128a50a2-b867-486f-8e80-6d00879d3160-istio-podinfo\") pod \"128a50a2-b867-486f-8e80-6d00879d3160\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") "
Sep 19 15:32:53.818719 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.818579    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/128a50a2-b867-486f-8e80-6d00879d3160-istiod-ca-cert\") pod \"128a50a2-b867-486f-8e80-6d00879d3160\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") "
Sep 19 15:32:53.818719 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.818603    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-istio-data\") pod \"128a50a2-b867-486f-8e80-6d00879d3160\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") "
Sep 19 15:32:53.818719 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.818627    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-workload-certs\") pod \"128a50a2-b867-486f-8e80-6d00879d3160\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") "
Sep 19 15:32:53.818719 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.818668    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-workload-socket\") pod \"128a50a2-b867-486f-8e80-6d00879d3160\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") "
Sep 19 15:32:53.818719 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.818719    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-istio-envoy\") pod \"128a50a2-b867-486f-8e80-6d00879d3160\" (UID: \"128a50a2-b867-486f-8e80-6d00879d3160\") "
Sep 19 15:32:53.819107 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.818850    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "128a50a2-b867-486f-8e80-6d00879d3160" (UID: "128a50a2-b867-486f-8e80-6d00879d3160"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:32:53.819107 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.818864    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-istio-data" (OuterVolumeSpecName: "istio-data") pod "128a50a2-b867-486f-8e80-6d00879d3160" (UID: "128a50a2-b867-486f-8e80-6d00879d3160"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:32:53.819107 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.818981    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/128a50a2-b867-486f-8e80-6d00879d3160-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "128a50a2-b867-486f-8e80-6d00879d3160" (UID: "128a50a2-b867-486f-8e80-6d00879d3160"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:32:53.819107 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.819067    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "128a50a2-b867-486f-8e80-6d00879d3160" (UID: "128a50a2-b867-486f-8e80-6d00879d3160"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:32:53.819329 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.819167    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "128a50a2-b867-486f-8e80-6d00879d3160" (UID: "128a50a2-b867-486f-8e80-6d00879d3160"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:32:53.819329 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.819182    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-credential-socket\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:32:53.819329 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.819201    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/128a50a2-b867-486f-8e80-6d00879d3160-istiod-ca-cert\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:32:53.819329 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.819215    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-istio-data\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:32:53.819329 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.819230    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-workload-socket\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:32:53.820884 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.820859    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/128a50a2-b867-486f-8e80-6d00879d3160-istio-token" (OuterVolumeSpecName: "istio-token") pod "128a50a2-b867-486f-8e80-6d00879d3160" (UID: "128a50a2-b867-486f-8e80-6d00879d3160"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:32:53.821084 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.821069    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "128a50a2-b867-486f-8e80-6d00879d3160" (UID: "128a50a2-b867-486f-8e80-6d00879d3160"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:32:53.821258 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.821244    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/128a50a2-b867-486f-8e80-6d00879d3160-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "128a50a2-b867-486f-8e80-6d00879d3160" (UID: "128a50a2-b867-486f-8e80-6d00879d3160"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 15:32:53.821351 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.821279    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/128a50a2-b867-486f-8e80-6d00879d3160-kube-api-access-v89p5" (OuterVolumeSpecName: "kube-api-access-v89p5") pod "128a50a2-b867-486f-8e80-6d00879d3160" (UID: "128a50a2-b867-486f-8e80-6d00879d3160"). InnerVolumeSpecName "kube-api-access-v89p5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:32:53.920311 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.920271    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/128a50a2-b867-486f-8e80-6d00879d3160-istio-token\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:32:53.920311 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.920303    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/128a50a2-b867-486f-8e80-6d00879d3160-istio-podinfo\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:32:53.920311 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.920316    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-workload-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:32:53.920553 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.920327    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/128a50a2-b867-486f-8e80-6d00879d3160-istio-envoy\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:32:53.920553 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:53.920339    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v89p5\" (UniqueName: \"kubernetes.io/projected/128a50a2-b867-486f-8e80-6d00879d3160-kube-api-access-v89p5\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:32:54.563545 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.563512    2563 generic.go:356] "Generic (PLEG): container finished" podID="128a50a2-b867-486f-8e80-6d00879d3160" containerID="67fc7a2b80df5460e382f9c8cc1c86b5111da4bc75acd299e756e39cda8ad943" exitCode=0
Sep 19 15:32:54.563940 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.563612    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"
Sep 19 15:32:54.563940 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.563657    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8" event={"ID":"128a50a2-b867-486f-8e80-6d00879d3160","Type":"ContainerDied","Data":"67fc7a2b80df5460e382f9c8cc1c86b5111da4bc75acd299e756e39cda8ad943"}
Sep 19 15:32:54.563940 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.563713    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8" event={"ID":"128a50a2-b867-486f-8e80-6d00879d3160","Type":"ContainerDied","Data":"bd7dcebfd6911b2ab8f2f267a84dd7de3993f45df689713b1010748462b54fa0"}
Sep 19 15:32:54.563940 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.563735    2563 scope.go:117] "RemoveContainer" containerID="67fc7a2b80df5460e382f9c8cc1c86b5111da4bc75acd299e756e39cda8ad943"
Sep 19 15:32:54.581619 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.581599    2563 scope.go:117] "RemoveContainer" containerID="b7d18efe1a28f42594bec53cba1b0ad4ec1d1309136524a47fa8b170cd74d61a"
Sep 19 15:32:54.590207 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.590184    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"]
Sep 19 15:32:54.591638 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.591610    2563 scope.go:117] "RemoveContainer" containerID="67fc7a2b80df5460e382f9c8cc1c86b5111da4bc75acd299e756e39cda8ad943"
Sep 19 15:32:54.592024 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:32:54.591994    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67fc7a2b80df5460e382f9c8cc1c86b5111da4bc75acd299e756e39cda8ad943\": container with ID starting with 67fc7a2b80df5460e382f9c8cc1c86b5111da4bc75acd299e756e39cda8ad943 not found: ID does not exist" containerID="67fc7a2b80df5460e382f9c8cc1c86b5111da4bc75acd299e756e39cda8ad943"
Sep 19 15:32:54.592144 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.592035    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67fc7a2b80df5460e382f9c8cc1c86b5111da4bc75acd299e756e39cda8ad943"} err="failed to get container status \"67fc7a2b80df5460e382f9c8cc1c86b5111da4bc75acd299e756e39cda8ad943\": rpc error: code = NotFound desc = could not find container \"67fc7a2b80df5460e382f9c8cc1c86b5111da4bc75acd299e756e39cda8ad943\": container with ID starting with 67fc7a2b80df5460e382f9c8cc1c86b5111da4bc75acd299e756e39cda8ad943 not found: ID does not exist"
Sep 19 15:32:54.592144 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.592058    2563 scope.go:117] "RemoveContainer" containerID="b7d18efe1a28f42594bec53cba1b0ad4ec1d1309136524a47fa8b170cd74d61a"
Sep 19 15:32:54.592411 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:32:54.592382    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7d18efe1a28f42594bec53cba1b0ad4ec1d1309136524a47fa8b170cd74d61a\": container with ID starting with b7d18efe1a28f42594bec53cba1b0ad4ec1d1309136524a47fa8b170cd74d61a not found: ID does not exist" containerID="b7d18efe1a28f42594bec53cba1b0ad4ec1d1309136524a47fa8b170cd74d61a"
Sep 19 15:32:54.592498 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.592419    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7d18efe1a28f42594bec53cba1b0ad4ec1d1309136524a47fa8b170cd74d61a"} err="failed to get container status \"b7d18efe1a28f42594bec53cba1b0ad4ec1d1309136524a47fa8b170cd74d61a\": rpc error: code = NotFound desc = could not find container \"b7d18efe1a28f42594bec53cba1b0ad4ec1d1309136524a47fa8b170cd74d61a\": container with ID starting with b7d18efe1a28f42594bec53cba1b0ad4ec1d1309136524a47fa8b170cd74d61a not found: ID does not exist"
Sep 19 15:32:54.594291 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.594271    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8"]
Sep 19 15:32:54.849703 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.849606    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"]
Sep 19 15:32:54.850191 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.850172    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="128a50a2-b867-486f-8e80-6d00879d3160" containerName="istio-proxy"
Sep 19 15:32:54.850287 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.850192    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="128a50a2-b867-486f-8e80-6d00879d3160" containerName="istio-proxy"
Sep 19 15:32:54.850287 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.850209    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="128a50a2-b867-486f-8e80-6d00879d3160" containerName="istio-proxy"
Sep 19 15:32:54.850287 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.850217    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="128a50a2-b867-486f-8e80-6d00879d3160" containerName="istio-proxy"
Sep 19 15:32:54.850455 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.850334    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="128a50a2-b867-486f-8e80-6d00879d3160" containerName="istio-proxy"
Sep 19 15:32:54.850455 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.850350    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="128a50a2-b867-486f-8e80-6d00879d3160" containerName="istio-proxy"
Sep 19 15:32:54.855122 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.855096    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"
Sep 19 15:32:54.857145 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.857111    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-24d51017-serving-cert\""
Sep 19 15:32:54.863666 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.863636    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"]
Sep 19 15:32:54.931109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.931074    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-openshift-service-ca\") pod \"maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w\" (UID: \"fded8463-d7c4-4fa0-bb0f-030a4fcb8560\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"
Sep 19 15:32:54.931270 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.931126    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-metrics-certs\") pod \"maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w\" (UID: \"fded8463-d7c4-4fa0-bb0f-030a4fcb8560\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"
Sep 19 15:32:54.931270 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.931152    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-maas-api-tls\") pod \"maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w\" (UID: \"fded8463-d7c4-4fa0-bb0f-030a4fcb8560\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"
Sep 19 15:32:54.931270 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:54.931202    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb7vz\" (UniqueName: \"kubernetes.io/projected/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-kube-api-access-nb7vz\") pod \"maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w\" (UID: \"fded8463-d7c4-4fa0-bb0f-030a4fcb8560\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"
Sep 19 15:32:55.032572 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:55.032538    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-openshift-service-ca\") pod \"maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w\" (UID: \"fded8463-d7c4-4fa0-bb0f-030a4fcb8560\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"
Sep 19 15:32:55.032744 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:55.032585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-metrics-certs\") pod \"maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w\" (UID: \"fded8463-d7c4-4fa0-bb0f-030a4fcb8560\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"
Sep 19 15:32:55.032744 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:55.032699    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-maas-api-tls\") pod \"maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w\" (UID: \"fded8463-d7c4-4fa0-bb0f-030a4fcb8560\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"
Sep 19 15:32:55.032744 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:55.032734    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb7vz\" (UniqueName: \"kubernetes.io/projected/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-kube-api-access-nb7vz\") pod \"maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w\" (UID: \"fded8463-d7c4-4fa0-bb0f-030a4fcb8560\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"
Sep 19 15:32:55.033309 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:55.033287    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-openshift-service-ca\") pod \"maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w\" (UID: \"fded8463-d7c4-4fa0-bb0f-030a4fcb8560\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"
Sep 19 15:32:55.035305 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:55.035276    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-metrics-certs\") pod \"maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w\" (UID: \"fded8463-d7c4-4fa0-bb0f-030a4fcb8560\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"
Sep 19 15:32:55.035382 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:55.035276    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-maas-api-tls\") pod \"maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w\" (UID: \"fded8463-d7c4-4fa0-bb0f-030a4fcb8560\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"
Sep 19 15:32:55.040096 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:55.040073    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb7vz\" (UniqueName: \"kubernetes.io/projected/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-kube-api-access-nb7vz\") pod \"maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w\" (UID: \"fded8463-d7c4-4fa0-bb0f-030a4fcb8560\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"
Sep 19 15:32:55.169766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:55.169685    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"
Sep 19 15:32:55.445939 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:55.445909    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"]
Sep 19 15:32:55.446927 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:32:55.446881    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfded8463_d7c4_4fa0_bb0f_030a4fcb8560.slice/crio-5f62213db4b5066d77b3971f40041fa370979d414c89844ec2d6900317d7d0d0 WatchSource:0}: Error finding container 5f62213db4b5066d77b3971f40041fa370979d414c89844ec2d6900317d7d0d0: Status 404 returned error can't find the container with id 5f62213db4b5066d77b3971f40041fa370979d414c89844ec2d6900317d7d0d0
Sep 19 15:32:55.448948 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:55.448930    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 15:32:55.574402 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:55.574370    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w" event={"ID":"fded8463-d7c4-4fa0-bb0f-030a4fcb8560","Type":"ContainerStarted","Data":"5f62213db4b5066d77b3971f40041fa370979d414c89844ec2d6900317d7d0d0"}
Sep 19 15:32:55.642880 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:55.642843    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="128a50a2-b867-486f-8e80-6d00879d3160" path="/var/lib/kubelet/pods/128a50a2-b867-486f-8e80-6d00879d3160/volumes"
Sep 19 15:32:56.583179 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:56.583093    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w" event={"ID":"fded8463-d7c4-4fa0-bb0f-030a4fcb8560","Type":"ContainerStarted","Data":"2c067893c969e1a8723f3a5445608d368d68029757417c6cfb1837e58f125e93"}
Sep 19 15:32:56.583546 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:56.583218    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"
Sep 19 15:32:56.600024 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:32:56.599979    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w" podStartSLOduration=2.178713164 podStartE2EDuration="2.599962252s" totalImagesPullingTime="421.249088ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:32:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:32:56.598379527 +0000 UTC m=+1251.487579240" watchObservedRunningTime="2026-09-19 15:32:56.599962252 +0000 UTC m=+1251.489161966"
Sep 19 15:33:02.595270 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:02.595243    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"
Sep 19 15:33:21.546744 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:21.546703    2563 patch_prober.go:28] interesting pod/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 19 15:33:21.547172 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:21.546773    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6" podUID="258119f8-09f8-4919-8179-7bdff41bc8c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 19 15:33:21.750254 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:21.750219    2563 generic.go:356] "Generic (PLEG): container finished" podID="258119f8-09f8-4919-8179-7bdff41bc8c1" containerID="2984949c26dcd01fa7c24747e09d5d99225e1f19a44279da1ec798e44e6952c1" exitCode=0
Sep 19 15:33:21.750427 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:21.750296    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6" event={"ID":"258119f8-09f8-4919-8179-7bdff41bc8c1","Type":"ContainerDied","Data":"2984949c26dcd01fa7c24747e09d5d99225e1f19a44279da1ec798e44e6952c1"}
Sep 19 15:33:21.750719 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:21.750706    2563 scope.go:117] "RemoveContainer" containerID="2984949c26dcd01fa7c24747e09d5d99225e1f19a44279da1ec798e44e6952c1"
Sep 19 15:33:21.751857 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:21.751831    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:33:21.751939 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:21.751921    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:33:21.751980 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:21.751963    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:33:22.758491 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:22.758459    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6" event={"ID":"258119f8-09f8-4919-8179-7bdff41bc8c1","Type":"ContainerStarted","Data":"62665d6a40f3ecf387570998901779ed10a68bce6e22bc9a3b5abf77fcb3a806"}
Sep 19 15:33:23.511654 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:23.511614    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:33:23.511882 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:23.511859    2563 patch_prober.go:28] interesting pod/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 19 15:33:23.511967 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:23.511938    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6" podUID="258119f8-09f8-4919-8179-7bdff41bc8c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 19 15:33:24.512630 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:24.512594    2563 patch_prober.go:28] interesting pod/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 19 15:33:24.513067 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:24.512677    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6" podUID="258119f8-09f8-4919-8179-7bdff41bc8c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 19 15:33:25.512084 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:25.512050    2563 patch_prober.go:28] interesting pod/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 19 15:33:25.512279 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:25.512111    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6" podUID="258119f8-09f8-4919-8179-7bdff41bc8c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 19 15:33:26.511980 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:26.511950    2563 patch_prober.go:28] interesting pod/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 19 15:33:26.512382 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:26.512006    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6" podUID="258119f8-09f8-4919-8179-7bdff41bc8c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 19 15:33:27.512543 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:27.512506    2563 patch_prober.go:28] interesting pod/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 19 15:33:27.512932 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:27.512574    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6" podUID="258119f8-09f8-4919-8179-7bdff41bc8c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 19 15:33:28.516173 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:28.516139    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:33:28.516736 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:28.516715    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:33:28.517404 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:28.517382    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:33:33.597826 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:33.597792    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"]
Sep 19 15:33:33.598428 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:33.598032    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w" podUID="fded8463-d7c4-4fa0-bb0f-030a4fcb8560" containerName="maas-api" containerID="cri-o://2c067893c969e1a8723f3a5445608d368d68029757417c6cfb1837e58f125e93" gracePeriod=30
Sep 19 15:33:33.829099 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:33.829048    2563 generic.go:356] "Generic (PLEG): container finished" podID="fded8463-d7c4-4fa0-bb0f-030a4fcb8560" containerID="2c067893c969e1a8723f3a5445608d368d68029757417c6cfb1837e58f125e93" exitCode=0
Sep 19 15:33:33.829313 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:33.829141    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w" event={"ID":"fded8463-d7c4-4fa0-bb0f-030a4fcb8560","Type":"ContainerDied","Data":"2c067893c969e1a8723f3a5445608d368d68029757417c6cfb1837e58f125e93"}
Sep 19 15:33:33.883649 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:33.877727    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"
Sep 19 15:33:33.927654 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:33.927620    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"]
Sep 19 15:33:33.928230 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:33.928195    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6" podUID="258119f8-09f8-4919-8179-7bdff41bc8c1" containerName="istio-proxy" containerID="cri-o://62665d6a40f3ecf387570998901779ed10a68bce6e22bc9a3b5abf77fcb3a806" gracePeriod=30
Sep 19 15:33:34.012312 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:34.012279    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-maas-api-tls\") pod \"fded8463-d7c4-4fa0-bb0f-030a4fcb8560\" (UID: \"fded8463-d7c4-4fa0-bb0f-030a4fcb8560\") "
Sep 19 15:33:34.012519 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:34.012384    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nb7vz\" (UniqueName: \"kubernetes.io/projected/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-kube-api-access-nb7vz\") pod \"fded8463-d7c4-4fa0-bb0f-030a4fcb8560\" (UID: \"fded8463-d7c4-4fa0-bb0f-030a4fcb8560\") "
Sep 19 15:33:34.012519 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:34.012413    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-openshift-service-ca\") pod \"fded8463-d7c4-4fa0-bb0f-030a4fcb8560\" (UID: \"fded8463-d7c4-4fa0-bb0f-030a4fcb8560\") "
Sep 19 15:33:34.012519 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:34.012456    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-metrics-certs\") pod \"fded8463-d7c4-4fa0-bb0f-030a4fcb8560\" (UID: \"fded8463-d7c4-4fa0-bb0f-030a4fcb8560\") "
Sep 19 15:33:34.012874 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:34.012825    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fded8463-d7c4-4fa0-bb0f-030a4fcb8560" (UID: "fded8463-d7c4-4fa0-bb0f-030a4fcb8560"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:33:34.015149 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:34.015116    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-kube-api-access-nb7vz" (OuterVolumeSpecName: "kube-api-access-nb7vz") pod "fded8463-d7c4-4fa0-bb0f-030a4fcb8560" (UID: "fded8463-d7c4-4fa0-bb0f-030a4fcb8560"). InnerVolumeSpecName "kube-api-access-nb7vz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:33:34.015258 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:34.015124    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fded8463-d7c4-4fa0-bb0f-030a4fcb8560" (UID: "fded8463-d7c4-4fa0-bb0f-030a4fcb8560"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:33:34.015258 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:34.015171    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fded8463-d7c4-4fa0-bb0f-030a4fcb8560" (UID: "fded8463-d7c4-4fa0-bb0f-030a4fcb8560"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:33:34.114035 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:34.113945    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-metrics-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:33:34.114035 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:34.113973    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-maas-api-tls\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:33:34.114035 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:34.113983    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nb7vz\" (UniqueName: \"kubernetes.io/projected/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-kube-api-access-nb7vz\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:33:34.114035 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:34.113993    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fded8463-d7c4-4fa0-bb0f-030a4fcb8560-openshift-service-ca\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:33:34.840109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:34.840079    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"
Sep 19 15:33:34.840109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:34.840090    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w" event={"ID":"fded8463-d7c4-4fa0-bb0f-030a4fcb8560","Type":"ContainerDied","Data":"5f62213db4b5066d77b3971f40041fa370979d414c89844ec2d6900317d7d0d0"}
Sep 19 15:33:34.840572 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:34.840150    2563 scope.go:117] "RemoveContainer" containerID="2c067893c969e1a8723f3a5445608d368d68029757417c6cfb1837e58f125e93"
Sep 19 15:33:34.866003 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:34.865976    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"]
Sep 19 15:33:34.869799 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:34.869775    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-24d51017-7dfd994cfc-7qk4w"]
Sep 19 15:33:35.643167 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:35.643134    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fded8463-d7c4-4fa0-bb0f-030a4fcb8560" path="/var/lib/kubelet/pods/fded8463-d7c4-4fa0-bb0f-030a4fcb8560/volumes"
Sep 19 15:33:39.309969 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.309944    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:33:39.471719 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.471682    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/258119f8-09f8-4919-8179-7bdff41bc8c1-istiod-ca-cert\") pod \"258119f8-09f8-4919-8179-7bdff41bc8c1\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") "
Sep 19 15:33:39.471925 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.471731    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-workload-certs\") pod \"258119f8-09f8-4919-8179-7bdff41bc8c1\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") "
Sep 19 15:33:39.471925 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.471773    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-credential-socket\") pod \"258119f8-09f8-4919-8179-7bdff41bc8c1\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") "
Sep 19 15:33:39.471925 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.471796    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-token\") pod \"258119f8-09f8-4919-8179-7bdff41bc8c1\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") "
Sep 19 15:33:39.471925 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.471872    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6q54v\" (UniqueName: \"kubernetes.io/projected/258119f8-09f8-4919-8179-7bdff41bc8c1-kube-api-access-6q54v\") pod \"258119f8-09f8-4919-8179-7bdff41bc8c1\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") "
Sep 19 15:33:39.472217 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.471926    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-envoy\") pod \"258119f8-09f8-4919-8179-7bdff41bc8c1\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") "
Sep 19 15:33:39.472217 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.471973    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-workload-socket\") pod \"258119f8-09f8-4919-8179-7bdff41bc8c1\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") "
Sep 19 15:33:39.472217 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.471996    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-podinfo\") pod \"258119f8-09f8-4919-8179-7bdff41bc8c1\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") "
Sep 19 15:33:39.472217 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.472055    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-data\") pod \"258119f8-09f8-4919-8179-7bdff41bc8c1\" (UID: \"258119f8-09f8-4919-8179-7bdff41bc8c1\") "
Sep 19 15:33:39.472217 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.472116    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "258119f8-09f8-4919-8179-7bdff41bc8c1" (UID: "258119f8-09f8-4919-8179-7bdff41bc8c1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:33:39.472217 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.472147    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "258119f8-09f8-4919-8179-7bdff41bc8c1" (UID: "258119f8-09f8-4919-8179-7bdff41bc8c1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:33:39.472462 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.472181    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/258119f8-09f8-4919-8179-7bdff41bc8c1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "258119f8-09f8-4919-8179-7bdff41bc8c1" (UID: "258119f8-09f8-4919-8179-7bdff41bc8c1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:33:39.472462 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.472282    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "258119f8-09f8-4919-8179-7bdff41bc8c1" (UID: "258119f8-09f8-4919-8179-7bdff41bc8c1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:33:39.472462 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.472334    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-data" (OuterVolumeSpecName: "istio-data") pod "258119f8-09f8-4919-8179-7bdff41bc8c1" (UID: "258119f8-09f8-4919-8179-7bdff41bc8c1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:33:39.472567 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.472460    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/258119f8-09f8-4919-8179-7bdff41bc8c1-istiod-ca-cert\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:33:39.472567 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.472475    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-workload-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:33:39.472567 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.472483    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-credential-socket\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:33:39.472567 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.472492    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-workload-socket\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:33:39.472567 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.472500    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-data\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:33:39.474332 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.474308    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "258119f8-09f8-4919-8179-7bdff41bc8c1" (UID: "258119f8-09f8-4919-8179-7bdff41bc8c1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 15:33:39.474435 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.474392    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-token" (OuterVolumeSpecName: "istio-token") pod "258119f8-09f8-4919-8179-7bdff41bc8c1" (UID: "258119f8-09f8-4919-8179-7bdff41bc8c1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:33:39.474717 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.474691    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/258119f8-09f8-4919-8179-7bdff41bc8c1-kube-api-access-6q54v" (OuterVolumeSpecName: "kube-api-access-6q54v") pod "258119f8-09f8-4919-8179-7bdff41bc8c1" (UID: "258119f8-09f8-4919-8179-7bdff41bc8c1"). InnerVolumeSpecName "kube-api-access-6q54v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:33:39.474717 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.474700    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "258119f8-09f8-4919-8179-7bdff41bc8c1" (UID: "258119f8-09f8-4919-8179-7bdff41bc8c1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:33:39.573290 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.573252    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-podinfo\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:33:39.573290 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.573277    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-token\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:33:39.573290 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.573287    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6q54v\" (UniqueName: \"kubernetes.io/projected/258119f8-09f8-4919-8179-7bdff41bc8c1-kube-api-access-6q54v\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:33:39.573290 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.573298    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/258119f8-09f8-4919-8179-7bdff41bc8c1-istio-envoy\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:33:39.874353 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.874271    2563 generic.go:356] "Generic (PLEG): container finished" podID="258119f8-09f8-4919-8179-7bdff41bc8c1" containerID="62665d6a40f3ecf387570998901779ed10a68bce6e22bc9a3b5abf77fcb3a806" exitCode=0
Sep 19 15:33:39.874353 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.874319    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"
Sep 19 15:33:39.874546 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.874356    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6" event={"ID":"258119f8-09f8-4919-8179-7bdff41bc8c1","Type":"ContainerDied","Data":"62665d6a40f3ecf387570998901779ed10a68bce6e22bc9a3b5abf77fcb3a806"}
Sep 19 15:33:39.874546 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.874418    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6" event={"ID":"258119f8-09f8-4919-8179-7bdff41bc8c1","Type":"ContainerDied","Data":"85e0af8805d65b756f90bf957deb64d10095ec3a0cc908279de7ad1aa760d809"}
Sep 19 15:33:39.874546 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.874448    2563 scope.go:117] "RemoveContainer" containerID="62665d6a40f3ecf387570998901779ed10a68bce6e22bc9a3b5abf77fcb3a806"
Sep 19 15:33:39.884632 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.884605    2563 scope.go:117] "RemoveContainer" containerID="2984949c26dcd01fa7c24747e09d5d99225e1f19a44279da1ec798e44e6952c1"
Sep 19 15:33:39.892307 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.892283    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"]
Sep 19 15:33:39.894841 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.894822    2563 scope.go:117] "RemoveContainer" containerID="62665d6a40f3ecf387570998901779ed10a68bce6e22bc9a3b5abf77fcb3a806"
Sep 19 15:33:39.895216 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:33:39.895194    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62665d6a40f3ecf387570998901779ed10a68bce6e22bc9a3b5abf77fcb3a806\": container with ID starting with 62665d6a40f3ecf387570998901779ed10a68bce6e22bc9a3b5abf77fcb3a806 not found: ID does not exist" containerID="62665d6a40f3ecf387570998901779ed10a68bce6e22bc9a3b5abf77fcb3a806"
Sep 19 15:33:39.895280 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.895224    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62665d6a40f3ecf387570998901779ed10a68bce6e22bc9a3b5abf77fcb3a806"} err="failed to get container status \"62665d6a40f3ecf387570998901779ed10a68bce6e22bc9a3b5abf77fcb3a806\": rpc error: code = NotFound desc = could not find container \"62665d6a40f3ecf387570998901779ed10a68bce6e22bc9a3b5abf77fcb3a806\": container with ID starting with 62665d6a40f3ecf387570998901779ed10a68bce6e22bc9a3b5abf77fcb3a806 not found: ID does not exist"
Sep 19 15:33:39.895280 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.895240    2563 scope.go:117] "RemoveContainer" containerID="2984949c26dcd01fa7c24747e09d5d99225e1f19a44279da1ec798e44e6952c1"
Sep 19 15:33:39.895532 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:33:39.895515    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2984949c26dcd01fa7c24747e09d5d99225e1f19a44279da1ec798e44e6952c1\": container with ID starting with 2984949c26dcd01fa7c24747e09d5d99225e1f19a44279da1ec798e44e6952c1 not found: ID does not exist" containerID="2984949c26dcd01fa7c24747e09d5d99225e1f19a44279da1ec798e44e6952c1"
Sep 19 15:33:39.895590 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.895535    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2984949c26dcd01fa7c24747e09d5d99225e1f19a44279da1ec798e44e6952c1"} err="failed to get container status \"2984949c26dcd01fa7c24747e09d5d99225e1f19a44279da1ec798e44e6952c1\": rpc error: code = NotFound desc = could not find container \"2984949c26dcd01fa7c24747e09d5d99225e1f19a44279da1ec798e44e6952c1\": container with ID starting with 2984949c26dcd01fa7c24747e09d5d99225e1f19a44279da1ec798e44e6952c1 not found: ID does not exist"
Sep 19 15:33:39.897347 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:39.897330    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6"]
Sep 19 15:33:41.640823 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:33:41.640788    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="258119f8-09f8-4919-8179-7bdff41bc8c1" path="/var/lib/kubelet/pods/258119f8-09f8-4919-8179-7bdff41bc8c1/volumes"
Sep 19 15:35:07.400322 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.400284    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"]
Sep 19 15:35:07.401036 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.401019    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fded8463-d7c4-4fa0-bb0f-030a4fcb8560" containerName="maas-api"
Sep 19 15:35:07.401095 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.401039    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fded8463-d7c4-4fa0-bb0f-030a4fcb8560" containerName="maas-api"
Sep 19 15:35:07.401095 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.401054    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="258119f8-09f8-4919-8179-7bdff41bc8c1" containerName="istio-proxy"
Sep 19 15:35:07.401095 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.401063    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="258119f8-09f8-4919-8179-7bdff41bc8c1" containerName="istio-proxy"
Sep 19 15:35:07.401095 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.401072    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="258119f8-09f8-4919-8179-7bdff41bc8c1" containerName="istio-proxy"
Sep 19 15:35:07.401095 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.401081    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="258119f8-09f8-4919-8179-7bdff41bc8c1" containerName="istio-proxy"
Sep 19 15:35:07.401249 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.401178    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="258119f8-09f8-4919-8179-7bdff41bc8c1" containerName="istio-proxy"
Sep 19 15:35:07.401249 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.401193    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="258119f8-09f8-4919-8179-7bdff41bc8c1" containerName="istio-proxy"
Sep 19 15:35:07.401249 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.401203    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fded8463-d7c4-4fa0-bb0f-030a4fcb8560" containerName="maas-api"
Sep 19 15:35:07.404828 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.404793    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.406887 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.406861    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a5942927-openshift-default-dockercfg-kl7jp\""
Sep 19 15:35:07.415318 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.415278    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"]
Sep 19 15:35:07.483345 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.483314    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-envoy\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.483547 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.483355    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-data\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.483547 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.483393    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-workload-certs\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.483547 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.483474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-token\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.483547 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.483519    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-podinfo\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.483761 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.483569    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-workload-socket\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.483761 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.483742    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdftp\" (UniqueName: \"kubernetes.io/projected/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-kube-api-access-qdftp\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.483856 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.483774    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istiod-ca-cert\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.483931 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.483860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-credential-socket\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.584437 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.584400    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdftp\" (UniqueName: \"kubernetes.io/projected/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-kube-api-access-qdftp\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.584437 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.584438    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istiod-ca-cert\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.584688 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.584466    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-credential-socket\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.584688 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.584510    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-envoy\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.584688 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.584528    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-data\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.584688 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.584555    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-workload-certs\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.584688 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.584583    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-token\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.584688 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.584607    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-podinfo\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.584688 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.584654    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-workload-socket\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.585071 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.584982    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-credential-socket\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.585071 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.585056    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-workload-certs\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.585280 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.585252    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istiod-ca-cert\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.585371 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.585278    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-workload-socket\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.585371 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.585255    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-data\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.587252 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.587229    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-envoy\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.587458 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.587439    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-podinfo\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.592410 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.592385    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-token\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.592572 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.592554    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdftp\" (UniqueName: \"kubernetes.io/projected/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-kube-api-access-qdftp\") pod \"e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") " pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.719779 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.719737    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:07.999949 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:07.999922    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"]
Sep 19 15:35:08.001743 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:35:08.001714    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf0598d_00ba_45e9_b85f_aa78e021d9c7.slice/crio-526e94d894cfab9ac0fd35fb0354bbb82e685030fe76f48a3d295f24431d71f7 WatchSource:0}: Error finding container 526e94d894cfab9ac0fd35fb0354bbb82e685030fe76f48a3d295f24431d71f7: Status 404 returned error can't find the container with id 526e94d894cfab9ac0fd35fb0354bbb82e685030fe76f48a3d295f24431d71f7
Sep 19 15:35:08.004079 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:08.004045    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:35:08.004189 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:08.004128    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:35:08.004189 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:08.004171    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:35:08.389314 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:08.389222    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft" event={"ID":"3cf0598d-00ba-45e9-b85f-aa78e021d9c7","Type":"ContainerStarted","Data":"aa6a6d2ded70c45bb22c44f0800a3e46d87044b84938103364181369d2bc8728"}
Sep 19 15:35:08.389314 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:08.389276    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft" event={"ID":"3cf0598d-00ba-45e9-b85f-aa78e021d9c7","Type":"ContainerStarted","Data":"526e94d894cfab9ac0fd35fb0354bbb82e685030fe76f48a3d295f24431d71f7"}
Sep 19 15:35:08.436142 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:08.436071    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft" podStartSLOduration=1.436055267 podStartE2EDuration="1.436055267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:35:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:35:08.433499759 +0000 UTC m=+1383.322699472" watchObservedRunningTime="2026-09-19 15:35:08.436055267 +0000 UTC m=+1383.325254979"
Sep 19 15:35:08.720023 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:08.719984    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:09.726564 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:09.726533    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:10.402978 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:10.402944    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:10.404056 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:10.404032    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:12.678983 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:12.678945    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"]
Sep 19 15:35:12.682588 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:12.682568    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"
Sep 19 15:35:12.684481 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:12.684456    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a5942927-serving-cert\""
Sep 19 15:35:12.690672 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:12.690649    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"]
Sep 19 15:35:12.835495 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:12.835456    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h8l7\" (UniqueName: \"kubernetes.io/projected/b9719864-ad32-4338-9a2e-54d9f190d3b4-kube-api-access-2h8l7\") pod \"maas-api-e2e-mt-a5942927-65d484568d-p7jz9\" (UID: \"b9719864-ad32-4338-9a2e-54d9f190d3b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"
Sep 19 15:35:12.835840 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:12.835802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9719864-ad32-4338-9a2e-54d9f190d3b4-openshift-service-ca\") pod \"maas-api-e2e-mt-a5942927-65d484568d-p7jz9\" (UID: \"b9719864-ad32-4338-9a2e-54d9f190d3b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"
Sep 19 15:35:12.835974 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:12.835883    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9719864-ad32-4338-9a2e-54d9f190d3b4-metrics-certs\") pod \"maas-api-e2e-mt-a5942927-65d484568d-p7jz9\" (UID: \"b9719864-ad32-4338-9a2e-54d9f190d3b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"
Sep 19 15:35:12.836042 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:12.836010    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9719864-ad32-4338-9a2e-54d9f190d3b4-maas-api-tls\") pod \"maas-api-e2e-mt-a5942927-65d484568d-p7jz9\" (UID: \"b9719864-ad32-4338-9a2e-54d9f190d3b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"
Sep 19 15:35:12.937533 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:12.937446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9719864-ad32-4338-9a2e-54d9f190d3b4-metrics-certs\") pod \"maas-api-e2e-mt-a5942927-65d484568d-p7jz9\" (UID: \"b9719864-ad32-4338-9a2e-54d9f190d3b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"
Sep 19 15:35:12.937533 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:12.937489    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9719864-ad32-4338-9a2e-54d9f190d3b4-maas-api-tls\") pod \"maas-api-e2e-mt-a5942927-65d484568d-p7jz9\" (UID: \"b9719864-ad32-4338-9a2e-54d9f190d3b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"
Sep 19 15:35:12.937533 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:12.937528    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h8l7\" (UniqueName: \"kubernetes.io/projected/b9719864-ad32-4338-9a2e-54d9f190d3b4-kube-api-access-2h8l7\") pod \"maas-api-e2e-mt-a5942927-65d484568d-p7jz9\" (UID: \"b9719864-ad32-4338-9a2e-54d9f190d3b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"
Sep 19 15:35:12.937766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:12.937580    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9719864-ad32-4338-9a2e-54d9f190d3b4-openshift-service-ca\") pod \"maas-api-e2e-mt-a5942927-65d484568d-p7jz9\" (UID: \"b9719864-ad32-4338-9a2e-54d9f190d3b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"
Sep 19 15:35:12.938342 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:12.938266    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9719864-ad32-4338-9a2e-54d9f190d3b4-openshift-service-ca\") pod \"maas-api-e2e-mt-a5942927-65d484568d-p7jz9\" (UID: \"b9719864-ad32-4338-9a2e-54d9f190d3b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"
Sep 19 15:35:12.940233 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:12.940202    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9719864-ad32-4338-9a2e-54d9f190d3b4-metrics-certs\") pod \"maas-api-e2e-mt-a5942927-65d484568d-p7jz9\" (UID: \"b9719864-ad32-4338-9a2e-54d9f190d3b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"
Sep 19 15:35:12.940324 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:12.940205    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9719864-ad32-4338-9a2e-54d9f190d3b4-maas-api-tls\") pod \"maas-api-e2e-mt-a5942927-65d484568d-p7jz9\" (UID: \"b9719864-ad32-4338-9a2e-54d9f190d3b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"
Sep 19 15:35:12.946160 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:12.946140    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h8l7\" (UniqueName: \"kubernetes.io/projected/b9719864-ad32-4338-9a2e-54d9f190d3b4-kube-api-access-2h8l7\") pod \"maas-api-e2e-mt-a5942927-65d484568d-p7jz9\" (UID: \"b9719864-ad32-4338-9a2e-54d9f190d3b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"
Sep 19 15:35:12.995167 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:12.995124    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"
Sep 19 15:35:13.274239 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.274209    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"]
Sep 19 15:35:13.275582 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:35:13.275551    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9719864_ad32_4338_9a2e_54d9f190d3b4.slice/crio-1d306265631c97ec5453737fd783e46fd8694c3d5e853d189f5e9c2d3012e8e1 WatchSource:0}: Error finding container 1d306265631c97ec5453737fd783e46fd8694c3d5e853d189f5e9c2d3012e8e1: Status 404 returned error can't find the container with id 1d306265631c97ec5453737fd783e46fd8694c3d5e853d189f5e9c2d3012e8e1
Sep 19 15:35:13.343051 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.343014    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7"]
Sep 19 15:35:13.348093 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.348072    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7"
Sep 19 15:35:13.350233 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.350208    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-a5942927\""
Sep 19 15:35:13.350463 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.350447    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-a5942927-dockercfg-cwkm2\""
Sep 19 15:35:13.356831 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.356526    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7"]
Sep 19 15:35:13.364424 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.364396    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n"]
Sep 19 15:35:13.368864 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.368845    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n"
Sep 19 15:35:13.383976 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.383951    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n"]
Sep 19 15:35:13.422308 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.422265    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9" event={"ID":"b9719864-ad32-4338-9a2e-54d9f190d3b4","Type":"ContainerStarted","Data":"1d306265631c97ec5453737fd783e46fd8694c3d5e853d189f5e9c2d3012e8e1"}
Sep 19 15:35:13.442677 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.442645    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00450006-f1b2-4e70-81ee-1e9911df9c36-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7\" (UID: \"00450006-f1b2-4e70-81ee-1e9911df9c36\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7"
Sep 19 15:35:13.442847 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.442692    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrtxg\" (UniqueName: \"kubernetes.io/projected/00450006-f1b2-4e70-81ee-1e9911df9c36-kube-api-access-lrtxg\") pod \"payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7\" (UID: \"00450006-f1b2-4e70-81ee-1e9911df9c36\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7"
Sep 19 15:35:13.543441 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.543342    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2-plugins-config-volume\") pod \"payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n\" (UID: \"9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2\") " pod="openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n"
Sep 19 15:35:13.543613 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.543475    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00450006-f1b2-4e70-81ee-1e9911df9c36-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7\" (UID: \"00450006-f1b2-4e70-81ee-1e9911df9c36\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7"
Sep 19 15:35:13.543613 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.543511    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrtxg\" (UniqueName: \"kubernetes.io/projected/00450006-f1b2-4e70-81ee-1e9911df9c36-kube-api-access-lrtxg\") pod \"payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7\" (UID: \"00450006-f1b2-4e70-81ee-1e9911df9c36\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7"
Sep 19 15:35:13.543613 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.543542    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm579\" (UniqueName: \"kubernetes.io/projected/9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2-kube-api-access-fm579\") pod \"payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n\" (UID: \"9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2\") " pod="openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n"
Sep 19 15:35:13.544151 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.544131    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00450006-f1b2-4e70-81ee-1e9911df9c36-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7\" (UID: \"00450006-f1b2-4e70-81ee-1e9911df9c36\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7"
Sep 19 15:35:13.551420 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.551398    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrtxg\" (UniqueName: \"kubernetes.io/projected/00450006-f1b2-4e70-81ee-1e9911df9c36-kube-api-access-lrtxg\") pod \"payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7\" (UID: \"00450006-f1b2-4e70-81ee-1e9911df9c36\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7"
Sep 19 15:35:13.644802 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.644768    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm579\" (UniqueName: \"kubernetes.io/projected/9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2-kube-api-access-fm579\") pod \"payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n\" (UID: \"9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2\") " pod="openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n"
Sep 19 15:35:13.644979 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.644813    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2-plugins-config-volume\") pod \"payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n\" (UID: \"9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2\") " pod="openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n"
Sep 19 15:35:13.645522 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.645504    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2-plugins-config-volume\") pod \"payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n\" (UID: \"9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2\") " pod="openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n"
Sep 19 15:35:13.653195 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.653170    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm579\" (UniqueName: \"kubernetes.io/projected/9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2-kube-api-access-fm579\") pod \"payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n\" (UID: \"9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2\") " pod="openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n"
Sep 19 15:35:13.662598 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.662582    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7"
Sep 19 15:35:13.678885 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.678802    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n"
Sep 19 15:35:13.940977 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.940948    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7"]
Sep 19 15:35:13.941806 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:35:13.941781    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00450006_f1b2_4e70_81ee_1e9911df9c36.slice/crio-85ab0816ef0ae71c41471f921196ed7af3cfca0530c3e6cec726a01d314b36ee WatchSource:0}: Error finding container 85ab0816ef0ae71c41471f921196ed7af3cfca0530c3e6cec726a01d314b36ee: Status 404 returned error can't find the container with id 85ab0816ef0ae71c41471f921196ed7af3cfca0530c3e6cec726a01d314b36ee
Sep 19 15:35:13.968204 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:13.968177    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n"]
Sep 19 15:35:13.969516 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:35:13.969493    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab53d55_1d3a_47cc_bd44_ef78a9f7e8a2.slice/crio-7f46f9447652b5bbce08f4ae007fcee9236ad34010fe527881d78443754d9b09 WatchSource:0}: Error finding container 7f46f9447652b5bbce08f4ae007fcee9236ad34010fe527881d78443754d9b09: Status 404 returned error can't find the container with id 7f46f9447652b5bbce08f4ae007fcee9236ad34010fe527881d78443754d9b09
Sep 19 15:35:14.432302 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:14.432260    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7" event={"ID":"00450006-f1b2-4e70-81ee-1e9911df9c36","Type":"ContainerStarted","Data":"03d022c6f45485575460e0ac18573c5d2996f6e01a7706de3a041734d18f21da"}
Sep 19 15:35:14.432506 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:14.432331    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7" event={"ID":"00450006-f1b2-4e70-81ee-1e9911df9c36","Type":"ContainerStarted","Data":"85ab0816ef0ae71c41471f921196ed7af3cfca0530c3e6cec726a01d314b36ee"}
Sep 19 15:35:14.432506 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:14.432361    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7"
Sep 19 15:35:14.434420 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:14.434392    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9" event={"ID":"b9719864-ad32-4338-9a2e-54d9f190d3b4","Type":"ContainerStarted","Data":"b41de44a756433806d47fd597abea2bdbf646c925ce18f2382d2208c68a84434"}
Sep 19 15:35:14.434567 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:14.434445    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"
Sep 19 15:35:14.436550 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:14.436526    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n" event={"ID":"9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2","Type":"ContainerStarted","Data":"8a7d9b3d6ec729ce88e74b6423fa8d71f2b5ae20e715ba3f6b7bc6839c553353"}
Sep 19 15:35:14.436663 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:14.436573    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n" event={"ID":"9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2","Type":"ContainerStarted","Data":"7f46f9447652b5bbce08f4ae007fcee9236ad34010fe527881d78443754d9b09"}
Sep 19 15:35:14.436663 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:14.436601    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n"
Sep 19 15:35:14.448539 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:14.448496    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7" podStartSLOduration=1.44848323 podStartE2EDuration="1.44848323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:35:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:35:14.447022039 +0000 UTC m=+1389.336221754" watchObservedRunningTime="2026-09-19 15:35:14.44848323 +0000 UTC m=+1389.337682969"
Sep 19 15:35:14.462240 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:14.462194    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n" podStartSLOduration=1.462179218 podStartE2EDuration="1.462179218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:35:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:35:14.46063056 +0000 UTC m=+1389.349830287" watchObservedRunningTime="2026-09-19 15:35:14.462179218 +0000 UTC m=+1389.351378931"
Sep 19 15:35:14.480109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:14.480069    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9" podStartSLOduration=1.856239086 podStartE2EDuration="2.480054665s" totalImagesPullingTime="623.815579ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:35:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:35:14.476851361 +0000 UTC m=+1389.366051089" watchObservedRunningTime="2026-09-19 15:35:14.480054665 +0000 UTC m=+1389.369254580"
Sep 19 15:35:18.258098 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.258057    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"]
Sep 19 15:35:18.258516 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.258324    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk" podUID="955a87c9-c90e-4034-b0ea-a52666760677" containerName="maas-api" containerID="cri-o://0d9a907fc4f6550fb630f27b47569cfe6c610be830fa5af8c941ceb78c4d5086" gracePeriod=30
Sep 19 15:35:18.301726 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.301696    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd"]
Sep 19 15:35:18.301954 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.301928    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd" podUID="96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0" containerName="payload-processing" containerID="cri-o://3ca011158c4fc2e6ed8d0b95b973f99d811dcdb6eae153e5dd4b4ed385dd2c3f" gracePeriod=30
Sep 19 15:35:18.462346 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.462229    2563 generic.go:356] "Generic (PLEG): container finished" podID="955a87c9-c90e-4034-b0ea-a52666760677" containerID="0d9a907fc4f6550fb630f27b47569cfe6c610be830fa5af8c941ceb78c4d5086" exitCode=0
Sep 19 15:35:18.462513 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.462345    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk" event={"ID":"955a87c9-c90e-4034-b0ea-a52666760677","Type":"ContainerDied","Data":"0d9a907fc4f6550fb630f27b47569cfe6c610be830fa5af8c941ceb78c4d5086"}
Sep 19 15:35:18.464422 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.464363    2563 generic.go:356] "Generic (PLEG): container finished" podID="96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0" containerID="3ca011158c4fc2e6ed8d0b95b973f99d811dcdb6eae153e5dd4b4ed385dd2c3f" exitCode=0
Sep 19 15:35:18.464787 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.464438    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd" event={"ID":"96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0","Type":"ContainerDied","Data":"3ca011158c4fc2e6ed8d0b95b973f99d811dcdb6eae153e5dd4b4ed385dd2c3f"}
Sep 19 15:35:18.576015 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.575923    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"
Sep 19 15:35:18.614571 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.614542    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd"
Sep 19 15:35:18.697101 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.697065    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/955a87c9-c90e-4034-b0ea-a52666760677-maas-api-tls\") pod \"955a87c9-c90e-4034-b0ea-a52666760677\" (UID: \"955a87c9-c90e-4034-b0ea-a52666760677\") "
Sep 19 15:35:18.697302 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.697128    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/955a87c9-c90e-4034-b0ea-a52666760677-openshift-service-ca\") pod \"955a87c9-c90e-4034-b0ea-a52666760677\" (UID: \"955a87c9-c90e-4034-b0ea-a52666760677\") "
Sep 19 15:35:18.697302 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.697261    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m49jc\" (UniqueName: \"kubernetes.io/projected/955a87c9-c90e-4034-b0ea-a52666760677-kube-api-access-m49jc\") pod \"955a87c9-c90e-4034-b0ea-a52666760677\" (UID: \"955a87c9-c90e-4034-b0ea-a52666760677\") "
Sep 19 15:35:18.697302 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.697285    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/955a87c9-c90e-4034-b0ea-a52666760677-metrics-certs\") pod \"955a87c9-c90e-4034-b0ea-a52666760677\" (UID: \"955a87c9-c90e-4034-b0ea-a52666760677\") "
Sep 19 15:35:18.697573 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.697545    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/955a87c9-c90e-4034-b0ea-a52666760677-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "955a87c9-c90e-4034-b0ea-a52666760677" (UID: "955a87c9-c90e-4034-b0ea-a52666760677"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:35:18.699660 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.699627    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/955a87c9-c90e-4034-b0ea-a52666760677-kube-api-access-m49jc" (OuterVolumeSpecName: "kube-api-access-m49jc") pod "955a87c9-c90e-4034-b0ea-a52666760677" (UID: "955a87c9-c90e-4034-b0ea-a52666760677"). InnerVolumeSpecName "kube-api-access-m49jc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:35:18.700239 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.700208    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/955a87c9-c90e-4034-b0ea-a52666760677-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "955a87c9-c90e-4034-b0ea-a52666760677" (UID: "955a87c9-c90e-4034-b0ea-a52666760677"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:35:18.700468 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.700446    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/955a87c9-c90e-4034-b0ea-a52666760677-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "955a87c9-c90e-4034-b0ea-a52666760677" (UID: "955a87c9-c90e-4034-b0ea-a52666760677"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:35:18.797987 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.797851    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0-plugins-config-volume\") pod \"96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0\" (UID: \"96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0\") "
Sep 19 15:35:18.797987 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.797981    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4kgf\" (UniqueName: \"kubernetes.io/projected/96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0-kube-api-access-g4kgf\") pod \"96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0\" (UID: \"96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0\") "
Sep 19 15:35:18.798330 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.798299    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0" (UID: "96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:35:18.798429 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.798408    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0-plugins-config-volume\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:18.798465 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.798437    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m49jc\" (UniqueName: \"kubernetes.io/projected/955a87c9-c90e-4034-b0ea-a52666760677-kube-api-access-m49jc\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:18.798465 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.798454    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/955a87c9-c90e-4034-b0ea-a52666760677-metrics-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:18.798572 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.798469    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/955a87c9-c90e-4034-b0ea-a52666760677-maas-api-tls\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:18.798572 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.798483    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/955a87c9-c90e-4034-b0ea-a52666760677-openshift-service-ca\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:18.800471 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.800446    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0-kube-api-access-g4kgf" (OuterVolumeSpecName: "kube-api-access-g4kgf") pod "96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0" (UID: "96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0"). InnerVolumeSpecName "kube-api-access-g4kgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:35:18.899787 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:18.899749    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4kgf\" (UniqueName: \"kubernetes.io/projected/96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0-kube-api-access-g4kgf\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:19.471342 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:19.471312    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd"
Sep 19 15:35:19.471785 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:19.471350    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd" event={"ID":"96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0","Type":"ContainerDied","Data":"859d21d55c71439a4cef59161ab35a1c631fb45eee8db4777915d394c06765cf"}
Sep 19 15:35:19.471785 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:19.471424    2563 scope.go:117] "RemoveContainer" containerID="3ca011158c4fc2e6ed8d0b95b973f99d811dcdb6eae153e5dd4b4ed385dd2c3f"
Sep 19 15:35:19.472973 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:19.472918    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk" event={"ID":"955a87c9-c90e-4034-b0ea-a52666760677","Type":"ContainerDied","Data":"08418e5c4e8e57075717fbcfb38811d6133536d02cfb3d64b76794264ab700c0"}
Sep 19 15:35:19.472973 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:19.472948    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"
Sep 19 15:35:19.482767 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:19.482747    2563 scope.go:117] "RemoveContainer" containerID="0d9a907fc4f6550fb630f27b47569cfe6c610be830fa5af8c941ceb78c4d5086"
Sep 19 15:35:19.499259 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:19.499237    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"]
Sep 19 15:35:19.506309 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:19.506288    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-21d2a4-644c4fc9d7-86czk"]
Sep 19 15:35:19.520427 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:19.520401    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd"]
Sep 19 15:35:19.524410 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:19.524353    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd"]
Sep 19 15:35:19.642425 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:19.642390    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="955a87c9-c90e-4034-b0ea-a52666760677" path="/var/lib/kubelet/pods/955a87c9-c90e-4034-b0ea-a52666760677/volumes"
Sep 19 15:35:19.642760 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:19.642747    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0" path="/var/lib/kubelet/pods/96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0/volumes"
Sep 19 15:35:20.448572 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:20.448544    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"
Sep 19 15:35:25.445004 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:25.444974    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7"
Sep 19 15:35:25.445518 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:25.445090    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n"
Sep 19 15:35:36.820496 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:36.820450    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"]
Sep 19 15:35:36.821007 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:36.820718    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql" podUID="ab8c2c57-ce62-4335-b53a-ad3f73fbee51" containerName="maas-api" containerID="cri-o://50f9be21f3eeff52e24e8b15a9dbbb4f98023366caebc2887ea9a78999540020" gracePeriod=30
Sep 19 15:35:37.134280 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.134252    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"
Sep 19 15:35:37.167615 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.167586    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-maas-api-tls\") pod \"ab8c2c57-ce62-4335-b53a-ad3f73fbee51\" (UID: \"ab8c2c57-ce62-4335-b53a-ad3f73fbee51\") "
Sep 19 15:35:37.167795 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.167683    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnqfg\" (UniqueName: \"kubernetes.io/projected/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-kube-api-access-jnqfg\") pod \"ab8c2c57-ce62-4335-b53a-ad3f73fbee51\" (UID: \"ab8c2c57-ce62-4335-b53a-ad3f73fbee51\") "
Sep 19 15:35:37.167795 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.167720    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-openshift-service-ca\") pod \"ab8c2c57-ce62-4335-b53a-ad3f73fbee51\" (UID: \"ab8c2c57-ce62-4335-b53a-ad3f73fbee51\") "
Sep 19 15:35:37.167795 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.167767    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-metrics-certs\") pod \"ab8c2c57-ce62-4335-b53a-ad3f73fbee51\" (UID: \"ab8c2c57-ce62-4335-b53a-ad3f73fbee51\") "
Sep 19 15:35:37.168149 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.168121    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ab8c2c57-ce62-4335-b53a-ad3f73fbee51" (UID: "ab8c2c57-ce62-4335-b53a-ad3f73fbee51"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:35:37.170053 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.170026    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ab8c2c57-ce62-4335-b53a-ad3f73fbee51" (UID: "ab8c2c57-ce62-4335-b53a-ad3f73fbee51"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:35:37.170053 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.170044    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ab8c2c57-ce62-4335-b53a-ad3f73fbee51" (UID: "ab8c2c57-ce62-4335-b53a-ad3f73fbee51"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:35:37.170191 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.170097    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-kube-api-access-jnqfg" (OuterVolumeSpecName: "kube-api-access-jnqfg") pod "ab8c2c57-ce62-4335-b53a-ad3f73fbee51" (UID: "ab8c2c57-ce62-4335-b53a-ad3f73fbee51"). InnerVolumeSpecName "kube-api-access-jnqfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:35:37.268673 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.268638    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-maas-api-tls\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:37.268673 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.268672    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnqfg\" (UniqueName: \"kubernetes.io/projected/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-kube-api-access-jnqfg\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:37.268673 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.268682    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-openshift-service-ca\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:37.268954 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.268691    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab8c2c57-ce62-4335-b53a-ad3f73fbee51-metrics-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:37.606964 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.606929    2563 generic.go:356] "Generic (PLEG): container finished" podID="ab8c2c57-ce62-4335-b53a-ad3f73fbee51" containerID="50f9be21f3eeff52e24e8b15a9dbbb4f98023366caebc2887ea9a78999540020" exitCode=0
Sep 19 15:35:37.607255 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.607041    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"
Sep 19 15:35:37.607712 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.607062    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql" event={"ID":"ab8c2c57-ce62-4335-b53a-ad3f73fbee51","Type":"ContainerDied","Data":"50f9be21f3eeff52e24e8b15a9dbbb4f98023366caebc2887ea9a78999540020"}
Sep 19 15:35:37.607824 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.607760    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql" event={"ID":"ab8c2c57-ce62-4335-b53a-ad3f73fbee51","Type":"ContainerDied","Data":"6ba0e175c661768a1c04a4aac103ad01cd2b06416c52e6b55beeefabc8552024"}
Sep 19 15:35:37.607824 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.607795    2563 scope.go:117] "RemoveContainer" containerID="50f9be21f3eeff52e24e8b15a9dbbb4f98023366caebc2887ea9a78999540020"
Sep 19 15:35:37.619351 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.619332    2563 scope.go:117] "RemoveContainer" containerID="50f9be21f3eeff52e24e8b15a9dbbb4f98023366caebc2887ea9a78999540020"
Sep 19 15:35:37.619642 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:35:37.619623    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50f9be21f3eeff52e24e8b15a9dbbb4f98023366caebc2887ea9a78999540020\": container with ID starting with 50f9be21f3eeff52e24e8b15a9dbbb4f98023366caebc2887ea9a78999540020 not found: ID does not exist" containerID="50f9be21f3eeff52e24e8b15a9dbbb4f98023366caebc2887ea9a78999540020"
Sep 19 15:35:37.619697 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.619651    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50f9be21f3eeff52e24e8b15a9dbbb4f98023366caebc2887ea9a78999540020"} err="failed to get container status \"50f9be21f3eeff52e24e8b15a9dbbb4f98023366caebc2887ea9a78999540020\": rpc error: code = NotFound desc = could not find container \"50f9be21f3eeff52e24e8b15a9dbbb4f98023366caebc2887ea9a78999540020\": container with ID starting with 50f9be21f3eeff52e24e8b15a9dbbb4f98023366caebc2887ea9a78999540020 not found: ID does not exist"
Sep 19 15:35:37.632029 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.631997    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"]
Sep 19 15:35:37.634584 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.634558    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e93f57-7b799b565-h5mql"]
Sep 19 15:35:37.641649 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:37.641624    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab8c2c57-ce62-4335-b53a-ad3f73fbee51" path="/var/lib/kubelet/pods/ab8c2c57-ce62-4335-b53a-ad3f73fbee51/volumes"
Sep 19 15:35:42.091677 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.091640    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"]
Sep 19 15:35:42.092160 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.091965    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9" podUID="b9719864-ad32-4338-9a2e-54d9f190d3b4" containerName="maas-api" containerID="cri-o://b41de44a756433806d47fd597abea2bdbf646c925ce18f2382d2208c68a84434" gracePeriod=30
Sep 19 15:35:42.142737 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.142700    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n"]
Sep 19 15:35:42.143000 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.142967    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n" podUID="9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2" containerName="payload-processing" containerID="cri-o://8a7d9b3d6ec729ce88e74b6423fa8d71f2b5ae20e715ba3f6b7bc6839c553353" gracePeriod=30
Sep 19 15:35:42.148309 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.148271    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7"]
Sep 19 15:35:42.149178 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.148539    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7" podUID="00450006-f1b2-4e70-81ee-1e9911df9c36" containerName="payload-pre-processing" containerID="cri-o://03d022c6f45485575460e0ac18573c5d2996f6e01a7706de3a041734d18f21da" gracePeriod=30
Sep 19 15:35:42.439770 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.439735    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"
Sep 19 15:35:42.482245 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.482216    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n"
Sep 19 15:35:42.484242 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.484218    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7"
Sep 19 15:35:42.540476 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.540443    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9719864-ad32-4338-9a2e-54d9f190d3b4-openshift-service-ca\") pod \"b9719864-ad32-4338-9a2e-54d9f190d3b4\" (UID: \"b9719864-ad32-4338-9a2e-54d9f190d3b4\") "
Sep 19 15:35:42.540645 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.540496    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2h8l7\" (UniqueName: \"kubernetes.io/projected/b9719864-ad32-4338-9a2e-54d9f190d3b4-kube-api-access-2h8l7\") pod \"b9719864-ad32-4338-9a2e-54d9f190d3b4\" (UID: \"b9719864-ad32-4338-9a2e-54d9f190d3b4\") "
Sep 19 15:35:42.540645 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.540533    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9719864-ad32-4338-9a2e-54d9f190d3b4-metrics-certs\") pod \"b9719864-ad32-4338-9a2e-54d9f190d3b4\" (UID: \"b9719864-ad32-4338-9a2e-54d9f190d3b4\") "
Sep 19 15:35:42.540645 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.540563    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9719864-ad32-4338-9a2e-54d9f190d3b4-maas-api-tls\") pod \"b9719864-ad32-4338-9a2e-54d9f190d3b4\" (UID: \"b9719864-ad32-4338-9a2e-54d9f190d3b4\") "
Sep 19 15:35:42.540941 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.540908    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9719864-ad32-4338-9a2e-54d9f190d3b4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b9719864-ad32-4338-9a2e-54d9f190d3b4" (UID: "b9719864-ad32-4338-9a2e-54d9f190d3b4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:35:42.542958 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.542863    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9719864-ad32-4338-9a2e-54d9f190d3b4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b9719864-ad32-4338-9a2e-54d9f190d3b4" (UID: "b9719864-ad32-4338-9a2e-54d9f190d3b4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:35:42.543245 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.543224    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9719864-ad32-4338-9a2e-54d9f190d3b4-kube-api-access-2h8l7" (OuterVolumeSpecName: "kube-api-access-2h8l7") pod "b9719864-ad32-4338-9a2e-54d9f190d3b4" (UID: "b9719864-ad32-4338-9a2e-54d9f190d3b4"). InnerVolumeSpecName "kube-api-access-2h8l7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:35:42.543353 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.543336    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9719864-ad32-4338-9a2e-54d9f190d3b4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b9719864-ad32-4338-9a2e-54d9f190d3b4" (UID: "b9719864-ad32-4338-9a2e-54d9f190d3b4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:35:42.641533 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.641434    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrtxg\" (UniqueName: \"kubernetes.io/projected/00450006-f1b2-4e70-81ee-1e9911df9c36-kube-api-access-lrtxg\") pod \"00450006-f1b2-4e70-81ee-1e9911df9c36\" (UID: \"00450006-f1b2-4e70-81ee-1e9911df9c36\") "
Sep 19 15:35:42.641533 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.641515    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2-plugins-config-volume\") pod \"9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2\" (UID: \"9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2\") "
Sep 19 15:35:42.641775 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.641561    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00450006-f1b2-4e70-81ee-1e9911df9c36-plugins-config-volume\") pod \"00450006-f1b2-4e70-81ee-1e9911df9c36\" (UID: \"00450006-f1b2-4e70-81ee-1e9911df9c36\") "
Sep 19 15:35:42.641775 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.641596    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fm579\" (UniqueName: \"kubernetes.io/projected/9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2-kube-api-access-fm579\") pod \"9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2\" (UID: \"9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2\") "
Sep 19 15:35:42.642035 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.641954    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2" (UID: "9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:35:42.642035 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.641979    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00450006-f1b2-4e70-81ee-1e9911df9c36-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "00450006-f1b2-4e70-81ee-1e9911df9c36" (UID: "00450006-f1b2-4e70-81ee-1e9911df9c36"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:35:42.642035 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.642024    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2h8l7\" (UniqueName: \"kubernetes.io/projected/b9719864-ad32-4338-9a2e-54d9f190d3b4-kube-api-access-2h8l7\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:42.642449 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.642045    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9719864-ad32-4338-9a2e-54d9f190d3b4-metrics-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:42.642449 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.642059    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9719864-ad32-4338-9a2e-54d9f190d3b4-maas-api-tls\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:42.642449 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.642071    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9719864-ad32-4338-9a2e-54d9f190d3b4-openshift-service-ca\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:42.643829 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.643806    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2-kube-api-access-fm579" (OuterVolumeSpecName: "kube-api-access-fm579") pod "9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2" (UID: "9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2"). InnerVolumeSpecName "kube-api-access-fm579". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:35:42.644153 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.644129    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00450006-f1b2-4e70-81ee-1e9911df9c36-kube-api-access-lrtxg" (OuterVolumeSpecName: "kube-api-access-lrtxg") pod "00450006-f1b2-4e70-81ee-1e9911df9c36" (UID: "00450006-f1b2-4e70-81ee-1e9911df9c36"). InnerVolumeSpecName "kube-api-access-lrtxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:35:42.649482 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.649454    2563 generic.go:356] "Generic (PLEG): container finished" podID="00450006-f1b2-4e70-81ee-1e9911df9c36" containerID="03d022c6f45485575460e0ac18573c5d2996f6e01a7706de3a041734d18f21da" exitCode=0
Sep 19 15:35:42.649574 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.649548    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7"
Sep 19 15:35:42.649629 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.649595    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7" event={"ID":"00450006-f1b2-4e70-81ee-1e9911df9c36","Type":"ContainerDied","Data":"03d022c6f45485575460e0ac18573c5d2996f6e01a7706de3a041734d18f21da"}
Sep 19 15:35:42.649699 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.649654    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7" event={"ID":"00450006-f1b2-4e70-81ee-1e9911df9c36","Type":"ContainerDied","Data":"85ab0816ef0ae71c41471f921196ed7af3cfca0530c3e6cec726a01d314b36ee"}
Sep 19 15:35:42.649699 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.649687    2563 scope.go:117] "RemoveContainer" containerID="03d022c6f45485575460e0ac18573c5d2996f6e01a7706de3a041734d18f21da"
Sep 19 15:35:42.651047 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.651023    2563 generic.go:356] "Generic (PLEG): container finished" podID="b9719864-ad32-4338-9a2e-54d9f190d3b4" containerID="b41de44a756433806d47fd597abea2bdbf646c925ce18f2382d2208c68a84434" exitCode=0
Sep 19 15:35:42.651145 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.651095    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"
Sep 19 15:35:42.651216 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.651094    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9" event={"ID":"b9719864-ad32-4338-9a2e-54d9f190d3b4","Type":"ContainerDied","Data":"b41de44a756433806d47fd597abea2bdbf646c925ce18f2382d2208c68a84434"}
Sep 19 15:35:42.651371 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.651240    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9" event={"ID":"b9719864-ad32-4338-9a2e-54d9f190d3b4","Type":"ContainerDied","Data":"1d306265631c97ec5453737fd783e46fd8694c3d5e853d189f5e9c2d3012e8e1"}
Sep 19 15:35:42.654193 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.654170    2563 generic.go:356] "Generic (PLEG): container finished" podID="9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2" containerID="8a7d9b3d6ec729ce88e74b6423fa8d71f2b5ae20e715ba3f6b7bc6839c553353" exitCode=0
Sep 19 15:35:42.654298 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.654252    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n"
Sep 19 15:35:42.654379 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.654312    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n" event={"ID":"9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2","Type":"ContainerDied","Data":"8a7d9b3d6ec729ce88e74b6423fa8d71f2b5ae20e715ba3f6b7bc6839c553353"}
Sep 19 15:35:42.654434 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.654370    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n" event={"ID":"9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2","Type":"ContainerDied","Data":"7f46f9447652b5bbce08f4ae007fcee9236ad34010fe527881d78443754d9b09"}
Sep 19 15:35:42.661602 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.661579    2563 scope.go:117] "RemoveContainer" containerID="03d022c6f45485575460e0ac18573c5d2996f6e01a7706de3a041734d18f21da"
Sep 19 15:35:42.662003 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:35:42.661981    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03d022c6f45485575460e0ac18573c5d2996f6e01a7706de3a041734d18f21da\": container with ID starting with 03d022c6f45485575460e0ac18573c5d2996f6e01a7706de3a041734d18f21da not found: ID does not exist" containerID="03d022c6f45485575460e0ac18573c5d2996f6e01a7706de3a041734d18f21da"
Sep 19 15:35:42.662097 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.662012    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03d022c6f45485575460e0ac18573c5d2996f6e01a7706de3a041734d18f21da"} err="failed to get container status \"03d022c6f45485575460e0ac18573c5d2996f6e01a7706de3a041734d18f21da\": rpc error: code = NotFound desc = could not find container \"03d022c6f45485575460e0ac18573c5d2996f6e01a7706de3a041734d18f21da\": container with ID starting with 03d022c6f45485575460e0ac18573c5d2996f6e01a7706de3a041734d18f21da not found: ID does not exist"
Sep 19 15:35:42.662097 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.662028    2563 scope.go:117] "RemoveContainer" containerID="b41de44a756433806d47fd597abea2bdbf646c925ce18f2382d2208c68a84434"
Sep 19 15:35:42.672808 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.672787    2563 scope.go:117] "RemoveContainer" containerID="b41de44a756433806d47fd597abea2bdbf646c925ce18f2382d2208c68a84434"
Sep 19 15:35:42.673198 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:35:42.673178    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b41de44a756433806d47fd597abea2bdbf646c925ce18f2382d2208c68a84434\": container with ID starting with b41de44a756433806d47fd597abea2bdbf646c925ce18f2382d2208c68a84434 not found: ID does not exist" containerID="b41de44a756433806d47fd597abea2bdbf646c925ce18f2382d2208c68a84434"
Sep 19 15:35:42.673261 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.673206    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b41de44a756433806d47fd597abea2bdbf646c925ce18f2382d2208c68a84434"} err="failed to get container status \"b41de44a756433806d47fd597abea2bdbf646c925ce18f2382d2208c68a84434\": rpc error: code = NotFound desc = could not find container \"b41de44a756433806d47fd597abea2bdbf646c925ce18f2382d2208c68a84434\": container with ID starting with b41de44a756433806d47fd597abea2bdbf646c925ce18f2382d2208c68a84434 not found: ID does not exist"
Sep 19 15:35:42.673261 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.673223    2563 scope.go:117] "RemoveContainer" containerID="8a7d9b3d6ec729ce88e74b6423fa8d71f2b5ae20e715ba3f6b7bc6839c553353"
Sep 19 15:35:42.684203 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.684174    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7"]
Sep 19 15:35:42.685603 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.685573    2563 scope.go:117] "RemoveContainer" containerID="8a7d9b3d6ec729ce88e74b6423fa8d71f2b5ae20e715ba3f6b7bc6839c553353"
Sep 19 15:35:42.686146 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:35:42.686119    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a7d9b3d6ec729ce88e74b6423fa8d71f2b5ae20e715ba3f6b7bc6839c553353\": container with ID starting with 8a7d9b3d6ec729ce88e74b6423fa8d71f2b5ae20e715ba3f6b7bc6839c553353 not found: ID does not exist" containerID="8a7d9b3d6ec729ce88e74b6423fa8d71f2b5ae20e715ba3f6b7bc6839c553353"
Sep 19 15:35:42.686247 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.686167    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a7d9b3d6ec729ce88e74b6423fa8d71f2b5ae20e715ba3f6b7bc6839c553353"} err="failed to get container status \"8a7d9b3d6ec729ce88e74b6423fa8d71f2b5ae20e715ba3f6b7bc6839c553353\": rpc error: code = NotFound desc = could not find container \"8a7d9b3d6ec729ce88e74b6423fa8d71f2b5ae20e715ba3f6b7bc6839c553353\": container with ID starting with 8a7d9b3d6ec729ce88e74b6423fa8d71f2b5ae20e715ba3f6b7bc6839c553353 not found: ID does not exist"
Sep 19 15:35:42.689500 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.689475    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7"]
Sep 19 15:35:42.699529 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.699500    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n"]
Sep 19 15:35:42.703758 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.703732    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n"]
Sep 19 15:35:42.709813 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.709783    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"]
Sep 19 15:35:42.712114 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.712095    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a5942927-65d484568d-p7jz9"]
Sep 19 15:35:42.742759 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.742732    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrtxg\" (UniqueName: \"kubernetes.io/projected/00450006-f1b2-4e70-81ee-1e9911df9c36-kube-api-access-lrtxg\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:42.742759 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.742755    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2-plugins-config-volume\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:42.742943 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.742766    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00450006-f1b2-4e70-81ee-1e9911df9c36-plugins-config-volume\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:42.742943 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:42.742774    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fm579\" (UniqueName: \"kubernetes.io/projected/9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2-kube-api-access-fm579\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:43.642860 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:43.642821    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00450006-f1b2-4e70-81ee-1e9911df9c36" path="/var/lib/kubelet/pods/00450006-f1b2-4e70-81ee-1e9911df9c36/volumes"
Sep 19 15:35:43.643457 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:43.643436    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2" path="/var/lib/kubelet/pods/9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2/volumes"
Sep 19 15:35:43.644033 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:43.644014    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9719864-ad32-4338-9a2e-54d9f190d3b4" path="/var/lib/kubelet/pods/b9719864-ad32-4338-9a2e-54d9f190d3b4/volumes"
Sep 19 15:35:44.672687 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:44.672658    2563 generic.go:356] "Generic (PLEG): container finished" podID="3cf0598d-00ba-45e9-b85f-aa78e021d9c7" containerID="aa6a6d2ded70c45bb22c44f0800a3e46d87044b84938103364181369d2bc8728" exitCode=0
Sep 19 15:35:44.673194 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:44.672731    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft" event={"ID":"3cf0598d-00ba-45e9-b85f-aa78e021d9c7","Type":"ContainerDied","Data":"aa6a6d2ded70c45bb22c44f0800a3e46d87044b84938103364181369d2bc8728"}
Sep 19 15:35:44.673194 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:44.673144    2563 scope.go:117] "RemoveContainer" containerID="aa6a6d2ded70c45bb22c44f0800a3e46d87044b84938103364181369d2bc8728"
Sep 19 15:35:44.674312 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:44.674282    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:35:44.674394 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:44.674379    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:35:44.674435 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:44.674425    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:35:45.007250 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.007216    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"]
Sep 19 15:35:45.007909 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.007859    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="955a87c9-c90e-4034-b0ea-a52666760677" containerName="maas-api"
Sep 19 15:35:45.007909 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.007886    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="955a87c9-c90e-4034-b0ea-a52666760677" containerName="maas-api"
Sep 19 15:35:45.008105 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.007926    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00450006-f1b2-4e70-81ee-1e9911df9c36" containerName="payload-pre-processing"
Sep 19 15:35:45.008105 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.007935    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="00450006-f1b2-4e70-81ee-1e9911df9c36" containerName="payload-pre-processing"
Sep 19 15:35:45.008105 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.007955    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9719864-ad32-4338-9a2e-54d9f190d3b4" containerName="maas-api"
Sep 19 15:35:45.008105 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.007963    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9719864-ad32-4338-9a2e-54d9f190d3b4" containerName="maas-api"
Sep 19 15:35:45.008105 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.007976    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0" containerName="payload-processing"
Sep 19 15:35:45.008105 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.007983    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0" containerName="payload-processing"
Sep 19 15:35:45.008105 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.007993    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2" containerName="payload-processing"
Sep 19 15:35:45.008105 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.008001    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2" containerName="payload-processing"
Sep 19 15:35:45.008105 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.008016    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab8c2c57-ce62-4335-b53a-ad3f73fbee51" containerName="maas-api"
Sep 19 15:35:45.008105 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.008023    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab8c2c57-ce62-4335-b53a-ad3f73fbee51" containerName="maas-api"
Sep 19 15:35:45.008576 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.008133    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab8c2c57-ce62-4335-b53a-ad3f73fbee51" containerName="maas-api"
Sep 19 15:35:45.008576 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.008146    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9719864-ad32-4338-9a2e-54d9f190d3b4" containerName="maas-api"
Sep 19 15:35:45.008576 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.008155    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="00450006-f1b2-4e70-81ee-1e9911df9c36" containerName="payload-pre-processing"
Sep 19 15:35:45.008576 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.008166    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="955a87c9-c90e-4034-b0ea-a52666760677" containerName="maas-api"
Sep 19 15:35:45.008576 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.008179    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="96d4dcc8-4ddc-41f1-a3d2-b8cba3b825d0" containerName="payload-processing"
Sep 19 15:35:45.008576 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.008190    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ab53d55-1d3a-47cc-bd44-ef78a9f7e8a2" containerName="payload-processing"
Sep 19 15:35:45.011804 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.011779    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.014003 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.013979    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-50372a-openshift-default-dockercfg-8jbwv\""
Sep 19 15:35:45.022664 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.022613    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"]
Sep 19 15:35:45.163325 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.163287    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-istio-envoy\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.163325 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.163327    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-credential-socket\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.163599 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.163358    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnzlx\" (UniqueName: \"kubernetes.io/projected/25adf7ff-22b9-449b-8456-99a1deef1558-kube-api-access-cnzlx\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.163599 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.163450    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-workload-socket\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.163599 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.163514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-istio-data\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.163599 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.163539    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25adf7ff-22b9-449b-8456-99a1deef1558-istio-podinfo\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.163768 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.163603    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25adf7ff-22b9-449b-8456-99a1deef1558-istio-token\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.163768 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.163681    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25adf7ff-22b9-449b-8456-99a1deef1558-istiod-ca-cert\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.163768 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.163743    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-workload-certs\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.264607 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.264508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25adf7ff-22b9-449b-8456-99a1deef1558-istio-token\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.264607 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.264559    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25adf7ff-22b9-449b-8456-99a1deef1558-istiod-ca-cert\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.264607 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.264591    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-workload-certs\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.264938 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.264613    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-istio-envoy\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.264938 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.264630    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-credential-socket\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.264938 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.264649    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnzlx\" (UniqueName: \"kubernetes.io/projected/25adf7ff-22b9-449b-8456-99a1deef1558-kube-api-access-cnzlx\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.264938 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.264836    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-workload-socket\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.265148 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.265051    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-workload-certs\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.265187 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.265143    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-workload-socket\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.265283 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.265263    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-istio-data\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.265347 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.265298    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25adf7ff-22b9-449b-8456-99a1deef1558-istio-podinfo\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.265395 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.265376    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-credential-socket\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.265441 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.265415    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25adf7ff-22b9-449b-8456-99a1deef1558-istiod-ca-cert\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.265758 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.265731    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-istio-data\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.267243 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.267212    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-istio-envoy\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.267687 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.267667    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25adf7ff-22b9-449b-8456-99a1deef1558-istio-podinfo\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.279508 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.279484    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25adf7ff-22b9-449b-8456-99a1deef1558-istio-token\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.280233 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.280208    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnzlx\" (UniqueName: \"kubernetes.io/projected/25adf7ff-22b9-449b-8456-99a1deef1558-kube-api-access-cnzlx\") pod \"e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") " pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.326152 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.326106    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:45.619476 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.619449    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"]
Sep 19 15:35:45.621037 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:35:45.621011    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25adf7ff_22b9_449b_8456_99a1deef1558.slice/crio-c5d0a77d10ff33fec3b4eca81d85ee708fc060810fc13182adafcdc731e62b1b WatchSource:0}: Error finding container c5d0a77d10ff33fec3b4eca81d85ee708fc060810fc13182adafcdc731e62b1b: Status 404 returned error can't find the container with id c5d0a77d10ff33fec3b4eca81d85ee708fc060810fc13182adafcdc731e62b1b
Sep 19 15:35:45.623432 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.623399    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:35:45.623528 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.623463    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:35:45.623528 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.623491    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:35:45.696453 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.696074    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft" event={"ID":"3cf0598d-00ba-45e9-b85f-aa78e021d9c7","Type":"ContainerStarted","Data":"b5c0f905922ae607a1ac0b2dc62485d35bec79d71925fc832aede2a978e15361"}
Sep 19 15:35:45.699323 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.699182    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb" event={"ID":"25adf7ff-22b9-449b-8456-99a1deef1558","Type":"ContainerStarted","Data":"c5d0a77d10ff33fec3b4eca81d85ee708fc060810fc13182adafcdc731e62b1b"}
Sep 19 15:35:45.720466 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.720432    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:45.720724 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.720625    2563 patch_prober.go:28] interesting pod/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 19 15:35:45.720724 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:45.720672    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft" podUID="3cf0598d-00ba-45e9-b85f-aa78e021d9c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 19 15:35:46.710037 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:46.709997    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb" event={"ID":"25adf7ff-22b9-449b-8456-99a1deef1558","Type":"ContainerStarted","Data":"c74785b4184d67ca21dbe48c9913f546d7db28885460bdce3005ffb86a966529"}
Sep 19 15:35:46.720600 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:46.720568    2563 patch_prober.go:28] interesting pod/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 19 15:35:46.720748 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:46.720622    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft" podUID="3cf0598d-00ba-45e9-b85f-aa78e021d9c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 19 15:35:46.731214 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:46.731163    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb" podStartSLOduration=2.731147082 podStartE2EDuration="2.731147082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:35:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:35:46.729423901 +0000 UTC m=+1421.618623627" watchObservedRunningTime="2026-09-19 15:35:46.731147082 +0000 UTC m=+1421.620346795"
Sep 19 15:35:47.327078 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:47.327040    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:47.332927 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:47.332870    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:47.718520 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:47.718488    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:47.719517 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:47.719499    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:35:47.720687 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:47.720667    2563 patch_prober.go:28] interesting pod/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 19 15:35:47.720754 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:47.720712    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft" podUID="3cf0598d-00ba-45e9-b85f-aa78e021d9c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 19 15:35:48.720787 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:48.720753    2563 patch_prober.go:28] interesting pod/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 19 15:35:48.721299 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:48.720830    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft" podUID="3cf0598d-00ba-45e9-b85f-aa78e021d9c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 19 15:35:49.411920 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:49.406601    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"]
Sep 19 15:35:49.411920 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:49.406840    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft" podUID="3cf0598d-00ba-45e9-b85f-aa78e021d9c7" containerName="istio-proxy" containerID="cri-o://b5c0f905922ae607a1ac0b2dc62485d35bec79d71925fc832aede2a978e15361" gracePeriod=30
Sep 19 15:35:50.774473 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:50.774431    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"]
Sep 19 15:35:50.786497 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:50.786467    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"
Sep 19 15:35:50.789429 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:50.789402    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-50372a-serving-cert\""
Sep 19 15:35:50.805202 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:50.805166    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"]
Sep 19 15:35:50.936313 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:50.936241    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/153d5b94-f0c7-4296-b5af-4f5f85878cf2-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss\" (UID: \"153d5b94-f0c7-4296-b5af-4f5f85878cf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"
Sep 19 15:35:50.936313 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:50.936286    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/153d5b94-f0c7-4296-b5af-4f5f85878cf2-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss\" (UID: \"153d5b94-f0c7-4296-b5af-4f5f85878cf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"
Sep 19 15:35:50.936534 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:50.936346    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/153d5b94-f0c7-4296-b5af-4f5f85878cf2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss\" (UID: \"153d5b94-f0c7-4296-b5af-4f5f85878cf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"
Sep 19 15:35:50.936534 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:50.936415    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pngb\" (UniqueName: \"kubernetes.io/projected/153d5b94-f0c7-4296-b5af-4f5f85878cf2-kube-api-access-7pngb\") pod \"maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss\" (UID: \"153d5b94-f0c7-4296-b5af-4f5f85878cf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"
Sep 19 15:35:51.037639 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.037534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/153d5b94-f0c7-4296-b5af-4f5f85878cf2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss\" (UID: \"153d5b94-f0c7-4296-b5af-4f5f85878cf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"
Sep 19 15:35:51.037639 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.037588    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pngb\" (UniqueName: \"kubernetes.io/projected/153d5b94-f0c7-4296-b5af-4f5f85878cf2-kube-api-access-7pngb\") pod \"maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss\" (UID: \"153d5b94-f0c7-4296-b5af-4f5f85878cf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"
Sep 19 15:35:51.037909 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.037694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/153d5b94-f0c7-4296-b5af-4f5f85878cf2-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss\" (UID: \"153d5b94-f0c7-4296-b5af-4f5f85878cf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"
Sep 19 15:35:51.037909 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.037731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/153d5b94-f0c7-4296-b5af-4f5f85878cf2-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss\" (UID: \"153d5b94-f0c7-4296-b5af-4f5f85878cf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"
Sep 19 15:35:51.038335 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.038310    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/153d5b94-f0c7-4296-b5af-4f5f85878cf2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss\" (UID: \"153d5b94-f0c7-4296-b5af-4f5f85878cf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"
Sep 19 15:35:51.040455 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.040423    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/153d5b94-f0c7-4296-b5af-4f5f85878cf2-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss\" (UID: \"153d5b94-f0c7-4296-b5af-4f5f85878cf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"
Sep 19 15:35:51.040554 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.040468    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/153d5b94-f0c7-4296-b5af-4f5f85878cf2-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss\" (UID: \"153d5b94-f0c7-4296-b5af-4f5f85878cf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"
Sep 19 15:35:51.044790 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.044763    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pngb\" (UniqueName: \"kubernetes.io/projected/153d5b94-f0c7-4296-b5af-4f5f85878cf2-kube-api-access-7pngb\") pod \"maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss\" (UID: \"153d5b94-f0c7-4296-b5af-4f5f85878cf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"
Sep 19 15:35:51.121106 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.121074    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"
Sep 19 15:35:51.403778 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.403745    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"]
Sep 19 15:35:51.405644 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:35:51.405616    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod153d5b94_f0c7_4296_b5af_4f5f85878cf2.slice/crio-3bfa556ab77ee2a6497a2f3521884acc0814bc77cf29e908d0f2aaedb79296be WatchSource:0}: Error finding container 3bfa556ab77ee2a6497a2f3521884acc0814bc77cf29e908d0f2aaedb79296be: Status 404 returned error can't find the container with id 3bfa556ab77ee2a6497a2f3521884acc0814bc77cf29e908d0f2aaedb79296be
Sep 19 15:35:51.454594 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.454563    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t"]
Sep 19 15:35:51.459643 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.459626    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t"
Sep 19 15:35:51.461645 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.461623    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-50372a\""
Sep 19 15:35:51.461773 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.461706    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-50372a-dockercfg-q7zzw\""
Sep 19 15:35:51.472602 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.472573    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t"]
Sep 19 15:35:51.501094 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.501065    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz"]
Sep 19 15:35:51.504603 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.504588    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz"
Sep 19 15:35:51.516480 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.516453    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz"]
Sep 19 15:35:51.643039 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.643006    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtlkk\" (UniqueName: \"kubernetes.io/projected/045b6834-4806-41ab-932f-e7eeb786ef2a-kube-api-access-vtlkk\") pod \"payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t\" (UID: \"045b6834-4806-41ab-932f-e7eeb786ef2a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t"
Sep 19 15:35:51.643235 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.643071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/045b6834-4806-41ab-932f-e7eeb786ef2a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t\" (UID: \"045b6834-4806-41ab-932f-e7eeb786ef2a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t"
Sep 19 15:35:51.643235 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.643146    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fa503d6-642c-40d7-9968-01b21e0d477f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz\" (UID: \"9fa503d6-642c-40d7-9968-01b21e0d477f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz"
Sep 19 15:35:51.643337 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.643254    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v8xw\" (UniqueName: \"kubernetes.io/projected/9fa503d6-642c-40d7-9968-01b21e0d477f-kube-api-access-2v8xw\") pod \"payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz\" (UID: \"9fa503d6-642c-40d7-9968-01b21e0d477f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz"
Sep 19 15:35:51.744319 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.744289    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/045b6834-4806-41ab-932f-e7eeb786ef2a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t\" (UID: \"045b6834-4806-41ab-932f-e7eeb786ef2a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t"
Sep 19 15:35:51.744503 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.744358    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fa503d6-642c-40d7-9968-01b21e0d477f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz\" (UID: \"9fa503d6-642c-40d7-9968-01b21e0d477f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz"
Sep 19 15:35:51.744503 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.744419    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v8xw\" (UniqueName: \"kubernetes.io/projected/9fa503d6-642c-40d7-9968-01b21e0d477f-kube-api-access-2v8xw\") pod \"payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz\" (UID: \"9fa503d6-642c-40d7-9968-01b21e0d477f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz"
Sep 19 15:35:51.744503 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.744480    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtlkk\" (UniqueName: \"kubernetes.io/projected/045b6834-4806-41ab-932f-e7eeb786ef2a-kube-api-access-vtlkk\") pod \"payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t\" (UID: \"045b6834-4806-41ab-932f-e7eeb786ef2a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t"
Sep 19 15:35:51.745133 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.745114    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/045b6834-4806-41ab-932f-e7eeb786ef2a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t\" (UID: \"045b6834-4806-41ab-932f-e7eeb786ef2a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t"
Sep 19 15:35:51.745234 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.745212    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fa503d6-642c-40d7-9968-01b21e0d477f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz\" (UID: \"9fa503d6-642c-40d7-9968-01b21e0d477f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz"
Sep 19 15:35:51.747528 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.747500    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss" event={"ID":"153d5b94-f0c7-4296-b5af-4f5f85878cf2","Type":"ContainerStarted","Data":"3bfa556ab77ee2a6497a2f3521884acc0814bc77cf29e908d0f2aaedb79296be"}
Sep 19 15:35:51.752863 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.752836    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v8xw\" (UniqueName: \"kubernetes.io/projected/9fa503d6-642c-40d7-9968-01b21e0d477f-kube-api-access-2v8xw\") pod \"payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz\" (UID: \"9fa503d6-642c-40d7-9968-01b21e0d477f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz"
Sep 19 15:35:51.752975 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.752957    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtlkk\" (UniqueName: \"kubernetes.io/projected/045b6834-4806-41ab-932f-e7eeb786ef2a-kube-api-access-vtlkk\") pod \"payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t\" (UID: \"045b6834-4806-41ab-932f-e7eeb786ef2a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t"
Sep 19 15:35:51.778719 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.778683    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t"
Sep 19 15:35:51.814989 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:51.814967    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz"
Sep 19 15:35:52.061646 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:52.061616    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t"]
Sep 19 15:35:52.062600 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:35:52.062568    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod045b6834_4806_41ab_932f_e7eeb786ef2a.slice/crio-93edd9d7436daf08d8bcfb576d1aeeb86833b0dc55dfc77ac2f73395a7b244c5 WatchSource:0}: Error finding container 93edd9d7436daf08d8bcfb576d1aeeb86833b0dc55dfc77ac2f73395a7b244c5: Status 404 returned error can't find the container with id 93edd9d7436daf08d8bcfb576d1aeeb86833b0dc55dfc77ac2f73395a7b244c5
Sep 19 15:35:52.110058 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:52.110009    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz"]
Sep 19 15:35:52.111176 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:35:52.111145    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa503d6_642c_40d7_9968_01b21e0d477f.slice/crio-ff2a70272eb822c2df9a82574b184db60e4acda48c688983715798a25e635996 WatchSource:0}: Error finding container ff2a70272eb822c2df9a82574b184db60e4acda48c688983715798a25e635996: Status 404 returned error can't find the container with id ff2a70272eb822c2df9a82574b184db60e4acda48c688983715798a25e635996
Sep 19 15:35:52.755095 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:52.755020    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t" event={"ID":"045b6834-4806-41ab-932f-e7eeb786ef2a","Type":"ContainerStarted","Data":"efab4c9d24c3beac10c3cc6c9850ea4441a564b08cc148e80248998195e7f0e8"}
Sep 19 15:35:52.755095 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:52.755092    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t" event={"ID":"045b6834-4806-41ab-932f-e7eeb786ef2a","Type":"ContainerStarted","Data":"93edd9d7436daf08d8bcfb576d1aeeb86833b0dc55dfc77ac2f73395a7b244c5"}
Sep 19 15:35:52.755603 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:52.755212    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t"
Sep 19 15:35:52.756886 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:52.756858    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss" event={"ID":"153d5b94-f0c7-4296-b5af-4f5f85878cf2","Type":"ContainerStarted","Data":"d241b08011e4f678bd0d628e0014cee05391d2c6d1d6f13a0000c3effc59b1eb"}
Sep 19 15:35:52.757051 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:52.756940    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"
Sep 19 15:35:52.758604 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:52.758570    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz" event={"ID":"9fa503d6-642c-40d7-9968-01b21e0d477f","Type":"ContainerStarted","Data":"c1a50e560d2e93d483575a8bead648f16759e1fb98730d2915cf51119613bc99"}
Sep 19 15:35:52.758716 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:52.758617    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz"
Sep 19 15:35:52.758716 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:52.758635    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz" event={"ID":"9fa503d6-642c-40d7-9968-01b21e0d477f","Type":"ContainerStarted","Data":"ff2a70272eb822c2df9a82574b184db60e4acda48c688983715798a25e635996"}
Sep 19 15:35:52.772769 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:52.772721    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t" podStartSLOduration=1.772707762 podStartE2EDuration="1.772707762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:35:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:35:52.769240615 +0000 UTC m=+1427.658440332" watchObservedRunningTime="2026-09-19 15:35:52.772707762 +0000 UTC m=+1427.661907479"
Sep 19 15:35:52.786186 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:52.786131    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz" podStartSLOduration=1.7861111219999999 podStartE2EDuration="1.786111122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:35:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:35:52.782702031 +0000 UTC m=+1427.671901743" watchObservedRunningTime="2026-09-19 15:35:52.786111122 +0000 UTC m=+1427.675310834"
Sep 19 15:35:52.800121 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:52.800075    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss" podStartSLOduration=2.394357549 podStartE2EDuration="2.800059255s" totalImagesPullingTime="405.701706ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:35:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:35:52.798318546 +0000 UTC m=+1427.687518260" watchObservedRunningTime="2026-09-19 15:35:52.800059255 +0000 UTC m=+1427.689258968"
Sep 19 15:35:55.403506 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:55.403468    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:56.365941 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.365912    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:56.391870 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.391840    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-workload-socket\") pod \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") "
Sep 19 15:35:56.392032 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.391886    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-envoy\") pod \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") "
Sep 19 15:35:56.392032 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.391946    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-workload-certs\") pod \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") "
Sep 19 15:35:56.392032 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.391967    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-credential-socket\") pod \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") "
Sep 19 15:35:56.392032 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.392019    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-token\") pod \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") "
Sep 19 15:35:56.392231 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.392069    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdftp\" (UniqueName: \"kubernetes.io/projected/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-kube-api-access-qdftp\") pod \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") "
Sep 19 15:35:56.392231 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.392093    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istiod-ca-cert\") pod \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") "
Sep 19 15:35:56.392231 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.392156    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3cf0598d-00ba-45e9-b85f-aa78e021d9c7" (UID: "3cf0598d-00ba-45e9-b85f-aa78e021d9c7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:35:56.392383 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.392293    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3cf0598d-00ba-45e9-b85f-aa78e021d9c7" (UID: "3cf0598d-00ba-45e9-b85f-aa78e021d9c7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:35:56.392383 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.392325    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-podinfo\") pod \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") "
Sep 19 15:35:56.392481 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.392313    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3cf0598d-00ba-45e9-b85f-aa78e021d9c7" (UID: "3cf0598d-00ba-45e9-b85f-aa78e021d9c7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:35:56.392481 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.392448    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-data\") pod \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\" (UID: \"3cf0598d-00ba-45e9-b85f-aa78e021d9c7\") "
Sep 19 15:35:56.392837 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.392815    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-workload-socket\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:56.392956 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.392839    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-workload-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:56.392956 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.392853    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-credential-socket\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:56.392956 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.392855    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-data" (OuterVolumeSpecName: "istio-data") pod "3cf0598d-00ba-45e9-b85f-aa78e021d9c7" (UID: "3cf0598d-00ba-45e9-b85f-aa78e021d9c7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:35:56.392956 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.392865    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3cf0598d-00ba-45e9-b85f-aa78e021d9c7" (UID: "3cf0598d-00ba-45e9-b85f-aa78e021d9c7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:35:56.394883 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.394847    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-kube-api-access-qdftp" (OuterVolumeSpecName: "kube-api-access-qdftp") pod "3cf0598d-00ba-45e9-b85f-aa78e021d9c7" (UID: "3cf0598d-00ba-45e9-b85f-aa78e021d9c7"). InnerVolumeSpecName "kube-api-access-qdftp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:35:56.395021 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.394927    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3cf0598d-00ba-45e9-b85f-aa78e021d9c7" (UID: "3cf0598d-00ba-45e9-b85f-aa78e021d9c7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:35:56.395021 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.394987    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-token" (OuterVolumeSpecName: "istio-token") pod "3cf0598d-00ba-45e9-b85f-aa78e021d9c7" (UID: "3cf0598d-00ba-45e9-b85f-aa78e021d9c7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:35:56.395137 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.395028    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3cf0598d-00ba-45e9-b85f-aa78e021d9c7" (UID: "3cf0598d-00ba-45e9-b85f-aa78e021d9c7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 15:35:56.494284 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.494201    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-data\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:56.494284 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.494231    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-envoy\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:56.494284 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.494240    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-token\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:56.494284 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.494249    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdftp\" (UniqueName: \"kubernetes.io/projected/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-kube-api-access-qdftp\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:56.494284 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.494257    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istiod-ca-cert\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:56.494284 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.494265    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf0598d-00ba-45e9-b85f-aa78e021d9c7-istio-podinfo\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:35:56.786775 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.786658    2563 generic.go:356] "Generic (PLEG): container finished" podID="3cf0598d-00ba-45e9-b85f-aa78e021d9c7" containerID="b5c0f905922ae607a1ac0b2dc62485d35bec79d71925fc832aede2a978e15361" exitCode=0
Sep 19 15:35:56.786775 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.786704    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"
Sep 19 15:35:56.786775 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.786715    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft" event={"ID":"3cf0598d-00ba-45e9-b85f-aa78e021d9c7","Type":"ContainerDied","Data":"b5c0f905922ae607a1ac0b2dc62485d35bec79d71925fc832aede2a978e15361"}
Sep 19 15:35:56.786775 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.786756    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft" event={"ID":"3cf0598d-00ba-45e9-b85f-aa78e021d9c7","Type":"ContainerDied","Data":"526e94d894cfab9ac0fd35fb0354bbb82e685030fe76f48a3d295f24431d71f7"}
Sep 19 15:35:56.786775 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.786779    2563 scope.go:117] "RemoveContainer" containerID="b5c0f905922ae607a1ac0b2dc62485d35bec79d71925fc832aede2a978e15361"
Sep 19 15:35:56.797698 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.797677    2563 scope.go:117] "RemoveContainer" containerID="aa6a6d2ded70c45bb22c44f0800a3e46d87044b84938103364181369d2bc8728"
Sep 19 15:35:56.806551 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.806532    2563 scope.go:117] "RemoveContainer" containerID="b5c0f905922ae607a1ac0b2dc62485d35bec79d71925fc832aede2a978e15361"
Sep 19 15:35:56.806830 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:35:56.806810    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5c0f905922ae607a1ac0b2dc62485d35bec79d71925fc832aede2a978e15361\": container with ID starting with b5c0f905922ae607a1ac0b2dc62485d35bec79d71925fc832aede2a978e15361 not found: ID does not exist" containerID="b5c0f905922ae607a1ac0b2dc62485d35bec79d71925fc832aede2a978e15361"
Sep 19 15:35:56.806877 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.806838    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5c0f905922ae607a1ac0b2dc62485d35bec79d71925fc832aede2a978e15361"} err="failed to get container status \"b5c0f905922ae607a1ac0b2dc62485d35bec79d71925fc832aede2a978e15361\": rpc error: code = NotFound desc = could not find container \"b5c0f905922ae607a1ac0b2dc62485d35bec79d71925fc832aede2a978e15361\": container with ID starting with b5c0f905922ae607a1ac0b2dc62485d35bec79d71925fc832aede2a978e15361 not found: ID does not exist"
Sep 19 15:35:56.806877 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.806856    2563 scope.go:117] "RemoveContainer" containerID="aa6a6d2ded70c45bb22c44f0800a3e46d87044b84938103364181369d2bc8728"
Sep 19 15:35:56.807170 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:35:56.807149    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa6a6d2ded70c45bb22c44f0800a3e46d87044b84938103364181369d2bc8728\": container with ID starting with aa6a6d2ded70c45bb22c44f0800a3e46d87044b84938103364181369d2bc8728 not found: ID does not exist" containerID="aa6a6d2ded70c45bb22c44f0800a3e46d87044b84938103364181369d2bc8728"
Sep 19 15:35:56.807215 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.807176    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa6a6d2ded70c45bb22c44f0800a3e46d87044b84938103364181369d2bc8728"} err="failed to get container status \"aa6a6d2ded70c45bb22c44f0800a3e46d87044b84938103364181369d2bc8728\": rpc error: code = NotFound desc = could not find container \"aa6a6d2ded70c45bb22c44f0800a3e46d87044b84938103364181369d2bc8728\": container with ID starting with aa6a6d2ded70c45bb22c44f0800a3e46d87044b84938103364181369d2bc8728 not found: ID does not exist"
Sep 19 15:35:56.812169 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.812145    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"]
Sep 19 15:35:56.819777 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:56.819756    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft"]
Sep 19 15:35:57.641667 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:57.641637    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cf0598d-00ba-45e9-b85f-aa78e021d9c7" path="/var/lib/kubelet/pods/3cf0598d-00ba-45e9-b85f-aa78e021d9c7/volumes"
Sep 19 15:35:58.771005 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:35:58.770968    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"
Sep 19 15:36:03.766812 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:03.766778    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t"
Sep 19 15:36:03.767247 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:03.766855    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz"
Sep 19 15:36:09.890681 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:09.890631    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"]
Sep 19 15:36:09.891398 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:09.891343    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf0598d-00ba-45e9-b85f-aa78e021d9c7" containerName="istio-proxy"
Sep 19 15:36:09.891398 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:09.891369    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf0598d-00ba-45e9-b85f-aa78e021d9c7" containerName="istio-proxy"
Sep 19 15:36:09.891398 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:09.891387    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf0598d-00ba-45e9-b85f-aa78e021d9c7" containerName="istio-proxy"
Sep 19 15:36:09.891398 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:09.891395    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf0598d-00ba-45e9-b85f-aa78e021d9c7" containerName="istio-proxy"
Sep 19 15:36:09.913429 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:09.891559    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cf0598d-00ba-45e9-b85f-aa78e021d9c7" containerName="istio-proxy"
Sep 19 15:36:09.913429 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:09.897187    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"
Sep 19 15:36:09.913429 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:09.900046    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w1-c8e1cf-serving-cert\""
Sep 19 15:36:09.917538 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:09.917505    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"]
Sep 19 15:36:10.027592 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:10.027558    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb88e07a-f6f1-450a-9db5-03384b6a58c2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h\" (UID: \"fb88e07a-f6f1-450a-9db5-03384b6a58c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"
Sep 19 15:36:10.027767 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:10.027639    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb88e07a-f6f1-450a-9db5-03384b6a58c2-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h\" (UID: \"fb88e07a-f6f1-450a-9db5-03384b6a58c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"
Sep 19 15:36:10.027767 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:10.027689    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb88e07a-f6f1-450a-9db5-03384b6a58c2-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h\" (UID: \"fb88e07a-f6f1-450a-9db5-03384b6a58c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"
Sep 19 15:36:10.027870 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:10.027767    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t2kr\" (UniqueName: \"kubernetes.io/projected/fb88e07a-f6f1-450a-9db5-03384b6a58c2-kube-api-access-6t2kr\") pod \"maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h\" (UID: \"fb88e07a-f6f1-450a-9db5-03384b6a58c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"
Sep 19 15:36:10.128764 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:10.128720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb88e07a-f6f1-450a-9db5-03384b6a58c2-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h\" (UID: \"fb88e07a-f6f1-450a-9db5-03384b6a58c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"
Sep 19 15:36:10.129017 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:10.128773    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb88e07a-f6f1-450a-9db5-03384b6a58c2-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h\" (UID: \"fb88e07a-f6f1-450a-9db5-03384b6a58c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"
Sep 19 15:36:10.129017 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:10.128850    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t2kr\" (UniqueName: \"kubernetes.io/projected/fb88e07a-f6f1-450a-9db5-03384b6a58c2-kube-api-access-6t2kr\") pod \"maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h\" (UID: \"fb88e07a-f6f1-450a-9db5-03384b6a58c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"
Sep 19 15:36:10.129017 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:36:10.128885    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-serving-cert: secret "maas-api-e2e-shared-a-w1-c8e1cf-serving-cert" not found
Sep 19 15:36:10.129017 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:10.128929    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb88e07a-f6f1-450a-9db5-03384b6a58c2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h\" (UID: \"fb88e07a-f6f1-450a-9db5-03384b6a58c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"
Sep 19 15:36:10.129252 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:36:10.129024    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb88e07a-f6f1-450a-9db5-03384b6a58c2-maas-api-tls podName:fb88e07a-f6f1-450a-9db5-03384b6a58c2 nodeName:}" failed. No retries permitted until 2026-09-19 15:36:10.629003576 +0000 UTC m=+1445.518203293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fb88e07a-f6f1-450a-9db5-03384b6a58c2-maas-api-tls") pod "maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h" (UID: "fb88e07a-f6f1-450a-9db5-03384b6a58c2") : secret "maas-api-e2e-shared-a-w1-c8e1cf-serving-cert" not found
Sep 19 15:36:10.129612 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:10.129588    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb88e07a-f6f1-450a-9db5-03384b6a58c2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h\" (UID: \"fb88e07a-f6f1-450a-9db5-03384b6a58c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"
Sep 19 15:36:10.131492 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:10.131471    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb88e07a-f6f1-450a-9db5-03384b6a58c2-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h\" (UID: \"fb88e07a-f6f1-450a-9db5-03384b6a58c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"
Sep 19 15:36:10.139732 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:10.139711    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t2kr\" (UniqueName: \"kubernetes.io/projected/fb88e07a-f6f1-450a-9db5-03384b6a58c2-kube-api-access-6t2kr\") pod \"maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h\" (UID: \"fb88e07a-f6f1-450a-9db5-03384b6a58c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"
Sep 19 15:36:10.633693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:10.633652    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb88e07a-f6f1-450a-9db5-03384b6a58c2-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h\" (UID: \"fb88e07a-f6f1-450a-9db5-03384b6a58c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"
Sep 19 15:36:10.636294 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:10.636268    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb88e07a-f6f1-450a-9db5-03384b6a58c2-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h\" (UID: \"fb88e07a-f6f1-450a-9db5-03384b6a58c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"
Sep 19 15:36:10.821409 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:10.821371    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"
Sep 19 15:36:11.106498 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:11.106466    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"]
Sep 19 15:36:11.107587 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:36:11.107548    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb88e07a_f6f1_450a_9db5_03384b6a58c2.slice/crio-ff613631518a27550d16cf8d523526ef6803911639d4338229772321b3b54e80 WatchSource:0}: Error finding container ff613631518a27550d16cf8d523526ef6803911639d4338229772321b3b54e80: Status 404 returned error can't find the container with id ff613631518a27550d16cf8d523526ef6803911639d4338229772321b3b54e80
Sep 19 15:36:11.931230 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:11.931198    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h" event={"ID":"fb88e07a-f6f1-450a-9db5-03384b6a58c2","Type":"ContainerStarted","Data":"5e506fdf9e7ac605aa6ae9f0976b0a154b725e2fc1760a2c4ecf267fb94800ce"}
Sep 19 15:36:11.931414 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:11.931263    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"
Sep 19 15:36:11.931414 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:11.931280    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h" event={"ID":"fb88e07a-f6f1-450a-9db5-03384b6a58c2","Type":"ContainerStarted","Data":"ff613631518a27550d16cf8d523526ef6803911639d4338229772321b3b54e80"}
Sep 19 15:36:11.949386 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:11.949330    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h" podStartSLOduration=2.601023367 podStartE2EDuration="2.9493118s" totalImagesPullingTime="348.288433ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:36:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:36:11.947491506 +0000 UTC m=+1446.836691241" watchObservedRunningTime="2026-09-19 15:36:11.9493118 +0000 UTC m=+1446.838511514"
Sep 19 15:36:14.119084 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.119043    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"]
Sep 19 15:36:14.119752 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.119730    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cf0598d-00ba-45e9-b85f-aa78e021d9c7" containerName="istio-proxy"
Sep 19 15:36:14.123190 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.123168    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.125564 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.125546    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-f9c5c2-openshift-default-dockercfg-c6l6p\""
Sep 19 15:36:14.134682 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.134655    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"]
Sep 19 15:36:14.171194 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.171145    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-token\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.171365 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.171213    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-credential-socket\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.171365 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.171275    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4db1e571-acde-4ae3-903a-444ea2e57a39-istiod-ca-cert\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.171365 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.171338    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-podinfo\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.171581 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.171382    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-envoy\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.171581 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.171418    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-data\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.171581 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.171505    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-workload-socket\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.171581 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.171534    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm7h5\" (UniqueName: \"kubernetes.io/projected/4db1e571-acde-4ae3-903a-444ea2e57a39-kube-api-access-bm7h5\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.171581 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.171556    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-workload-certs\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.272369 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.272336    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-data\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.272544 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.272395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-workload-socket\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.272642 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.272629    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm7h5\" (UniqueName: \"kubernetes.io/projected/4db1e571-acde-4ae3-903a-444ea2e57a39-kube-api-access-bm7h5\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.272698 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.272674    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-workload-certs\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.272698 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.272693    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-token\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.272787 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.272727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-credential-socket\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.272787 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.272766    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-data\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.272787 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.272779    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4db1e571-acde-4ae3-903a-444ea2e57a39-istiod-ca-cert\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.272962 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.272851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-podinfo\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.272962 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.272860    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-workload-socket\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.272962 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.272884    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-envoy\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.273156 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.273138    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-workload-certs\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.273294 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.273273    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-credential-socket\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.273435 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.273418    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4db1e571-acde-4ae3-903a-444ea2e57a39-istiod-ca-cert\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.275364 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.275336    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-envoy\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.275563 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.275543    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-podinfo\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.281020 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.280998    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-token\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.281139 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.281042    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm7h5\" (UniqueName: \"kubernetes.io/projected/4db1e571-acde-4ae3-903a-444ea2e57a39-kube-api-access-bm7h5\") pod \"e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") " pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.435957 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.435923    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:14.730812 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.730749    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"]
Sep 19 15:36:14.731356 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:36:14.731328    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4db1e571_acde_4ae3_903a_444ea2e57a39.slice/crio-317046d0369aedbae6e3da2f827716cac770039db414aeaf21f71dd6c05b2ffe WatchSource:0}: Error finding container 317046d0369aedbae6e3da2f827716cac770039db414aeaf21f71dd6c05b2ffe: Status 404 returned error can't find the container with id 317046d0369aedbae6e3da2f827716cac770039db414aeaf21f71dd6c05b2ffe
Sep 19 15:36:14.734911 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.734658    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:36:14.734911 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.734743    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:36:14.734911 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.734814    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:36:14.956284 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.956240    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h" event={"ID":"4db1e571-acde-4ae3-903a-444ea2e57a39","Type":"ContainerStarted","Data":"24f483c5474560fcde351ad436db23b2007aa2c60bda3908c7baf02a60e9ef45"}
Sep 19 15:36:14.956597 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.956309    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h" event={"ID":"4db1e571-acde-4ae3-903a-444ea2e57a39","Type":"ContainerStarted","Data":"317046d0369aedbae6e3da2f827716cac770039db414aeaf21f71dd6c05b2ffe"}
Sep 19 15:36:14.977865 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:14.977750    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h" podStartSLOduration=0.977728344 podStartE2EDuration="977.728344ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:36:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:36:14.973483367 +0000 UTC m=+1449.862683115" watchObservedRunningTime="2026-09-19 15:36:14.977728344 +0000 UTC m=+1449.866928058"
Sep 19 15:36:15.436104 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:15.436064    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:15.441759 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:15.441729    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:15.971346 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:15.971311    2563 generic.go:356] "Generic (PLEG): container finished" podID="25adf7ff-22b9-449b-8456-99a1deef1558" containerID="c74785b4184d67ca21dbe48c9913f546d7db28885460bdce3005ffb86a966529" exitCode=0
Sep 19 15:36:15.971552 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:15.971394    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb" event={"ID":"25adf7ff-22b9-449b-8456-99a1deef1558","Type":"ContainerDied","Data":"c74785b4184d67ca21dbe48c9913f546d7db28885460bdce3005ffb86a966529"}
Sep 19 15:36:15.971838 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:15.971816    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:15.972073 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:15.972054    2563 scope.go:117] "RemoveContainer" containerID="c74785b4184d67ca21dbe48c9913f546d7db28885460bdce3005ffb86a966529"
Sep 19 15:36:15.973209 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:15.973055    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:15.973303 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:15.973210    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:36:15.973303 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:15.973271    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:36:15.973303 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:15.973300    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:36:16.982500 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:16.982458    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb" event={"ID":"25adf7ff-22b9-449b-8456-99a1deef1558","Type":"ContainerStarted","Data":"e3925414e1afa59d3e0566ca1579dbe2f1e4a0e9ccca72eeb61f3744112fab3d"}
Sep 19 15:36:17.326342 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:17.326253    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:36:17.327347 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:17.327324    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 19 15:36:17.327417 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:17.327383    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb" podUID="25adf7ff-22b9-449b-8456-99a1deef1558" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 19 15:36:17.719462 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:17.719423    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:36:17.944863 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:17.944837    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"
Sep 19 15:36:18.327259 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:18.327223    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 19 15:36:18.327674 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:18.327277    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb" podUID="25adf7ff-22b9-449b-8456-99a1deef1558" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 19 15:36:19.326722 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:19.326685    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 19 15:36:19.326944 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:19.326741    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb" podUID="25adf7ff-22b9-449b-8456-99a1deef1558" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 19 15:36:20.326705 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:20.326666    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 19 15:36:20.327135 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:20.326733    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb" podUID="25adf7ff-22b9-449b-8456-99a1deef1558" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 19 15:36:20.645964 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:20.645848    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"]
Sep 19 15:36:20.651554 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:20.651516    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"
Sep 19 15:36:20.653663 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:20.653634    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-f9c5c2-serving-cert\""
Sep 19 15:36:20.659228 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:20.659205    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"]
Sep 19 15:36:20.738567 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:20.738528    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glkcs\" (UniqueName: \"kubernetes.io/projected/194098ee-e6b4-454c-947f-214580634bff-kube-api-access-glkcs\") pod \"maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn\" (UID: \"194098ee-e6b4-454c-947f-214580634bff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"
Sep 19 15:36:20.738734 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:20.738637    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/194098ee-e6b4-454c-947f-214580634bff-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn\" (UID: \"194098ee-e6b4-454c-947f-214580634bff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"
Sep 19 15:36:20.738734 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:20.738653    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/194098ee-e6b4-454c-947f-214580634bff-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn\" (UID: \"194098ee-e6b4-454c-947f-214580634bff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"
Sep 19 15:36:20.738734 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:20.738672    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/194098ee-e6b4-454c-947f-214580634bff-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn\" (UID: \"194098ee-e6b4-454c-947f-214580634bff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"
Sep 19 15:36:20.839953 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:20.839887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/194098ee-e6b4-454c-947f-214580634bff-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn\" (UID: \"194098ee-e6b4-454c-947f-214580634bff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"
Sep 19 15:36:20.840150 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:36:20.840040    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-serving-cert: secret "maas-api-e2e-shared-b-w2-f9c5c2-serving-cert" not found
Sep 19 15:36:20.840150 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:36:20.840100    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/194098ee-e6b4-454c-947f-214580634bff-maas-api-tls podName:194098ee-e6b4-454c-947f-214580634bff nodeName:}" failed. No retries permitted until 2026-09-19 15:36:21.340085032 +0000 UTC m=+1456.229284728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/194098ee-e6b4-454c-947f-214580634bff-maas-api-tls") pod "maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn" (UID: "194098ee-e6b4-454c-947f-214580634bff") : secret "maas-api-e2e-shared-b-w2-f9c5c2-serving-cert" not found
Sep 19 15:36:20.840150 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:20.840040    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glkcs\" (UniqueName: \"kubernetes.io/projected/194098ee-e6b4-454c-947f-214580634bff-kube-api-access-glkcs\") pod \"maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn\" (UID: \"194098ee-e6b4-454c-947f-214580634bff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"
Sep 19 15:36:20.840342 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:20.840206    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/194098ee-e6b4-454c-947f-214580634bff-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn\" (UID: \"194098ee-e6b4-454c-947f-214580634bff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"
Sep 19 15:36:20.840342 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:20.840224    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/194098ee-e6b4-454c-947f-214580634bff-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn\" (UID: \"194098ee-e6b4-454c-947f-214580634bff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"
Sep 19 15:36:20.840796 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:20.840770    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/194098ee-e6b4-454c-947f-214580634bff-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn\" (UID: \"194098ee-e6b4-454c-947f-214580634bff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"
Sep 19 15:36:20.842841 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:20.842823    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/194098ee-e6b4-454c-947f-214580634bff-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn\" (UID: \"194098ee-e6b4-454c-947f-214580634bff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"
Sep 19 15:36:20.849449 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:20.849426    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glkcs\" (UniqueName: \"kubernetes.io/projected/194098ee-e6b4-454c-947f-214580634bff-kube-api-access-glkcs\") pod \"maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn\" (UID: \"194098ee-e6b4-454c-947f-214580634bff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"
Sep 19 15:36:21.326551 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:21.326516    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 19 15:36:21.326718 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:21.326592    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb" podUID="25adf7ff-22b9-449b-8456-99a1deef1558" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 19 15:36:21.345468 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:21.345437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/194098ee-e6b4-454c-947f-214580634bff-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn\" (UID: \"194098ee-e6b4-454c-947f-214580634bff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"
Sep 19 15:36:21.348141 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:21.348111    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/194098ee-e6b4-454c-947f-214580634bff-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn\" (UID: \"194098ee-e6b4-454c-947f-214580634bff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"
Sep 19 15:36:21.566413 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:21.566379    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"
Sep 19 15:36:21.871312 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:21.871269    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"]
Sep 19 15:36:21.872331 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:36:21.872305    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod194098ee_e6b4_454c_947f_214580634bff.slice/crio-27ad9c87cfab39e638c2a67c9ca640e90cbbb68fa604d88ae835dbba51baaaa1 WatchSource:0}: Error finding container 27ad9c87cfab39e638c2a67c9ca640e90cbbb68fa604d88ae835dbba51baaaa1: Status 404 returned error can't find the container with id 27ad9c87cfab39e638c2a67c9ca640e90cbbb68fa604d88ae835dbba51baaaa1
Sep 19 15:36:22.043987 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:22.043948    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn" event={"ID":"194098ee-e6b4-454c-947f-214580634bff","Type":"ContainerStarted","Data":"27ad9c87cfab39e638c2a67c9ca640e90cbbb68fa604d88ae835dbba51baaaa1"}
Sep 19 15:36:22.327459 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:22.327425    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 19 15:36:22.327612 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:22.327485    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb" podUID="25adf7ff-22b9-449b-8456-99a1deef1558" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 19 15:36:23.052001 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:23.051969    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn" event={"ID":"194098ee-e6b4-454c-947f-214580634bff","Type":"ContainerStarted","Data":"06e82f2c6294aacf9396976a0dc1bed8400557f3cba02e3feeb7e5b7df099b9e"}
Sep 19 15:36:23.052385 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:23.052082    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"
Sep 19 15:36:23.069158 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:23.069095    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn" podStartSLOduration=2.725502805 podStartE2EDuration="3.069079626s" totalImagesPullingTime="343.576821ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:36:23.067265012 +0000 UTC m=+1457.956464747" watchObservedRunningTime="2026-09-19 15:36:23.069079626 +0000 UTC m=+1457.958279338"
Sep 19 15:36:23.331508 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:23.331405    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:36:23.332313 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:23.332293    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:36:26.439574 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:26.439538    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"]
Sep 19 15:36:26.445580 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:26.445555    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"
Sep 19 15:36:26.447505 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:26.447480    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w1-da587f-serving-cert\""
Sep 19 15:36:26.454027 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:26.453912    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"]
Sep 19 15:36:26.501100 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:26.501070    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmxkv\" (UniqueName: \"kubernetes.io/projected/e07d4659-d78d-49f5-ad50-c3a5acfe220c-kube-api-access-kmxkv\") pod \"maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69\" (UID: \"e07d4659-d78d-49f5-ad50-c3a5acfe220c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"
Sep 19 15:36:26.501275 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:26.501127    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e07d4659-d78d-49f5-ad50-c3a5acfe220c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69\" (UID: \"e07d4659-d78d-49f5-ad50-c3a5acfe220c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"
Sep 19 15:36:26.501275 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:26.501190    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e07d4659-d78d-49f5-ad50-c3a5acfe220c-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69\" (UID: \"e07d4659-d78d-49f5-ad50-c3a5acfe220c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"
Sep 19 15:36:26.501275 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:26.501211    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e07d4659-d78d-49f5-ad50-c3a5acfe220c-metrics-certs\") pod \"maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69\" (UID: \"e07d4659-d78d-49f5-ad50-c3a5acfe220c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"
Sep 19 15:36:26.602446 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:26.602406    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmxkv\" (UniqueName: \"kubernetes.io/projected/e07d4659-d78d-49f5-ad50-c3a5acfe220c-kube-api-access-kmxkv\") pod \"maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69\" (UID: \"e07d4659-d78d-49f5-ad50-c3a5acfe220c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"
Sep 19 15:36:26.602627 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:26.602476    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e07d4659-d78d-49f5-ad50-c3a5acfe220c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69\" (UID: \"e07d4659-d78d-49f5-ad50-c3a5acfe220c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"
Sep 19 15:36:26.602627 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:26.602534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e07d4659-d78d-49f5-ad50-c3a5acfe220c-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69\" (UID: \"e07d4659-d78d-49f5-ad50-c3a5acfe220c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"
Sep 19 15:36:26.602627 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:26.602568    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e07d4659-d78d-49f5-ad50-c3a5acfe220c-metrics-certs\") pod \"maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69\" (UID: \"e07d4659-d78d-49f5-ad50-c3a5acfe220c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"
Sep 19 15:36:26.602746 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:36:26.602655    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-serving-cert: secret "maas-api-e2e-shared-b-w1-da587f-serving-cert" not found
Sep 19 15:36:26.602746 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:36:26.602733    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e07d4659-d78d-49f5-ad50-c3a5acfe220c-maas-api-tls podName:e07d4659-d78d-49f5-ad50-c3a5acfe220c nodeName:}" failed. No retries permitted until 2026-09-19 15:36:27.102705951 +0000 UTC m=+1461.991905642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e07d4659-d78d-49f5-ad50-c3a5acfe220c-maas-api-tls") pod "maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69" (UID: "e07d4659-d78d-49f5-ad50-c3a5acfe220c") : secret "maas-api-e2e-shared-b-w1-da587f-serving-cert" not found
Sep 19 15:36:26.603211 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:26.603185    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e07d4659-d78d-49f5-ad50-c3a5acfe220c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69\" (UID: \"e07d4659-d78d-49f5-ad50-c3a5acfe220c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"
Sep 19 15:36:26.605144 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:26.605123    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e07d4659-d78d-49f5-ad50-c3a5acfe220c-metrics-certs\") pod \"maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69\" (UID: \"e07d4659-d78d-49f5-ad50-c3a5acfe220c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"
Sep 19 15:36:26.612477 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:26.612456    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmxkv\" (UniqueName: \"kubernetes.io/projected/e07d4659-d78d-49f5-ad50-c3a5acfe220c-kube-api-access-kmxkv\") pod \"maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69\" (UID: \"e07d4659-d78d-49f5-ad50-c3a5acfe220c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"
Sep 19 15:36:27.109371 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:27.109338    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e07d4659-d78d-49f5-ad50-c3a5acfe220c-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69\" (UID: \"e07d4659-d78d-49f5-ad50-c3a5acfe220c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"
Sep 19 15:36:27.112677 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:27.112646    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e07d4659-d78d-49f5-ad50-c3a5acfe220c-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69\" (UID: \"e07d4659-d78d-49f5-ad50-c3a5acfe220c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"
Sep 19 15:36:27.360132 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:27.360040    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"
Sep 19 15:36:27.638366 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:36:27.638338    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode07d4659_d78d_49f5_ad50_c3a5acfe220c.slice/crio-a3f5c46ad8e70c25f0f3b41b34e70e6b3c6629eefba3b1bf0a4e948970ef7111 WatchSource:0}: Error finding container a3f5c46ad8e70c25f0f3b41b34e70e6b3c6629eefba3b1bf0a4e948970ef7111: Status 404 returned error can't find the container with id a3f5c46ad8e70c25f0f3b41b34e70e6b3c6629eefba3b1bf0a4e948970ef7111
Sep 19 15:36:27.643085 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:27.643062    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"]
Sep 19 15:36:28.087294 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:28.087265    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69" event={"ID":"e07d4659-d78d-49f5-ad50-c3a5acfe220c","Type":"ContainerStarted","Data":"a3f5c46ad8e70c25f0f3b41b34e70e6b3c6629eefba3b1bf0a4e948970ef7111"}
Sep 19 15:36:29.064606 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:29.064579    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"
Sep 19 15:36:29.098575 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:29.098537    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69" event={"ID":"e07d4659-d78d-49f5-ad50-c3a5acfe220c","Type":"ContainerStarted","Data":"bd032d12e1a7bebd1c0b1fe831890ac4057f26f130c3a4aa50178fb78fd368d5"}
Sep 19 15:36:29.098816 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:29.098798    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"
Sep 19 15:36:29.116728 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:29.116678    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69" podStartSLOduration=2.673895804 podStartE2EDuration="3.116659804s" totalImagesPullingTime="442.764ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:36:29.116168119 +0000 UTC m=+1464.005367859" watchObservedRunningTime="2026-09-19 15:36:29.116659804 +0000 UTC m=+1464.005859518"
Sep 19 15:36:35.110389 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:35.110357    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"
Sep 19 15:36:50.247498 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:50.247464    2563 generic.go:356] "Generic (PLEG): container finished" podID="4db1e571-acde-4ae3-903a-444ea2e57a39" containerID="24f483c5474560fcde351ad436db23b2007aa2c60bda3908c7baf02a60e9ef45" exitCode=0
Sep 19 15:36:50.247889 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:50.247531    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h" event={"ID":"4db1e571-acde-4ae3-903a-444ea2e57a39","Type":"ContainerDied","Data":"24f483c5474560fcde351ad436db23b2007aa2c60bda3908c7baf02a60e9ef45"}
Sep 19 15:36:50.247982 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:50.247959    2563 scope.go:117] "RemoveContainer" containerID="24f483c5474560fcde351ad436db23b2007aa2c60bda3908c7baf02a60e9ef45"
Sep 19 15:36:50.249111 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:50.249085    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:36:50.253915 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:50.249603    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:36:50.253915 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:50.249740    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 19 15:36:51.257442 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:51.257407    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h" event={"ID":"4db1e571-acde-4ae3-903a-444ea2e57a39","Type":"ContainerStarted","Data":"dafea10cb4c578c6f6e0470fd02026365f578e231336994f33abffe80a15fc71"}
Sep 19 15:36:51.436587 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:51.436552    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:51.436836 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:51.436815    2563 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 19 15:36:51.436920 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:51.436875    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h" podUID="4db1e571-acde-4ae3-903a-444ea2e57a39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 19 15:36:52.436324 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:52.436277    2563 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 19 15:36:52.436816 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:52.436332    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h" podUID="4db1e571-acde-4ae3-903a-444ea2e57a39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 19 15:36:53.436998 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:53.436959    2563 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 19 15:36:53.437366 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:53.437032    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h" podUID="4db1e571-acde-4ae3-903a-444ea2e57a39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 19 15:36:54.436630 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:54.436591    2563 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 19 15:36:54.436847 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:54.436654    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h" podUID="4db1e571-acde-4ae3-903a-444ea2e57a39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 19 15:36:55.436276 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:55.436238    2563 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 19 15:36:55.436642 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:55.436294    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h" podUID="4db1e571-acde-4ae3-903a-444ea2e57a39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 19 15:36:56.467661 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:56.467624    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:56.468615 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:56.468577    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:56.471433 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:56.471399    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:36:57.573915 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:57.573284    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"]
Sep 19 15:36:57.578869 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:57.578843    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"
Sep 19 15:36:57.581357 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:57.581333    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-7cbcece2-serving-cert\""
Sep 19 15:36:57.591048 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:57.590714    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"]
Sep 19 15:36:57.642877 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:57.642841    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5814430e-9409-41a7-a013-9c7f6b6a249d-openshift-service-ca\") pod \"maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt\" (UID: \"5814430e-9409-41a7-a013-9c7f6b6a249d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"
Sep 19 15:36:57.643066 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:57.642951    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5814430e-9409-41a7-a013-9c7f6b6a249d-metrics-certs\") pod \"maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt\" (UID: \"5814430e-9409-41a7-a013-9c7f6b6a249d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"
Sep 19 15:36:57.643066 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:57.642986    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5814430e-9409-41a7-a013-9c7f6b6a249d-maas-api-tls\") pod \"maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt\" (UID: \"5814430e-9409-41a7-a013-9c7f6b6a249d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"
Sep 19 15:36:57.643066 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:57.643023    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdv5c\" (UniqueName: \"kubernetes.io/projected/5814430e-9409-41a7-a013-9c7f6b6a249d-kube-api-access-rdv5c\") pod \"maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt\" (UID: \"5814430e-9409-41a7-a013-9c7f6b6a249d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"
Sep 19 15:36:57.743832 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:57.743799    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5814430e-9409-41a7-a013-9c7f6b6a249d-metrics-certs\") pod \"maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt\" (UID: \"5814430e-9409-41a7-a013-9c7f6b6a249d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"
Sep 19 15:36:57.744044 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:57.743878    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5814430e-9409-41a7-a013-9c7f6b6a249d-maas-api-tls\") pod \"maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt\" (UID: \"5814430e-9409-41a7-a013-9c7f6b6a249d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"
Sep 19 15:36:57.744044 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:57.743945    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdv5c\" (UniqueName: \"kubernetes.io/projected/5814430e-9409-41a7-a013-9c7f6b6a249d-kube-api-access-rdv5c\") pod \"maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt\" (UID: \"5814430e-9409-41a7-a013-9c7f6b6a249d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"
Sep 19 15:36:57.744044 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:57.744001    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5814430e-9409-41a7-a013-9c7f6b6a249d-openshift-service-ca\") pod \"maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt\" (UID: \"5814430e-9409-41a7-a013-9c7f6b6a249d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"
Sep 19 15:36:57.744044 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:36:57.744024    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-serving-cert: secret "maas-api-e2e-mt-7cbcece2-serving-cert" not found
Sep 19 15:36:57.744236 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:36:57.744091    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5814430e-9409-41a7-a013-9c7f6b6a249d-maas-api-tls podName:5814430e-9409-41a7-a013-9c7f6b6a249d nodeName:}" failed. No retries permitted until 2026-09-19 15:36:58.244070134 +0000 UTC m=+1493.133269852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5814430e-9409-41a7-a013-9c7f6b6a249d-maas-api-tls") pod "maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt" (UID: "5814430e-9409-41a7-a013-9c7f6b6a249d") : secret "maas-api-e2e-mt-7cbcece2-serving-cert" not found
Sep 19 15:36:57.744908 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:57.744793    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5814430e-9409-41a7-a013-9c7f6b6a249d-openshift-service-ca\") pod \"maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt\" (UID: \"5814430e-9409-41a7-a013-9c7f6b6a249d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"
Sep 19 15:36:57.746668 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:57.746646    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5814430e-9409-41a7-a013-9c7f6b6a249d-metrics-certs\") pod \"maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt\" (UID: \"5814430e-9409-41a7-a013-9c7f6b6a249d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"
Sep 19 15:36:57.752585 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:57.752564    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdv5c\" (UniqueName: \"kubernetes.io/projected/5814430e-9409-41a7-a013-9c7f6b6a249d-kube-api-access-rdv5c\") pod \"maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt\" (UID: \"5814430e-9409-41a7-a013-9c7f6b6a249d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"
Sep 19 15:36:58.250385 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:58.250352    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5814430e-9409-41a7-a013-9c7f6b6a249d-maas-api-tls\") pod \"maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt\" (UID: \"5814430e-9409-41a7-a013-9c7f6b6a249d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"
Sep 19 15:36:58.253065 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:58.253034    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5814430e-9409-41a7-a013-9c7f6b6a249d-maas-api-tls\") pod \"maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt\" (UID: \"5814430e-9409-41a7-a013-9c7f6b6a249d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"
Sep 19 15:36:58.336266 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:58.336231    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn"]
Sep 19 15:36:58.340295 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:58.340273    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn"
Sep 19 15:36:58.342726 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:58.342703    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-7cbcece2-dockercfg-zkll7\""
Sep 19 15:36:58.342840 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:58.342732    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-7cbcece2\""
Sep 19 15:36:58.355336 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:58.355312    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn"]
Sep 19 15:36:58.456882 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:58.456440    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvrrh\" (UniqueName: \"kubernetes.io/projected/34ddca04-8779-42eb-b8f1-6bbb82af0c39-kube-api-access-hvrrh\") pod \"payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn\" (UID: \"34ddca04-8779-42eb-b8f1-6bbb82af0c39\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn"
Sep 19 15:36:58.456882 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:58.456511    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34ddca04-8779-42eb-b8f1-6bbb82af0c39-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn\" (UID: \"34ddca04-8779-42eb-b8f1-6bbb82af0c39\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn"
Sep 19 15:36:58.494218 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:58.494184    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"
Sep 19 15:36:58.561091 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:58.559910    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvrrh\" (UniqueName: \"kubernetes.io/projected/34ddca04-8779-42eb-b8f1-6bbb82af0c39-kube-api-access-hvrrh\") pod \"payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn\" (UID: \"34ddca04-8779-42eb-b8f1-6bbb82af0c39\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn"
Sep 19 15:36:58.561091 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:58.559993    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34ddca04-8779-42eb-b8f1-6bbb82af0c39-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn\" (UID: \"34ddca04-8779-42eb-b8f1-6bbb82af0c39\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn"
Sep 19 15:36:58.561091 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:58.561064    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34ddca04-8779-42eb-b8f1-6bbb82af0c39-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn\" (UID: \"34ddca04-8779-42eb-b8f1-6bbb82af0c39\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn"
Sep 19 15:36:58.568467 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:58.568442    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvrrh\" (UniqueName: \"kubernetes.io/projected/34ddca04-8779-42eb-b8f1-6bbb82af0c39-kube-api-access-hvrrh\") pod \"payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn\" (UID: \"34ddca04-8779-42eb-b8f1-6bbb82af0c39\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn"
Sep 19 15:36:58.650786 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:58.650751    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn"
Sep 19 15:36:58.771845 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:58.771811    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"]
Sep 19 15:36:58.772708 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:36:58.772684    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5814430e_9409_41a7_a013_9c7f6b6a249d.slice/crio-4d8fa10d1d7f01e0d23dba295f5669f099ce879e27169026311d37deb78bfe09 WatchSource:0}: Error finding container 4d8fa10d1d7f01e0d23dba295f5669f099ce879e27169026311d37deb78bfe09: Status 404 returned error can't find the container with id 4d8fa10d1d7f01e0d23dba295f5669f099ce879e27169026311d37deb78bfe09
Sep 19 15:36:58.925633 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:58.925604    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn"]
Sep 19 15:36:58.925934 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:36:58.925883    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34ddca04_8779_42eb_b8f1_6bbb82af0c39.slice/crio-1ddfe725505bf43b3334d9683f25a27c01885a2a951b1974c7a8062d3bc661cb WatchSource:0}: Error finding container 1ddfe725505bf43b3334d9683f25a27c01885a2a951b1974c7a8062d3bc661cb: Status 404 returned error can't find the container with id 1ddfe725505bf43b3334d9683f25a27c01885a2a951b1974c7a8062d3bc661cb
Sep 19 15:36:59.319415 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:59.319354    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn" event={"ID":"34ddca04-8779-42eb-b8f1-6bbb82af0c39","Type":"ContainerStarted","Data":"b09b34aac3547903498621a30263ee21f28a35b1a783e697185990af9d9c118f"}
Sep 19 15:36:59.319609 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:59.319433    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn" event={"ID":"34ddca04-8779-42eb-b8f1-6bbb82af0c39","Type":"ContainerStarted","Data":"1ddfe725505bf43b3334d9683f25a27c01885a2a951b1974c7a8062d3bc661cb"}
Sep 19 15:36:59.319609 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:59.319481    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn"
Sep 19 15:36:59.322006 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:59.321971    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt" event={"ID":"5814430e-9409-41a7-a013-9c7f6b6a249d","Type":"ContainerStarted","Data":"cbc9e76989fcf0312a06a46f5846faf28791189d5c7a40c78e1067e14b07e94d"}
Sep 19 15:36:59.322158 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:59.322026    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt" event={"ID":"5814430e-9409-41a7-a013-9c7f6b6a249d","Type":"ContainerStarted","Data":"4d8fa10d1d7f01e0d23dba295f5669f099ce879e27169026311d37deb78bfe09"}
Sep 19 15:36:59.322592 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:59.322562    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"
Sep 19 15:36:59.337234 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:59.337134    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn" podStartSLOduration=1.337118394 podStartE2EDuration="1.337118394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:36:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:36:59.335279787 +0000 UTC m=+1494.224479501" watchObservedRunningTime="2026-09-19 15:36:59.337118394 +0000 UTC m=+1494.226318107"
Sep 19 15:36:59.354178 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:36:59.354119    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt" podStartSLOduration=2.045692733 podStartE2EDuration="2.35409146s" totalImagesPullingTime="308.398727ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:36:59.352944711 +0000 UTC m=+1494.242144425" watchObservedRunningTime="2026-09-19 15:36:59.35409146 +0000 UTC m=+1494.243291173"
Sep 19 15:37:05.679198 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:05.679171    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/1.log"
Sep 19 15:37:05.683425 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:05.683401    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/1.log"
Sep 19 15:37:06.340623 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:06.340593    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"
Sep 19 15:37:10.331090 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:10.331058    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn"
Sep 19 15:37:42.355762 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:42.355682    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"]
Sep 19 15:37:42.356318 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:42.355905    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj" podUID="b256d5e4-9b2a-4298-b322-648735dd34bd" containerName="maas-api" containerID="cri-o://baa869bb11531432e89f4b0a173e058b6e4ee24224afc6ae937a92d80d34d526" gracePeriod=30
Sep 19 15:37:43.617485 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:43.617451    2563 generic.go:356] "Generic (PLEG): container finished" podID="b256d5e4-9b2a-4298-b322-648735dd34bd" containerID="baa869bb11531432e89f4b0a173e058b6e4ee24224afc6ae937a92d80d34d526" exitCode=0
Sep 19 15:37:43.617836 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:43.617525    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj" event={"ID":"b256d5e4-9b2a-4298-b322-648735dd34bd","Type":"ContainerDied","Data":"baa869bb11531432e89f4b0a173e058b6e4ee24224afc6ae937a92d80d34d526"}
Sep 19 15:37:43.617836 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:43.617587    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj" event={"ID":"b256d5e4-9b2a-4298-b322-648735dd34bd","Type":"ContainerDied","Data":"e117c500a94487cba6e52aa69a641109bab700432ef04ce18363a97503ca8c80"}
Sep 19 15:37:43.617836 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:43.617608    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e117c500a94487cba6e52aa69a641109bab700432ef04ce18363a97503ca8c80"
Sep 19 15:37:43.620919 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:43.620873    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"
Sep 19 15:37:43.708526 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:43.708483    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b256d5e4-9b2a-4298-b322-648735dd34bd-metrics-certs\") pod \"b256d5e4-9b2a-4298-b322-648735dd34bd\" (UID: \"b256d5e4-9b2a-4298-b322-648735dd34bd\") "
Sep 19 15:37:43.708706 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:43.708588    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49qqj\" (UniqueName: \"kubernetes.io/projected/b256d5e4-9b2a-4298-b322-648735dd34bd-kube-api-access-49qqj\") pod \"b256d5e4-9b2a-4298-b322-648735dd34bd\" (UID: \"b256d5e4-9b2a-4298-b322-648735dd34bd\") "
Sep 19 15:37:43.708706 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:43.708687    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b256d5e4-9b2a-4298-b322-648735dd34bd-openshift-service-ca\") pod \"b256d5e4-9b2a-4298-b322-648735dd34bd\" (UID: \"b256d5e4-9b2a-4298-b322-648735dd34bd\") "
Sep 19 15:37:43.708844 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:43.708735    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b256d5e4-9b2a-4298-b322-648735dd34bd-maas-api-tls\") pod \"b256d5e4-9b2a-4298-b322-648735dd34bd\" (UID: \"b256d5e4-9b2a-4298-b322-648735dd34bd\") "
Sep 19 15:37:43.709086 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:43.709044    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b256d5e4-9b2a-4298-b322-648735dd34bd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b256d5e4-9b2a-4298-b322-648735dd34bd" (UID: "b256d5e4-9b2a-4298-b322-648735dd34bd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:37:43.709208 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:43.709193    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b256d5e4-9b2a-4298-b322-648735dd34bd-openshift-service-ca\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:37:43.710758 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:43.710735    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b256d5e4-9b2a-4298-b322-648735dd34bd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b256d5e4-9b2a-4298-b322-648735dd34bd" (UID: "b256d5e4-9b2a-4298-b322-648735dd34bd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:37:43.711379 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:43.711341    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b256d5e4-9b2a-4298-b322-648735dd34bd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b256d5e4-9b2a-4298-b322-648735dd34bd" (UID: "b256d5e4-9b2a-4298-b322-648735dd34bd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:37:43.711479 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:43.711383    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b256d5e4-9b2a-4298-b322-648735dd34bd-kube-api-access-49qqj" (OuterVolumeSpecName: "kube-api-access-49qqj") pod "b256d5e4-9b2a-4298-b322-648735dd34bd" (UID: "b256d5e4-9b2a-4298-b322-648735dd34bd"). InnerVolumeSpecName "kube-api-access-49qqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:37:43.810748 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:43.810713    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b256d5e4-9b2a-4298-b322-648735dd34bd-maas-api-tls\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:37:43.810748 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:43.810740    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b256d5e4-9b2a-4298-b322-648735dd34bd-metrics-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:37:43.810748 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:43.810750    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49qqj\" (UniqueName: \"kubernetes.io/projected/b256d5e4-9b2a-4298-b322-648735dd34bd-kube-api-access-49qqj\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:37:44.625957 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:44.625922    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"
Sep 19 15:37:44.651288 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:44.651257    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"]
Sep 19 15:37:44.654675 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:44.654651    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-33737b-f6859747b-nmbbj"]
Sep 19 15:37:45.642101 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:37:45.642056    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b256d5e4-9b2a-4298-b322-648735dd34bd" path="/var/lib/kubelet/pods/b256d5e4-9b2a-4298-b322-648735dd34bd/volumes"
Sep 19 15:38:05.773447 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:05.773413    2563 scope.go:117] "RemoveContainer" containerID="baa869bb11531432e89f4b0a173e058b6e4ee24224afc6ae937a92d80d34d526"
Sep 19 15:38:56.450429 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:56.450394    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"]
Sep 19 15:38:56.450930 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:56.450664    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5" podUID="91d03d2d-7d14-4f0b-b601-0a47321048f2" containerName="maas-api" containerID="cri-o://ddfbd69435c6f6d25b9e26eb6ef451ffa871a1ce5f094932d7d0a99b0d62f1c7" gracePeriod=30
Sep 19 15:38:56.737916 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:56.737863    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"
Sep 19 15:38:56.806219 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:56.806186    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91d03d2d-7d14-4f0b-b601-0a47321048f2-maas-api-tls\") pod \"91d03d2d-7d14-4f0b-b601-0a47321048f2\" (UID: \"91d03d2d-7d14-4f0b-b601-0a47321048f2\") "
Sep 19 15:38:56.806402 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:56.806258    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91d03d2d-7d14-4f0b-b601-0a47321048f2-openshift-service-ca\") pod \"91d03d2d-7d14-4f0b-b601-0a47321048f2\" (UID: \"91d03d2d-7d14-4f0b-b601-0a47321048f2\") "
Sep 19 15:38:56.806402 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:56.806337    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb2k8\" (UniqueName: \"kubernetes.io/projected/91d03d2d-7d14-4f0b-b601-0a47321048f2-kube-api-access-cb2k8\") pod \"91d03d2d-7d14-4f0b-b601-0a47321048f2\" (UID: \"91d03d2d-7d14-4f0b-b601-0a47321048f2\") "
Sep 19 15:38:56.806528 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:56.806406    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91d03d2d-7d14-4f0b-b601-0a47321048f2-metrics-certs\") pod \"91d03d2d-7d14-4f0b-b601-0a47321048f2\" (UID: \"91d03d2d-7d14-4f0b-b601-0a47321048f2\") "
Sep 19 15:38:56.806679 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:56.806651    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91d03d2d-7d14-4f0b-b601-0a47321048f2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "91d03d2d-7d14-4f0b-b601-0a47321048f2" (UID: "91d03d2d-7d14-4f0b-b601-0a47321048f2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:38:56.806782 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:56.806761    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91d03d2d-7d14-4f0b-b601-0a47321048f2-openshift-service-ca\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:38:56.809174 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:56.809142    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91d03d2d-7d14-4f0b-b601-0a47321048f2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "91d03d2d-7d14-4f0b-b601-0a47321048f2" (UID: "91d03d2d-7d14-4f0b-b601-0a47321048f2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:38:56.809284 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:56.809267    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91d03d2d-7d14-4f0b-b601-0a47321048f2-kube-api-access-cb2k8" (OuterVolumeSpecName: "kube-api-access-cb2k8") pod "91d03d2d-7d14-4f0b-b601-0a47321048f2" (UID: "91d03d2d-7d14-4f0b-b601-0a47321048f2"). InnerVolumeSpecName "kube-api-access-cb2k8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:38:56.809477 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:56.809438    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91d03d2d-7d14-4f0b-b601-0a47321048f2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "91d03d2d-7d14-4f0b-b601-0a47321048f2" (UID: "91d03d2d-7d14-4f0b-b601-0a47321048f2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:38:56.910654 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:56.910574    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb2k8\" (UniqueName: \"kubernetes.io/projected/91d03d2d-7d14-4f0b-b601-0a47321048f2-kube-api-access-cb2k8\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:38:56.910654 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:56.910614    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91d03d2d-7d14-4f0b-b601-0a47321048f2-metrics-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:38:56.910654 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:56.910627    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91d03d2d-7d14-4f0b-b601-0a47321048f2-maas-api-tls\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:38:57.083270 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:57.083169    2563 generic.go:356] "Generic (PLEG): container finished" podID="91d03d2d-7d14-4f0b-b601-0a47321048f2" containerID="ddfbd69435c6f6d25b9e26eb6ef451ffa871a1ce5f094932d7d0a99b0d62f1c7" exitCode=0
Sep 19 15:38:57.083270 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:57.083218    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5" event={"ID":"91d03d2d-7d14-4f0b-b601-0a47321048f2","Type":"ContainerDied","Data":"ddfbd69435c6f6d25b9e26eb6ef451ffa871a1ce5f094932d7d0a99b0d62f1c7"}
Sep 19 15:38:57.083270 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:57.083250    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"
Sep 19 15:38:57.083723 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:57.083291    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5" event={"ID":"91d03d2d-7d14-4f0b-b601-0a47321048f2","Type":"ContainerDied","Data":"72d80660ea5e58fb8abb576e6db641d4d92af5ea91c72c4d50700f29a629df12"}
Sep 19 15:38:57.083723 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:57.083321    2563 scope.go:117] "RemoveContainer" containerID="ddfbd69435c6f6d25b9e26eb6ef451ffa871a1ce5f094932d7d0a99b0d62f1c7"
Sep 19 15:38:57.096852 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:57.096829    2563 scope.go:117] "RemoveContainer" containerID="ddfbd69435c6f6d25b9e26eb6ef451ffa871a1ce5f094932d7d0a99b0d62f1c7"
Sep 19 15:38:57.097565 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:38:57.097541    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddfbd69435c6f6d25b9e26eb6ef451ffa871a1ce5f094932d7d0a99b0d62f1c7\": container with ID starting with ddfbd69435c6f6d25b9e26eb6ef451ffa871a1ce5f094932d7d0a99b0d62f1c7 not found: ID does not exist" containerID="ddfbd69435c6f6d25b9e26eb6ef451ffa871a1ce5f094932d7d0a99b0d62f1c7"
Sep 19 15:38:57.097677 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:57.097575    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddfbd69435c6f6d25b9e26eb6ef451ffa871a1ce5f094932d7d0a99b0d62f1c7"} err="failed to get container status \"ddfbd69435c6f6d25b9e26eb6ef451ffa871a1ce5f094932d7d0a99b0d62f1c7\": rpc error: code = NotFound desc = could not find container \"ddfbd69435c6f6d25b9e26eb6ef451ffa871a1ce5f094932d7d0a99b0d62f1c7\": container with ID starting with ddfbd69435c6f6d25b9e26eb6ef451ffa871a1ce5f094932d7d0a99b0d62f1c7 not found: ID does not exist"
Sep 19 15:38:57.104973 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:57.104947    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"]
Sep 19 15:38:57.108497 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:57.108475    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-15949d-75d8f5bf8d-4mkd5"]
Sep 19 15:38:57.642429 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:38:57.642388    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91d03d2d-7d14-4f0b-b601-0a47321048f2" path="/var/lib/kubelet/pods/91d03d2d-7d14-4f0b-b601-0a47321048f2/volumes"
Sep 19 15:39:08.709720 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:08.709683    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"]
Sep 19 15:39:08.710198 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:08.709935    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt" podUID="5814430e-9409-41a7-a013-9c7f6b6a249d" containerName="maas-api" containerID="cri-o://cbc9e76989fcf0312a06a46f5846faf28791189d5c7a40c78e1067e14b07e94d" gracePeriod=30
Sep 19 15:39:08.770286 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:08.770251    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn"]
Sep 19 15:39:08.770544 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:08.770498    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn" podUID="34ddca04-8779-42eb-b8f1-6bbb82af0c39" containerName="payload-pre-processing" containerID="cri-o://b09b34aac3547903498621a30263ee21f28a35b1a783e697185990af9d9c118f" gracePeriod=30
Sep 19 15:39:09.086375 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.086347    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"
Sep 19 15:39:09.089572 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.089551    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn"
Sep 19 15:39:09.165819 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.165783    2563 generic.go:356] "Generic (PLEG): container finished" podID="34ddca04-8779-42eb-b8f1-6bbb82af0c39" containerID="b09b34aac3547903498621a30263ee21f28a35b1a783e697185990af9d9c118f" exitCode=0
Sep 19 15:39:09.166022 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.165826    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn"
Sep 19 15:39:09.166022 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.165858    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn" event={"ID":"34ddca04-8779-42eb-b8f1-6bbb82af0c39","Type":"ContainerDied","Data":"b09b34aac3547903498621a30263ee21f28a35b1a783e697185990af9d9c118f"}
Sep 19 15:39:09.166022 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.165950    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn" event={"ID":"34ddca04-8779-42eb-b8f1-6bbb82af0c39","Type":"ContainerDied","Data":"1ddfe725505bf43b3334d9683f25a27c01885a2a951b1974c7a8062d3bc661cb"}
Sep 19 15:39:09.166022 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.165973    2563 scope.go:117] "RemoveContainer" containerID="b09b34aac3547903498621a30263ee21f28a35b1a783e697185990af9d9c118f"
Sep 19 15:39:09.167489 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.167458    2563 generic.go:356] "Generic (PLEG): container finished" podID="5814430e-9409-41a7-a013-9c7f6b6a249d" containerID="cbc9e76989fcf0312a06a46f5846faf28791189d5c7a40c78e1067e14b07e94d" exitCode=0
Sep 19 15:39:09.167489 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.167503    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"
Sep 19 15:39:09.167767 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.167544    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt" event={"ID":"5814430e-9409-41a7-a013-9c7f6b6a249d","Type":"ContainerDied","Data":"cbc9e76989fcf0312a06a46f5846faf28791189d5c7a40c78e1067e14b07e94d"}
Sep 19 15:39:09.167767 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.167580    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt" event={"ID":"5814430e-9409-41a7-a013-9c7f6b6a249d","Type":"ContainerDied","Data":"4d8fa10d1d7f01e0d23dba295f5669f099ce879e27169026311d37deb78bfe09"}
Sep 19 15:39:09.175714 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.175697    2563 scope.go:117] "RemoveContainer" containerID="b09b34aac3547903498621a30263ee21f28a35b1a783e697185990af9d9c118f"
Sep 19 15:39:09.175994 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:39:09.175974    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b09b34aac3547903498621a30263ee21f28a35b1a783e697185990af9d9c118f\": container with ID starting with b09b34aac3547903498621a30263ee21f28a35b1a783e697185990af9d9c118f not found: ID does not exist" containerID="b09b34aac3547903498621a30263ee21f28a35b1a783e697185990af9d9c118f"
Sep 19 15:39:09.176076 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.176007    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b09b34aac3547903498621a30263ee21f28a35b1a783e697185990af9d9c118f"} err="failed to get container status \"b09b34aac3547903498621a30263ee21f28a35b1a783e697185990af9d9c118f\": rpc error: code = NotFound desc = could not find container \"b09b34aac3547903498621a30263ee21f28a35b1a783e697185990af9d9c118f\": container with ID starting with b09b34aac3547903498621a30263ee21f28a35b1a783e697185990af9d9c118f not found: ID does not exist"
Sep 19 15:39:09.176076 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.176030    2563 scope.go:117] "RemoveContainer" containerID="cbc9e76989fcf0312a06a46f5846faf28791189d5c7a40c78e1067e14b07e94d"
Sep 19 15:39:09.184804 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.184777    2563 scope.go:117] "RemoveContainer" containerID="cbc9e76989fcf0312a06a46f5846faf28791189d5c7a40c78e1067e14b07e94d"
Sep 19 15:39:09.185173 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:39:09.185149    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbc9e76989fcf0312a06a46f5846faf28791189d5c7a40c78e1067e14b07e94d\": container with ID starting with cbc9e76989fcf0312a06a46f5846faf28791189d5c7a40c78e1067e14b07e94d not found: ID does not exist" containerID="cbc9e76989fcf0312a06a46f5846faf28791189d5c7a40c78e1067e14b07e94d"
Sep 19 15:39:09.185267 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.185177    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbc9e76989fcf0312a06a46f5846faf28791189d5c7a40c78e1067e14b07e94d"} err="failed to get container status \"cbc9e76989fcf0312a06a46f5846faf28791189d5c7a40c78e1067e14b07e94d\": rpc error: code = NotFound desc = could not find container \"cbc9e76989fcf0312a06a46f5846faf28791189d5c7a40c78e1067e14b07e94d\": container with ID starting with cbc9e76989fcf0312a06a46f5846faf28791189d5c7a40c78e1067e14b07e94d not found: ID does not exist"
Sep 19 15:39:09.236176 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.236145    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34ddca04-8779-42eb-b8f1-6bbb82af0c39-plugins-config-volume\") pod \"34ddca04-8779-42eb-b8f1-6bbb82af0c39\" (UID: \"34ddca04-8779-42eb-b8f1-6bbb82af0c39\") "
Sep 19 15:39:09.236324 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.236215    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdv5c\" (UniqueName: \"kubernetes.io/projected/5814430e-9409-41a7-a013-9c7f6b6a249d-kube-api-access-rdv5c\") pod \"5814430e-9409-41a7-a013-9c7f6b6a249d\" (UID: \"5814430e-9409-41a7-a013-9c7f6b6a249d\") "
Sep 19 15:39:09.236324 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.236236    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5814430e-9409-41a7-a013-9c7f6b6a249d-maas-api-tls\") pod \"5814430e-9409-41a7-a013-9c7f6b6a249d\" (UID: \"5814430e-9409-41a7-a013-9c7f6b6a249d\") "
Sep 19 15:39:09.236324 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.236276    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5814430e-9409-41a7-a013-9c7f6b6a249d-metrics-certs\") pod \"5814430e-9409-41a7-a013-9c7f6b6a249d\" (UID: \"5814430e-9409-41a7-a013-9c7f6b6a249d\") "
Sep 19 15:39:09.236324 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.236301    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5814430e-9409-41a7-a013-9c7f6b6a249d-openshift-service-ca\") pod \"5814430e-9409-41a7-a013-9c7f6b6a249d\" (UID: \"5814430e-9409-41a7-a013-9c7f6b6a249d\") "
Sep 19 15:39:09.236547 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.236356    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvrrh\" (UniqueName: \"kubernetes.io/projected/34ddca04-8779-42eb-b8f1-6bbb82af0c39-kube-api-access-hvrrh\") pod \"34ddca04-8779-42eb-b8f1-6bbb82af0c39\" (UID: \"34ddca04-8779-42eb-b8f1-6bbb82af0c39\") "
Sep 19 15:39:09.236604 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.236552    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34ddca04-8779-42eb-b8f1-6bbb82af0c39-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "34ddca04-8779-42eb-b8f1-6bbb82af0c39" (UID: "34ddca04-8779-42eb-b8f1-6bbb82af0c39"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:39:09.236736 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.236710    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5814430e-9409-41a7-a013-9c7f6b6a249d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5814430e-9409-41a7-a013-9c7f6b6a249d" (UID: "5814430e-9409-41a7-a013-9c7f6b6a249d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:39:09.236871 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.236746    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34ddca04-8779-42eb-b8f1-6bbb82af0c39-plugins-config-volume\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:39:09.238455 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.238430    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5814430e-9409-41a7-a013-9c7f6b6a249d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5814430e-9409-41a7-a013-9c7f6b6a249d" (UID: "5814430e-9409-41a7-a013-9c7f6b6a249d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:39:09.238541 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.238505    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5814430e-9409-41a7-a013-9c7f6b6a249d-kube-api-access-rdv5c" (OuterVolumeSpecName: "kube-api-access-rdv5c") pod "5814430e-9409-41a7-a013-9c7f6b6a249d" (UID: "5814430e-9409-41a7-a013-9c7f6b6a249d"). InnerVolumeSpecName "kube-api-access-rdv5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:39:09.239062 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.239046    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5814430e-9409-41a7-a013-9c7f6b6a249d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5814430e-9409-41a7-a013-9c7f6b6a249d" (UID: "5814430e-9409-41a7-a013-9c7f6b6a249d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:39:09.239062 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.239052    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34ddca04-8779-42eb-b8f1-6bbb82af0c39-kube-api-access-hvrrh" (OuterVolumeSpecName: "kube-api-access-hvrrh") pod "34ddca04-8779-42eb-b8f1-6bbb82af0c39" (UID: "34ddca04-8779-42eb-b8f1-6bbb82af0c39"). InnerVolumeSpecName "kube-api-access-hvrrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:39:09.338006 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.337922    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdv5c\" (UniqueName: \"kubernetes.io/projected/5814430e-9409-41a7-a013-9c7f6b6a249d-kube-api-access-rdv5c\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:39:09.338006 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.337955    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5814430e-9409-41a7-a013-9c7f6b6a249d-maas-api-tls\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:39:09.338006 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.337968    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5814430e-9409-41a7-a013-9c7f6b6a249d-metrics-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:39:09.338006 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.337976    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5814430e-9409-41a7-a013-9c7f6b6a249d-openshift-service-ca\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:39:09.338006 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.337985    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvrrh\" (UniqueName: \"kubernetes.io/projected/34ddca04-8779-42eb-b8f1-6bbb82af0c39-kube-api-access-hvrrh\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:39:09.490419 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.490381    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn"]
Sep 19 15:39:09.495980 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.495955    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn"]
Sep 19 15:39:09.506711 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.506684    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"]
Sep 19 15:39:09.509226 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.509199    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7cbcece2-5466bdcdc7-wf8wt"]
Sep 19 15:39:09.641464 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.641389    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34ddca04-8779-42eb-b8f1-6bbb82af0c39" path="/var/lib/kubelet/pods/34ddca04-8779-42eb-b8f1-6bbb82af0c39/volumes"
Sep 19 15:39:09.641792 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:39:09.641779    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5814430e-9409-41a7-a013-9c7f6b6a249d" path="/var/lib/kubelet/pods/5814430e-9409-41a7-a013-9c7f6b6a249d/volumes"
Sep 19 15:41:49.490261 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.490219    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw"]
Sep 19 15:41:49.492553 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.490674    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34ddca04-8779-42eb-b8f1-6bbb82af0c39" containerName="payload-pre-processing"
Sep 19 15:41:49.492553 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.490685    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="34ddca04-8779-42eb-b8f1-6bbb82af0c39" containerName="payload-pre-processing"
Sep 19 15:41:49.492553 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.490702    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b256d5e4-9b2a-4298-b322-648735dd34bd" containerName="maas-api"
Sep 19 15:41:49.492553 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.490707    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b256d5e4-9b2a-4298-b322-648735dd34bd" containerName="maas-api"
Sep 19 15:41:49.492553 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.490715    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5814430e-9409-41a7-a013-9c7f6b6a249d" containerName="maas-api"
Sep 19 15:41:49.492553 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.490721    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5814430e-9409-41a7-a013-9c7f6b6a249d" containerName="maas-api"
Sep 19 15:41:49.492553 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.490728    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91d03d2d-7d14-4f0b-b601-0a47321048f2" containerName="maas-api"
Sep 19 15:41:49.492553 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.490733    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="91d03d2d-7d14-4f0b-b601-0a47321048f2" containerName="maas-api"
Sep 19 15:41:49.492553 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.490793    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="91d03d2d-7d14-4f0b-b601-0a47321048f2" containerName="maas-api"
Sep 19 15:41:49.492553 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.490800    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b256d5e4-9b2a-4298-b322-648735dd34bd" containerName="maas-api"
Sep 19 15:41:49.492553 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.490805    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="34ddca04-8779-42eb-b8f1-6bbb82af0c39" containerName="payload-pre-processing"
Sep 19 15:41:49.492553 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.490813    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5814430e-9409-41a7-a013-9c7f6b6a249d" containerName="maas-api"
Sep 19 15:41:49.494089 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.494073    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw"
Sep 19 15:41:49.496251 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.496225    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-26cbe6\""
Sep 19 15:41:49.496251 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.496244    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-26cbe6-dockercfg-qgmsz\""
Sep 19 15:41:49.504555 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.504526    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw"]
Sep 19 15:41:49.594699 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.594661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3e852fd-628a-4d2e-9a2c-541d4a0e95a8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw\" (UID: \"d3e852fd-628a-4d2e-9a2c-541d4a0e95a8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw"
Sep 19 15:41:49.594930 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.594793    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2c9g\" (UniqueName: \"kubernetes.io/projected/d3e852fd-628a-4d2e-9a2c-541d4a0e95a8-kube-api-access-k2c9g\") pod \"payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw\" (UID: \"d3e852fd-628a-4d2e-9a2c-541d4a0e95a8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw"
Sep 19 15:41:49.696080 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.696040    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3e852fd-628a-4d2e-9a2c-541d4a0e95a8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw\" (UID: \"d3e852fd-628a-4d2e-9a2c-541d4a0e95a8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw"
Sep 19 15:41:49.696278 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.696105    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2c9g\" (UniqueName: \"kubernetes.io/projected/d3e852fd-628a-4d2e-9a2c-541d4a0e95a8-kube-api-access-k2c9g\") pod \"payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw\" (UID: \"d3e852fd-628a-4d2e-9a2c-541d4a0e95a8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw"
Sep 19 15:41:49.696790 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.696764    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3e852fd-628a-4d2e-9a2c-541d4a0e95a8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw\" (UID: \"d3e852fd-628a-4d2e-9a2c-541d4a0e95a8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw"
Sep 19 15:41:49.703357 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.703331    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2c9g\" (UniqueName: \"kubernetes.io/projected/d3e852fd-628a-4d2e-9a2c-541d4a0e95a8-kube-api-access-k2c9g\") pod \"payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw\" (UID: \"d3e852fd-628a-4d2e-9a2c-541d4a0e95a8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw"
Sep 19 15:41:49.806457 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:49.806361    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw"
Sep 19 15:41:50.082637 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:50.082606    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw"]
Sep 19 15:41:50.084262 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:41:50.084235    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3e852fd_628a_4d2e_9a2c_541d4a0e95a8.slice/crio-25482ebb6d29815ba86260e093b4ec9b90f91549279348e98e55178c5f82adf6 WatchSource:0}: Error finding container 25482ebb6d29815ba86260e093b4ec9b90f91549279348e98e55178c5f82adf6: Status 404 returned error can't find the container with id 25482ebb6d29815ba86260e093b4ec9b90f91549279348e98e55178c5f82adf6
Sep 19 15:41:50.153378 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:50.153337    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw" event={"ID":"d3e852fd-628a-4d2e-9a2c-541d4a0e95a8","Type":"ContainerStarted","Data":"25482ebb6d29815ba86260e093b4ec9b90f91549279348e98e55178c5f82adf6"}
Sep 19 15:41:51.161484 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:51.161451    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw" event={"ID":"d3e852fd-628a-4d2e-9a2c-541d4a0e95a8","Type":"ContainerStarted","Data":"661e8f3b00a0fc6b58fe9e76b8b69acc0f23cddfc620743bfa8a76e9661497b8"}
Sep 19 15:41:51.161954 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:51.161664    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw"
Sep 19 15:41:51.176254 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:41:51.176208    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw" podStartSLOduration=2.176194366 podStartE2EDuration="2.176194366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:41:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:41:51.174348793 +0000 UTC m=+1786.063548505" watchObservedRunningTime="2026-09-19 15:41:51.176194366 +0000 UTC m=+1786.065394077"
Sep 19 15:42:02.171005 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:42:02.170972    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw"
Sep 19 15:42:05.721265 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:42:05.721239    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/1.log"
Sep 19 15:42:05.727146 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:42:05.727127    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/1.log"
Sep 19 15:42:56.565037 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:42:56.564997    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw"]
Sep 19 15:42:56.566221 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:42:56.565275    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw" podUID="d3e852fd-628a-4d2e-9a2c-541d4a0e95a8" containerName="payload-pre-processing" containerID="cri-o://661e8f3b00a0fc6b58fe9e76b8b69acc0f23cddfc620743bfa8a76e9661497b8" gracePeriod=30
Sep 19 15:42:56.839862 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:42:56.839836    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw"
Sep 19 15:42:56.847044 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:42:56.847021    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2c9g\" (UniqueName: \"kubernetes.io/projected/d3e852fd-628a-4d2e-9a2c-541d4a0e95a8-kube-api-access-k2c9g\") pod \"d3e852fd-628a-4d2e-9a2c-541d4a0e95a8\" (UID: \"d3e852fd-628a-4d2e-9a2c-541d4a0e95a8\") "
Sep 19 15:42:56.847137 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:42:56.847102    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3e852fd-628a-4d2e-9a2c-541d4a0e95a8-plugins-config-volume\") pod \"d3e852fd-628a-4d2e-9a2c-541d4a0e95a8\" (UID: \"d3e852fd-628a-4d2e-9a2c-541d4a0e95a8\") "
Sep 19 15:42:56.847463 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:42:56.847439    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3e852fd-628a-4d2e-9a2c-541d4a0e95a8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d3e852fd-628a-4d2e-9a2c-541d4a0e95a8" (UID: "d3e852fd-628a-4d2e-9a2c-541d4a0e95a8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:42:56.849455 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:42:56.849428    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3e852fd-628a-4d2e-9a2c-541d4a0e95a8-kube-api-access-k2c9g" (OuterVolumeSpecName: "kube-api-access-k2c9g") pod "d3e852fd-628a-4d2e-9a2c-541d4a0e95a8" (UID: "d3e852fd-628a-4d2e-9a2c-541d4a0e95a8"). InnerVolumeSpecName "kube-api-access-k2c9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:42:56.948374 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:42:56.948337    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3e852fd-628a-4d2e-9a2c-541d4a0e95a8-plugins-config-volume\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:42:56.948374 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:42:56.948365    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2c9g\" (UniqueName: \"kubernetes.io/projected/d3e852fd-628a-4d2e-9a2c-541d4a0e95a8-kube-api-access-k2c9g\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:42:57.595386 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:42:57.595331    2563 generic.go:356] "Generic (PLEG): container finished" podID="d3e852fd-628a-4d2e-9a2c-541d4a0e95a8" containerID="661e8f3b00a0fc6b58fe9e76b8b69acc0f23cddfc620743bfa8a76e9661497b8" exitCode=0
Sep 19 15:42:57.595386 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:42:57.595387    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw"
Sep 19 15:42:57.595998 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:42:57.595412    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw" event={"ID":"d3e852fd-628a-4d2e-9a2c-541d4a0e95a8","Type":"ContainerDied","Data":"661e8f3b00a0fc6b58fe9e76b8b69acc0f23cddfc620743bfa8a76e9661497b8"}
Sep 19 15:42:57.595998 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:42:57.595471    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw" event={"ID":"d3e852fd-628a-4d2e-9a2c-541d4a0e95a8","Type":"ContainerDied","Data":"25482ebb6d29815ba86260e093b4ec9b90f91549279348e98e55178c5f82adf6"}
Sep 19 15:42:57.595998 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:42:57.595500    2563 scope.go:117] "RemoveContainer" containerID="661e8f3b00a0fc6b58fe9e76b8b69acc0f23cddfc620743bfa8a76e9661497b8"
Sep 19 15:42:57.605312 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:42:57.605292    2563 scope.go:117] "RemoveContainer" containerID="661e8f3b00a0fc6b58fe9e76b8b69acc0f23cddfc620743bfa8a76e9661497b8"
Sep 19 15:42:57.605607 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:42:57.605585    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"661e8f3b00a0fc6b58fe9e76b8b69acc0f23cddfc620743bfa8a76e9661497b8\": container with ID starting with 661e8f3b00a0fc6b58fe9e76b8b69acc0f23cddfc620743bfa8a76e9661497b8 not found: ID does not exist" containerID="661e8f3b00a0fc6b58fe9e76b8b69acc0f23cddfc620743bfa8a76e9661497b8"
Sep 19 15:42:57.605679 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:42:57.605614    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"661e8f3b00a0fc6b58fe9e76b8b69acc0f23cddfc620743bfa8a76e9661497b8"} err="failed to get container status \"661e8f3b00a0fc6b58fe9e76b8b69acc0f23cddfc620743bfa8a76e9661497b8\": rpc error: code = NotFound desc = could not find container \"661e8f3b00a0fc6b58fe9e76b8b69acc0f23cddfc620743bfa8a76e9661497b8\": container with ID starting with 661e8f3b00a0fc6b58fe9e76b8b69acc0f23cddfc620743bfa8a76e9661497b8 not found: ID does not exist"
Sep 19 15:42:57.616660 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:42:57.616634    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw"]
Sep 19 15:42:57.620336 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:42:57.620313    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw"]
Sep 19 15:42:57.641293 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:42:57.641269    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3e852fd-628a-4d2e-9a2c-541d4a0e95a8" path="/var/lib/kubelet/pods/d3e852fd-628a-4d2e-9a2c-541d4a0e95a8/volumes"
Sep 19 15:43:13.831433 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:13.831402    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"]
Sep 19 15:43:13.831973 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:13.831643    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h" podUID="fb88e07a-f6f1-450a-9db5-03384b6a58c2" containerName="maas-api" containerID="cri-o://5e506fdf9e7ac605aa6ae9f0976b0a154b725e2fc1760a2c4ecf267fb94800ce" gracePeriod=30
Sep 19 15:43:14.098119 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:14.098033    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"
Sep 19 15:43:14.217276 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:14.217242    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb88e07a-f6f1-450a-9db5-03384b6a58c2-openshift-service-ca\") pod \"fb88e07a-f6f1-450a-9db5-03384b6a58c2\" (UID: \"fb88e07a-f6f1-450a-9db5-03384b6a58c2\") "
Sep 19 15:43:14.217433 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:14.217286    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb88e07a-f6f1-450a-9db5-03384b6a58c2-maas-api-tls\") pod \"fb88e07a-f6f1-450a-9db5-03384b6a58c2\" (UID: \"fb88e07a-f6f1-450a-9db5-03384b6a58c2\") "
Sep 19 15:43:14.217433 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:14.217371    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb88e07a-f6f1-450a-9db5-03384b6a58c2-metrics-certs\") pod \"fb88e07a-f6f1-450a-9db5-03384b6a58c2\" (UID: \"fb88e07a-f6f1-450a-9db5-03384b6a58c2\") "
Sep 19 15:43:14.217433 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:14.217409    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6t2kr\" (UniqueName: \"kubernetes.io/projected/fb88e07a-f6f1-450a-9db5-03384b6a58c2-kube-api-access-6t2kr\") pod \"fb88e07a-f6f1-450a-9db5-03384b6a58c2\" (UID: \"fb88e07a-f6f1-450a-9db5-03384b6a58c2\") "
Sep 19 15:43:14.217689 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:14.217656    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb88e07a-f6f1-450a-9db5-03384b6a58c2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fb88e07a-f6f1-450a-9db5-03384b6a58c2" (UID: "fb88e07a-f6f1-450a-9db5-03384b6a58c2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:43:14.219626 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:14.219593    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb88e07a-f6f1-450a-9db5-03384b6a58c2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fb88e07a-f6f1-450a-9db5-03384b6a58c2" (UID: "fb88e07a-f6f1-450a-9db5-03384b6a58c2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:43:14.219711 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:14.219634    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb88e07a-f6f1-450a-9db5-03384b6a58c2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fb88e07a-f6f1-450a-9db5-03384b6a58c2" (UID: "fb88e07a-f6f1-450a-9db5-03384b6a58c2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:43:14.219711 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:14.219672    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb88e07a-f6f1-450a-9db5-03384b6a58c2-kube-api-access-6t2kr" (OuterVolumeSpecName: "kube-api-access-6t2kr") pod "fb88e07a-f6f1-450a-9db5-03384b6a58c2" (UID: "fb88e07a-f6f1-450a-9db5-03384b6a58c2"). InnerVolumeSpecName "kube-api-access-6t2kr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:43:14.319106 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:14.319069    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb88e07a-f6f1-450a-9db5-03384b6a58c2-metrics-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:43:14.319106 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:14.319100    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6t2kr\" (UniqueName: \"kubernetes.io/projected/fb88e07a-f6f1-450a-9db5-03384b6a58c2-kube-api-access-6t2kr\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:43:14.319106 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:14.319111    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb88e07a-f6f1-450a-9db5-03384b6a58c2-openshift-service-ca\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:43:14.319334 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:14.319119    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb88e07a-f6f1-450a-9db5-03384b6a58c2-maas-api-tls\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:43:14.706245 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:14.706204    2563 generic.go:356] "Generic (PLEG): container finished" podID="fb88e07a-f6f1-450a-9db5-03384b6a58c2" containerID="5e506fdf9e7ac605aa6ae9f0976b0a154b725e2fc1760a2c4ecf267fb94800ce" exitCode=0
Sep 19 15:43:14.706245 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:14.706245    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"
Sep 19 15:43:14.706451 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:14.706286    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h" event={"ID":"fb88e07a-f6f1-450a-9db5-03384b6a58c2","Type":"ContainerDied","Data":"5e506fdf9e7ac605aa6ae9f0976b0a154b725e2fc1760a2c4ecf267fb94800ce"}
Sep 19 15:43:14.706451 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:14.706338    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h" event={"ID":"fb88e07a-f6f1-450a-9db5-03384b6a58c2","Type":"ContainerDied","Data":"ff613631518a27550d16cf8d523526ef6803911639d4338229772321b3b54e80"}
Sep 19 15:43:14.706451 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:14.706366    2563 scope.go:117] "RemoveContainer" containerID="5e506fdf9e7ac605aa6ae9f0976b0a154b725e2fc1760a2c4ecf267fb94800ce"
Sep 19 15:43:14.717118 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:14.717100    2563 scope.go:117] "RemoveContainer" containerID="5e506fdf9e7ac605aa6ae9f0976b0a154b725e2fc1760a2c4ecf267fb94800ce"
Sep 19 15:43:14.717382 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:43:14.717367    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e506fdf9e7ac605aa6ae9f0976b0a154b725e2fc1760a2c4ecf267fb94800ce\": container with ID starting with 5e506fdf9e7ac605aa6ae9f0976b0a154b725e2fc1760a2c4ecf267fb94800ce not found: ID does not exist" containerID="5e506fdf9e7ac605aa6ae9f0976b0a154b725e2fc1760a2c4ecf267fb94800ce"
Sep 19 15:43:14.717427 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:14.717389    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e506fdf9e7ac605aa6ae9f0976b0a154b725e2fc1760a2c4ecf267fb94800ce"} err="failed to get container status \"5e506fdf9e7ac605aa6ae9f0976b0a154b725e2fc1760a2c4ecf267fb94800ce\": rpc error: code = NotFound desc = could not find container \"5e506fdf9e7ac605aa6ae9f0976b0a154b725e2fc1760a2c4ecf267fb94800ce\": container with ID starting with 5e506fdf9e7ac605aa6ae9f0976b0a154b725e2fc1760a2c4ecf267fb94800ce not found: ID does not exist"
Sep 19 15:43:14.728518 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:14.728494    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"]
Sep 19 15:43:14.732267 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:14.732243    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-c8e1cf-5d4cc998bb-vnl4h"]
Sep 19 15:43:15.641994 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:15.641960    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb88e07a-f6f1-450a-9db5-03384b6a58c2" path="/var/lib/kubelet/pods/fb88e07a-f6f1-450a-9db5-03384b6a58c2/volumes"
Sep 19 15:43:31.239699 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.239607    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"]
Sep 19 15:43:31.240647 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.240580    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69" podUID="e07d4659-d78d-49f5-ad50-c3a5acfe220c" containerName="maas-api" containerID="cri-o://bd032d12e1a7bebd1c0b1fe831890ac4057f26f130c3a4aa50178fb78fd368d5" gracePeriod=30
Sep 19 15:43:31.484324 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.484298    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"
Sep 19 15:43:31.590310 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.590239    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e07d4659-d78d-49f5-ad50-c3a5acfe220c-metrics-certs\") pod \"e07d4659-d78d-49f5-ad50-c3a5acfe220c\" (UID: \"e07d4659-d78d-49f5-ad50-c3a5acfe220c\") "
Sep 19 15:43:31.590310 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.590285    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmxkv\" (UniqueName: \"kubernetes.io/projected/e07d4659-d78d-49f5-ad50-c3a5acfe220c-kube-api-access-kmxkv\") pod \"e07d4659-d78d-49f5-ad50-c3a5acfe220c\" (UID: \"e07d4659-d78d-49f5-ad50-c3a5acfe220c\") "
Sep 19 15:43:31.590310 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.590301    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e07d4659-d78d-49f5-ad50-c3a5acfe220c-maas-api-tls\") pod \"e07d4659-d78d-49f5-ad50-c3a5acfe220c\" (UID: \"e07d4659-d78d-49f5-ad50-c3a5acfe220c\") "
Sep 19 15:43:31.590592 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.590441    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e07d4659-d78d-49f5-ad50-c3a5acfe220c-openshift-service-ca\") pod \"e07d4659-d78d-49f5-ad50-c3a5acfe220c\" (UID: \"e07d4659-d78d-49f5-ad50-c3a5acfe220c\") "
Sep 19 15:43:31.590865 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.590829    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e07d4659-d78d-49f5-ad50-c3a5acfe220c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e07d4659-d78d-49f5-ad50-c3a5acfe220c" (UID: "e07d4659-d78d-49f5-ad50-c3a5acfe220c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:43:31.592856 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.592829    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e07d4659-d78d-49f5-ad50-c3a5acfe220c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e07d4659-d78d-49f5-ad50-c3a5acfe220c" (UID: "e07d4659-d78d-49f5-ad50-c3a5acfe220c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:43:31.593061 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.593040    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e07d4659-d78d-49f5-ad50-c3a5acfe220c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e07d4659-d78d-49f5-ad50-c3a5acfe220c" (UID: "e07d4659-d78d-49f5-ad50-c3a5acfe220c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:43:31.593061 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.593056    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e07d4659-d78d-49f5-ad50-c3a5acfe220c-kube-api-access-kmxkv" (OuterVolumeSpecName: "kube-api-access-kmxkv") pod "e07d4659-d78d-49f5-ad50-c3a5acfe220c" (UID: "e07d4659-d78d-49f5-ad50-c3a5acfe220c"). InnerVolumeSpecName "kube-api-access-kmxkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:43:31.691602 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.691563    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e07d4659-d78d-49f5-ad50-c3a5acfe220c-metrics-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:43:31.691602 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.691592    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmxkv\" (UniqueName: \"kubernetes.io/projected/e07d4659-d78d-49f5-ad50-c3a5acfe220c-kube-api-access-kmxkv\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:43:31.691602 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.691602    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e07d4659-d78d-49f5-ad50-c3a5acfe220c-maas-api-tls\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:43:31.691602 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.691611    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e07d4659-d78d-49f5-ad50-c3a5acfe220c-openshift-service-ca\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:43:31.812646 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.812615    2563 generic.go:356] "Generic (PLEG): container finished" podID="e07d4659-d78d-49f5-ad50-c3a5acfe220c" containerID="bd032d12e1a7bebd1c0b1fe831890ac4057f26f130c3a4aa50178fb78fd368d5" exitCode=0
Sep 19 15:43:31.812822 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.812665    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"
Sep 19 15:43:31.812822 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.812703    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69" event={"ID":"e07d4659-d78d-49f5-ad50-c3a5acfe220c","Type":"ContainerDied","Data":"bd032d12e1a7bebd1c0b1fe831890ac4057f26f130c3a4aa50178fb78fd368d5"}
Sep 19 15:43:31.812822 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.812764    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69" event={"ID":"e07d4659-d78d-49f5-ad50-c3a5acfe220c","Type":"ContainerDied","Data":"a3f5c46ad8e70c25f0f3b41b34e70e6b3c6629eefba3b1bf0a4e948970ef7111"}
Sep 19 15:43:31.812822 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.812790    2563 scope.go:117] "RemoveContainer" containerID="bd032d12e1a7bebd1c0b1fe831890ac4057f26f130c3a4aa50178fb78fd368d5"
Sep 19 15:43:31.823079 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.823055    2563 scope.go:117] "RemoveContainer" containerID="bd032d12e1a7bebd1c0b1fe831890ac4057f26f130c3a4aa50178fb78fd368d5"
Sep 19 15:43:31.823394 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:43:31.823365    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd032d12e1a7bebd1c0b1fe831890ac4057f26f130c3a4aa50178fb78fd368d5\": container with ID starting with bd032d12e1a7bebd1c0b1fe831890ac4057f26f130c3a4aa50178fb78fd368d5 not found: ID does not exist" containerID="bd032d12e1a7bebd1c0b1fe831890ac4057f26f130c3a4aa50178fb78fd368d5"
Sep 19 15:43:31.823446 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.823403    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd032d12e1a7bebd1c0b1fe831890ac4057f26f130c3a4aa50178fb78fd368d5"} err="failed to get container status \"bd032d12e1a7bebd1c0b1fe831890ac4057f26f130c3a4aa50178fb78fd368d5\": rpc error: code = NotFound desc = could not find container \"bd032d12e1a7bebd1c0b1fe831890ac4057f26f130c3a4aa50178fb78fd368d5\": container with ID starting with bd032d12e1a7bebd1c0b1fe831890ac4057f26f130c3a4aa50178fb78fd368d5 not found: ID does not exist"
Sep 19 15:43:31.832217 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.832193    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"]
Sep 19 15:43:31.834701 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:31.834679    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-da587f-5684d94584-7fd69"]
Sep 19 15:43:33.641320 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:43:33.641288    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e07d4659-d78d-49f5-ad50-c3a5acfe220c" path="/var/lib/kubelet/pods/e07d4659-d78d-49f5-ad50-c3a5acfe220c/volumes"
Sep 19 15:44:58.205475 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:44:58.205450    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-85fd65c94c-d9qjb_84b17b0d-760c-4abd-a213-03033d4ddab7/payload-processing/0.log"
Sep 19 15:44:58.322875 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:44:58.322847    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-85fd65c94c-d9qjb_84b17b0d-760c-4abd-a213-03033d4ddab7/payload-processing/0.log"
Sep 19 15:46:00.185257 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:00.185229    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-85fd65c94c-d9qjb_84b17b0d-760c-4abd-a213-03033d4ddab7/payload-processing/0.log"
Sep 19 15:46:00.301235 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:00.301208    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-85fd65c94c-d9qjb_84b17b0d-760c-4abd-a213-03033d4ddab7/payload-processing/0.log"
Sep 19 15:46:06.653127 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.653088    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"]
Sep 19 15:46:06.653566 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.653523    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb88e07a-f6f1-450a-9db5-03384b6a58c2" containerName="maas-api"
Sep 19 15:46:06.653566 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.653535    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb88e07a-f6f1-450a-9db5-03384b6a58c2" containerName="maas-api"
Sep 19 15:46:06.653566 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.653557    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3e852fd-628a-4d2e-9a2c-541d4a0e95a8" containerName="payload-pre-processing"
Sep 19 15:46:06.653566 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.653562    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3e852fd-628a-4d2e-9a2c-541d4a0e95a8" containerName="payload-pre-processing"
Sep 19 15:46:06.653700 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.653571    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e07d4659-d78d-49f5-ad50-c3a5acfe220c" containerName="maas-api"
Sep 19 15:46:06.653700 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.653577    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e07d4659-d78d-49f5-ad50-c3a5acfe220c" containerName="maas-api"
Sep 19 15:46:06.653700 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.653636    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3e852fd-628a-4d2e-9a2c-541d4a0e95a8" containerName="payload-pre-processing"
Sep 19 15:46:06.653700 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.653645    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e07d4659-d78d-49f5-ad50-c3a5acfe220c" containerName="maas-api"
Sep 19 15:46:06.653700 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.653652    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb88e07a-f6f1-450a-9db5-03384b6a58c2" containerName="maas-api"
Sep 19 15:46:06.657663 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.657641    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"
Sep 19 15:46:06.659661 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.659638    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-fa8af0-serving-cert\""
Sep 19 15:46:06.668746 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.668675    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"]
Sep 19 15:46:06.741266 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.741234    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d65ba35c-20c1-4873-a9ad-5ada19776fdc-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw\" (UID: \"d65ba35c-20c1-4873-a9ad-5ada19776fdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"
Sep 19 15:46:06.741266 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.741269    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd5q6\" (UniqueName: \"kubernetes.io/projected/d65ba35c-20c1-4873-a9ad-5ada19776fdc-kube-api-access-dd5q6\") pod \"maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw\" (UID: \"d65ba35c-20c1-4873-a9ad-5ada19776fdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"
Sep 19 15:46:06.741504 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.741307    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d65ba35c-20c1-4873-a9ad-5ada19776fdc-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw\" (UID: \"d65ba35c-20c1-4873-a9ad-5ada19776fdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"
Sep 19 15:46:06.741504 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.741372    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d65ba35c-20c1-4873-a9ad-5ada19776fdc-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw\" (UID: \"d65ba35c-20c1-4873-a9ad-5ada19776fdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"
Sep 19 15:46:06.842024 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.841983    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d65ba35c-20c1-4873-a9ad-5ada19776fdc-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw\" (UID: \"d65ba35c-20c1-4873-a9ad-5ada19776fdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"
Sep 19 15:46:06.842024 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.842024    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd5q6\" (UniqueName: \"kubernetes.io/projected/d65ba35c-20c1-4873-a9ad-5ada19776fdc-kube-api-access-dd5q6\") pod \"maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw\" (UID: \"d65ba35c-20c1-4873-a9ad-5ada19776fdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"
Sep 19 15:46:06.842301 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.842070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d65ba35c-20c1-4873-a9ad-5ada19776fdc-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw\" (UID: \"d65ba35c-20c1-4873-a9ad-5ada19776fdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"
Sep 19 15:46:06.842301 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.842150    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d65ba35c-20c1-4873-a9ad-5ada19776fdc-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw\" (UID: \"d65ba35c-20c1-4873-a9ad-5ada19776fdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"
Sep 19 15:46:06.842301 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:46:06.842270    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-serving-cert: secret "maas-api-e2e-ipp-cleanup-fa8af0-serving-cert" not found
Sep 19 15:46:06.842485 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:46:06.842369    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d65ba35c-20c1-4873-a9ad-5ada19776fdc-maas-api-tls podName:d65ba35c-20c1-4873-a9ad-5ada19776fdc nodeName:}" failed. No retries permitted until 2026-09-19 15:46:07.342347921 +0000 UTC m=+2042.231547628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d65ba35c-20c1-4873-a9ad-5ada19776fdc-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw" (UID: "d65ba35c-20c1-4873-a9ad-5ada19776fdc") : secret "maas-api-e2e-ipp-cleanup-fa8af0-serving-cert" not found
Sep 19 15:46:06.842733 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.842711    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d65ba35c-20c1-4873-a9ad-5ada19776fdc-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw\" (UID: \"d65ba35c-20c1-4873-a9ad-5ada19776fdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"
Sep 19 15:46:06.844640 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.844619    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d65ba35c-20c1-4873-a9ad-5ada19776fdc-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw\" (UID: \"d65ba35c-20c1-4873-a9ad-5ada19776fdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"
Sep 19 15:46:06.849767 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:06.849744    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd5q6\" (UniqueName: \"kubernetes.io/projected/d65ba35c-20c1-4873-a9ad-5ada19776fdc-kube-api-access-dd5q6\") pod \"maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw\" (UID: \"d65ba35c-20c1-4873-a9ad-5ada19776fdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"
Sep 19 15:46:07.348421 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:07.348384    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d65ba35c-20c1-4873-a9ad-5ada19776fdc-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw\" (UID: \"d65ba35c-20c1-4873-a9ad-5ada19776fdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"
Sep 19 15:46:07.350977 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:07.350952    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d65ba35c-20c1-4873-a9ad-5ada19776fdc-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw\" (UID: \"d65ba35c-20c1-4873-a9ad-5ada19776fdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"
Sep 19 15:46:07.572216 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:07.572180    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"
Sep 19 15:46:07.847640 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:07.847615    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"]
Sep 19 15:46:07.848948 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:46:07.848924    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd65ba35c_20c1_4873_a9ad_5ada19776fdc.slice/crio-4efde6e385f10a3108630916aeaac33c9504a2d2f3e1c510da50a858fddb55d9 WatchSource:0}: Error finding container 4efde6e385f10a3108630916aeaac33c9504a2d2f3e1c510da50a858fddb55d9: Status 404 returned error can't find the container with id 4efde6e385f10a3108630916aeaac33c9504a2d2f3e1c510da50a858fddb55d9
Sep 19 15:46:07.850354 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:07.850336    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 15:46:08.734158 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:08.734060    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw" event={"ID":"d65ba35c-20c1-4873-a9ad-5ada19776fdc","Type":"ContainerStarted","Data":"34dfa618bccfe0e877c842b5aaa582bdd22ebd72dcaff201fda327bf3d9d0419"}
Sep 19 15:46:08.734158 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:08.734118    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw" event={"ID":"d65ba35c-20c1-4873-a9ad-5ada19776fdc","Type":"ContainerStarted","Data":"4efde6e385f10a3108630916aeaac33c9504a2d2f3e1c510da50a858fddb55d9"}
Sep 19 15:46:08.734158 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:08.734142    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"
Sep 19 15:46:08.750008 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:08.749961    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw" podStartSLOduration=2.170240714 podStartE2EDuration="2.749945174s" totalImagesPullingTime="579.70446ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:46:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:46:08.748417207 +0000 UTC m=+2043.637616920" watchObservedRunningTime="2026-09-19 15:46:08.749945174 +0000 UTC m=+2043.639144886"
Sep 19 15:46:14.746095 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:14.746066    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"
Sep 19 15:46:45.549641 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:45.549555    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"]
Sep 19 15:46:45.550251 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:45.550042    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw" podUID="d65ba35c-20c1-4873-a9ad-5ada19776fdc" containerName="maas-api" containerID="cri-o://34dfa618bccfe0e877c842b5aaa582bdd22ebd72dcaff201fda327bf3d9d0419" gracePeriod=30
Sep 19 15:46:45.823589 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:45.823551    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"
Sep 19 15:46:45.935646 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:45.935612    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d65ba35c-20c1-4873-a9ad-5ada19776fdc-maas-api-tls\") pod \"d65ba35c-20c1-4873-a9ad-5ada19776fdc\" (UID: \"d65ba35c-20c1-4873-a9ad-5ada19776fdc\") "
Sep 19 15:46:45.935844 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:45.935683    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d65ba35c-20c1-4873-a9ad-5ada19776fdc-metrics-certs\") pod \"d65ba35c-20c1-4873-a9ad-5ada19776fdc\" (UID: \"d65ba35c-20c1-4873-a9ad-5ada19776fdc\") "
Sep 19 15:46:45.935844 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:45.935718    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dd5q6\" (UniqueName: \"kubernetes.io/projected/d65ba35c-20c1-4873-a9ad-5ada19776fdc-kube-api-access-dd5q6\") pod \"d65ba35c-20c1-4873-a9ad-5ada19776fdc\" (UID: \"d65ba35c-20c1-4873-a9ad-5ada19776fdc\") "
Sep 19 15:46:45.935844 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:45.935762    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d65ba35c-20c1-4873-a9ad-5ada19776fdc-openshift-service-ca\") pod \"d65ba35c-20c1-4873-a9ad-5ada19776fdc\" (UID: \"d65ba35c-20c1-4873-a9ad-5ada19776fdc\") "
Sep 19 15:46:45.936158 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:45.936132    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d65ba35c-20c1-4873-a9ad-5ada19776fdc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d65ba35c-20c1-4873-a9ad-5ada19776fdc" (UID: "d65ba35c-20c1-4873-a9ad-5ada19776fdc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:46:45.938011 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:45.937980    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d65ba35c-20c1-4873-a9ad-5ada19776fdc-kube-api-access-dd5q6" (OuterVolumeSpecName: "kube-api-access-dd5q6") pod "d65ba35c-20c1-4873-a9ad-5ada19776fdc" (UID: "d65ba35c-20c1-4873-a9ad-5ada19776fdc"). InnerVolumeSpecName "kube-api-access-dd5q6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:46:45.938123 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:45.938037    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d65ba35c-20c1-4873-a9ad-5ada19776fdc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d65ba35c-20c1-4873-a9ad-5ada19776fdc" (UID: "d65ba35c-20c1-4873-a9ad-5ada19776fdc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:46:45.938123 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:45.938079    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d65ba35c-20c1-4873-a9ad-5ada19776fdc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d65ba35c-20c1-4873-a9ad-5ada19776fdc" (UID: "d65ba35c-20c1-4873-a9ad-5ada19776fdc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:46:45.968387 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:45.968352    2563 generic.go:356] "Generic (PLEG): container finished" podID="d65ba35c-20c1-4873-a9ad-5ada19776fdc" containerID="34dfa618bccfe0e877c842b5aaa582bdd22ebd72dcaff201fda327bf3d9d0419" exitCode=0
Sep 19 15:46:45.968541 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:45.968400    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"
Sep 19 15:46:45.968541 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:45.968432    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw" event={"ID":"d65ba35c-20c1-4873-a9ad-5ada19776fdc","Type":"ContainerDied","Data":"34dfa618bccfe0e877c842b5aaa582bdd22ebd72dcaff201fda327bf3d9d0419"}
Sep 19 15:46:45.968541 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:45.968482    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw" event={"ID":"d65ba35c-20c1-4873-a9ad-5ada19776fdc","Type":"ContainerDied","Data":"4efde6e385f10a3108630916aeaac33c9504a2d2f3e1c510da50a858fddb55d9"}
Sep 19 15:46:45.968541 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:45.968505    2563 scope.go:117] "RemoveContainer" containerID="34dfa618bccfe0e877c842b5aaa582bdd22ebd72dcaff201fda327bf3d9d0419"
Sep 19 15:46:45.983431 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:45.983399    2563 scope.go:117] "RemoveContainer" containerID="34dfa618bccfe0e877c842b5aaa582bdd22ebd72dcaff201fda327bf3d9d0419"
Sep 19 15:46:45.983770 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:46:45.983748    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34dfa618bccfe0e877c842b5aaa582bdd22ebd72dcaff201fda327bf3d9d0419\": container with ID starting with 34dfa618bccfe0e877c842b5aaa582bdd22ebd72dcaff201fda327bf3d9d0419 not found: ID does not exist" containerID="34dfa618bccfe0e877c842b5aaa582bdd22ebd72dcaff201fda327bf3d9d0419"
Sep 19 15:46:45.983868 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:45.983783    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34dfa618bccfe0e877c842b5aaa582bdd22ebd72dcaff201fda327bf3d9d0419"} err="failed to get container status \"34dfa618bccfe0e877c842b5aaa582bdd22ebd72dcaff201fda327bf3d9d0419\": rpc error: code = NotFound desc = could not find container \"34dfa618bccfe0e877c842b5aaa582bdd22ebd72dcaff201fda327bf3d9d0419\": container with ID starting with 34dfa618bccfe0e877c842b5aaa582bdd22ebd72dcaff201fda327bf3d9d0419 not found: ID does not exist"
Sep 19 15:46:46.001808 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:46.001768    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"]
Sep 19 15:46:46.014241 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:46.014210    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fa8af0-77c85c8-ztbvw"]
Sep 19 15:46:46.037361 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:46.037335    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d65ba35c-20c1-4873-a9ad-5ada19776fdc-maas-api-tls\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:46:46.037361 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:46.037359    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d65ba35c-20c1-4873-a9ad-5ada19776fdc-metrics-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:46:46.037547 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:46.037369    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dd5q6\" (UniqueName: \"kubernetes.io/projected/d65ba35c-20c1-4873-a9ad-5ada19776fdc-kube-api-access-dd5q6\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:46:46.037547 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:46.037390    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d65ba35c-20c1-4873-a9ad-5ada19776fdc-openshift-service-ca\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:46:47.646311 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:46:47.646271    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d65ba35c-20c1-4873-a9ad-5ada19776fdc" path="/var/lib/kubelet/pods/d65ba35c-20c1-4873-a9ad-5ada19776fdc/volumes"
Sep 19 15:47:05.769813 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:47:05.769781    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/1.log"
Sep 19 15:47:05.778587 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:47:05.778550    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/1.log"
Sep 19 15:48:28.220107 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.220060    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"]
Sep 19 15:48:28.221043 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.220946    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss" podUID="153d5b94-f0c7-4296-b5af-4f5f85878cf2" containerName="maas-api" containerID="cri-o://d241b08011e4f678bd0d628e0014cee05391d2c6d1d6f13a0000c3effc59b1eb" gracePeriod=30
Sep 19 15:48:28.269157 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.269113    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz"]
Sep 19 15:48:28.269618 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.269585    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz" podUID="9fa503d6-642c-40d7-9968-01b21e0d477f" containerName="payload-processing" containerID="cri-o://c1a50e560d2e93d483575a8bead648f16759e1fb98730d2915cf51119613bc99" gracePeriod=30
Sep 19 15:48:28.279521 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.279489    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t"]
Sep 19 15:48:28.279765 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.279740    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t" podUID="045b6834-4806-41ab-932f-e7eeb786ef2a" containerName="payload-pre-processing" containerID="cri-o://efab4c9d24c3beac10c3cc6c9850ea4441a564b08cc148e80248998195e7f0e8" gracePeriod=30
Sep 19 15:48:28.575294 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.575266    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"
Sep 19 15:48:28.586338 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.586304    2563 generic.go:356] "Generic (PLEG): container finished" podID="045b6834-4806-41ab-932f-e7eeb786ef2a" containerID="efab4c9d24c3beac10c3cc6c9850ea4441a564b08cc148e80248998195e7f0e8" exitCode=0
Sep 19 15:48:28.586494 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.586375    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t" event={"ID":"045b6834-4806-41ab-932f-e7eeb786ef2a","Type":"ContainerDied","Data":"efab4c9d24c3beac10c3cc6c9850ea4441a564b08cc148e80248998195e7f0e8"}
Sep 19 15:48:28.588181 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.588152    2563 generic.go:356] "Generic (PLEG): container finished" podID="153d5b94-f0c7-4296-b5af-4f5f85878cf2" containerID="d241b08011e4f678bd0d628e0014cee05391d2c6d1d6f13a0000c3effc59b1eb" exitCode=0
Sep 19 15:48:28.588288 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.588207    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"
Sep 19 15:48:28.588361 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.588307    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss" event={"ID":"153d5b94-f0c7-4296-b5af-4f5f85878cf2","Type":"ContainerDied","Data":"d241b08011e4f678bd0d628e0014cee05391d2c6d1d6f13a0000c3effc59b1eb"}
Sep 19 15:48:28.588417 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.588381    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss" event={"ID":"153d5b94-f0c7-4296-b5af-4f5f85878cf2","Type":"ContainerDied","Data":"3bfa556ab77ee2a6497a2f3521884acc0814bc77cf29e908d0f2aaedb79296be"}
Sep 19 15:48:28.588417 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.588400    2563 scope.go:117] "RemoveContainer" containerID="d241b08011e4f678bd0d628e0014cee05391d2c6d1d6f13a0000c3effc59b1eb"
Sep 19 15:48:28.590683 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.590658    2563 generic.go:356] "Generic (PLEG): container finished" podID="9fa503d6-642c-40d7-9968-01b21e0d477f" containerID="c1a50e560d2e93d483575a8bead648f16759e1fb98730d2915cf51119613bc99" exitCode=0
Sep 19 15:48:28.590804 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.590775    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz" event={"ID":"9fa503d6-642c-40d7-9968-01b21e0d477f","Type":"ContainerDied","Data":"c1a50e560d2e93d483575a8bead648f16759e1fb98730d2915cf51119613bc99"}
Sep 19 15:48:28.596421 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.596398    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz"
Sep 19 15:48:28.601286 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.601266    2563 scope.go:117] "RemoveContainer" containerID="d241b08011e4f678bd0d628e0014cee05391d2c6d1d6f13a0000c3effc59b1eb"
Sep 19 15:48:28.601596 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:48:28.601572    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d241b08011e4f678bd0d628e0014cee05391d2c6d1d6f13a0000c3effc59b1eb\": container with ID starting with d241b08011e4f678bd0d628e0014cee05391d2c6d1d6f13a0000c3effc59b1eb not found: ID does not exist" containerID="d241b08011e4f678bd0d628e0014cee05391d2c6d1d6f13a0000c3effc59b1eb"
Sep 19 15:48:28.601674 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.601608    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d241b08011e4f678bd0d628e0014cee05391d2c6d1d6f13a0000c3effc59b1eb"} err="failed to get container status \"d241b08011e4f678bd0d628e0014cee05391d2c6d1d6f13a0000c3effc59b1eb\": rpc error: code = NotFound desc = could not find container \"d241b08011e4f678bd0d628e0014cee05391d2c6d1d6f13a0000c3effc59b1eb\": container with ID starting with d241b08011e4f678bd0d628e0014cee05391d2c6d1d6f13a0000c3effc59b1eb not found: ID does not exist"
Sep 19 15:48:28.613634 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.613611    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t"
Sep 19 15:48:28.723237 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.723201    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/153d5b94-f0c7-4296-b5af-4f5f85878cf2-openshift-service-ca\") pod \"153d5b94-f0c7-4296-b5af-4f5f85878cf2\" (UID: \"153d5b94-f0c7-4296-b5af-4f5f85878cf2\") "
Sep 19 15:48:28.723408 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.723269    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/153d5b94-f0c7-4296-b5af-4f5f85878cf2-maas-api-tls\") pod \"153d5b94-f0c7-4296-b5af-4f5f85878cf2\" (UID: \"153d5b94-f0c7-4296-b5af-4f5f85878cf2\") "
Sep 19 15:48:28.723408 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.723294    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fa503d6-642c-40d7-9968-01b21e0d477f-plugins-config-volume\") pod \"9fa503d6-642c-40d7-9968-01b21e0d477f\" (UID: \"9fa503d6-642c-40d7-9968-01b21e0d477f\") "
Sep 19 15:48:28.723408 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.723338    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/153d5b94-f0c7-4296-b5af-4f5f85878cf2-metrics-certs\") pod \"153d5b94-f0c7-4296-b5af-4f5f85878cf2\" (UID: \"153d5b94-f0c7-4296-b5af-4f5f85878cf2\") "
Sep 19 15:48:28.723579 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.723558    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pngb\" (UniqueName: \"kubernetes.io/projected/153d5b94-f0c7-4296-b5af-4f5f85878cf2-kube-api-access-7pngb\") pod \"153d5b94-f0c7-4296-b5af-4f5f85878cf2\" (UID: \"153d5b94-f0c7-4296-b5af-4f5f85878cf2\") "
Sep 19 15:48:28.723670 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.723637    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2v8xw\" (UniqueName: \"kubernetes.io/projected/9fa503d6-642c-40d7-9968-01b21e0d477f-kube-api-access-2v8xw\") pod \"9fa503d6-642c-40d7-9968-01b21e0d477f\" (UID: \"9fa503d6-642c-40d7-9968-01b21e0d477f\") "
Sep 19 15:48:28.723670 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.723640    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/153d5b94-f0c7-4296-b5af-4f5f85878cf2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "153d5b94-f0c7-4296-b5af-4f5f85878cf2" (UID: "153d5b94-f0c7-4296-b5af-4f5f85878cf2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:48:28.723670 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.723652    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fa503d6-642c-40d7-9968-01b21e0d477f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9fa503d6-642c-40d7-9968-01b21e0d477f" (UID: "9fa503d6-642c-40d7-9968-01b21e0d477f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:48:28.723828 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.723718    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtlkk\" (UniqueName: \"kubernetes.io/projected/045b6834-4806-41ab-932f-e7eeb786ef2a-kube-api-access-vtlkk\") pod \"045b6834-4806-41ab-932f-e7eeb786ef2a\" (UID: \"045b6834-4806-41ab-932f-e7eeb786ef2a\") "
Sep 19 15:48:28.723828 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.723751    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/045b6834-4806-41ab-932f-e7eeb786ef2a-plugins-config-volume\") pod \"045b6834-4806-41ab-932f-e7eeb786ef2a\" (UID: \"045b6834-4806-41ab-932f-e7eeb786ef2a\") "
Sep 19 15:48:28.724097 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.724071    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/153d5b94-f0c7-4296-b5af-4f5f85878cf2-openshift-service-ca\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:28.724161 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.724104    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fa503d6-642c-40d7-9968-01b21e0d477f-plugins-config-volume\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:28.724218 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.724204    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/045b6834-4806-41ab-932f-e7eeb786ef2a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "045b6834-4806-41ab-932f-e7eeb786ef2a" (UID: "045b6834-4806-41ab-932f-e7eeb786ef2a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:48:28.726055 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.726032    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/045b6834-4806-41ab-932f-e7eeb786ef2a-kube-api-access-vtlkk" (OuterVolumeSpecName: "kube-api-access-vtlkk") pod "045b6834-4806-41ab-932f-e7eeb786ef2a" (UID: "045b6834-4806-41ab-932f-e7eeb786ef2a"). InnerVolumeSpecName "kube-api-access-vtlkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:48:28.726212 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.726199    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/153d5b94-f0c7-4296-b5af-4f5f85878cf2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "153d5b94-f0c7-4296-b5af-4f5f85878cf2" (UID: "153d5b94-f0c7-4296-b5af-4f5f85878cf2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:48:28.726379 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.726347    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fa503d6-642c-40d7-9968-01b21e0d477f-kube-api-access-2v8xw" (OuterVolumeSpecName: "kube-api-access-2v8xw") pod "9fa503d6-642c-40d7-9968-01b21e0d477f" (UID: "9fa503d6-642c-40d7-9968-01b21e0d477f"). InnerVolumeSpecName "kube-api-access-2v8xw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:48:28.726379 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.726360    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/153d5b94-f0c7-4296-b5af-4f5f85878cf2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "153d5b94-f0c7-4296-b5af-4f5f85878cf2" (UID: "153d5b94-f0c7-4296-b5af-4f5f85878cf2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:48:28.726551 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.726386    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/153d5b94-f0c7-4296-b5af-4f5f85878cf2-kube-api-access-7pngb" (OuterVolumeSpecName: "kube-api-access-7pngb") pod "153d5b94-f0c7-4296-b5af-4f5f85878cf2" (UID: "153d5b94-f0c7-4296-b5af-4f5f85878cf2"). InnerVolumeSpecName "kube-api-access-7pngb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:48:28.825194 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.825106    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtlkk\" (UniqueName: \"kubernetes.io/projected/045b6834-4806-41ab-932f-e7eeb786ef2a-kube-api-access-vtlkk\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:28.825194 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.825134    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/045b6834-4806-41ab-932f-e7eeb786ef2a-plugins-config-volume\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:28.825194 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.825147    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/153d5b94-f0c7-4296-b5af-4f5f85878cf2-maas-api-tls\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:28.825194 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.825155    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/153d5b94-f0c7-4296-b5af-4f5f85878cf2-metrics-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:28.825194 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.825164    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pngb\" (UniqueName: \"kubernetes.io/projected/153d5b94-f0c7-4296-b5af-4f5f85878cf2-kube-api-access-7pngb\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:28.825194 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.825172    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2v8xw\" (UniqueName: \"kubernetes.io/projected/9fa503d6-642c-40d7-9968-01b21e0d477f-kube-api-access-2v8xw\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:28.911106 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.911076    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"]
Sep 19 15:48:28.914794 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:28.914769    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-50372a-8578b7f7c7-vzvss"]
Sep 19 15:48:29.597985 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:29.597888    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz"
Sep 19 15:48:29.597985 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:29.597915    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz" event={"ID":"9fa503d6-642c-40d7-9968-01b21e0d477f","Type":"ContainerDied","Data":"ff2a70272eb822c2df9a82574b184db60e4acda48c688983715798a25e635996"}
Sep 19 15:48:29.598525 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:29.598006    2563 scope.go:117] "RemoveContainer" containerID="c1a50e560d2e93d483575a8bead648f16759e1fb98730d2915cf51119613bc99"
Sep 19 15:48:29.599515 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:29.599497    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t"
Sep 19 15:48:29.599575 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:29.599515    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t" event={"ID":"045b6834-4806-41ab-932f-e7eeb786ef2a","Type":"ContainerDied","Data":"93edd9d7436daf08d8bcfb576d1aeeb86833b0dc55dfc77ac2f73395a7b244c5"}
Sep 19 15:48:29.608501 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:29.608485    2563 scope.go:117] "RemoveContainer" containerID="efab4c9d24c3beac10c3cc6c9850ea4441a564b08cc148e80248998195e7f0e8"
Sep 19 15:48:29.619913 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:29.619874    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz"]
Sep 19 15:48:29.623821 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:29.623792    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz"]
Sep 19 15:48:29.642250 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:29.642196    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="153d5b94-f0c7-4296-b5af-4f5f85878cf2" path="/var/lib/kubelet/pods/153d5b94-f0c7-4296-b5af-4f5f85878cf2/volumes"
Sep 19 15:48:29.642747 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:29.642726    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fa503d6-642c-40d7-9968-01b21e0d477f" path="/var/lib/kubelet/pods/9fa503d6-642c-40d7-9968-01b21e0d477f/volumes"
Sep 19 15:48:29.643093 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:29.643080    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t"]
Sep 19 15:48:29.643147 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:29.643104    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t"]
Sep 19 15:48:31.641955 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:31.641920    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="045b6834-4806-41ab-932f-e7eeb786ef2a" path="/var/lib/kubelet/pods/045b6834-4806-41ab-932f-e7eeb786ef2a/volumes"
Sep 19 15:48:34.959007 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:34.958970    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"]
Sep 19 15:48:34.959509 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:34.959226    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb" podUID="25adf7ff-22b9-449b-8456-99a1deef1558" containerName="istio-proxy" containerID="cri-o://e3925414e1afa59d3e0566ca1579dbe2f1e4a0e9ccca72eeb61f3744112fab3d" gracePeriod=30
Sep 19 15:48:38.333924 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:38.333876    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 15:48:38.334295 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:38.333951    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb" podUID="25adf7ff-22b9-449b-8456-99a1deef1558" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 15:48:40.214365 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.214340    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:48:40.227418 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.227356    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-workload-socket\") pod \"25adf7ff-22b9-449b-8456-99a1deef1558\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") "
Sep 19 15:48:40.227418 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.227401    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnzlx\" (UniqueName: \"kubernetes.io/projected/25adf7ff-22b9-449b-8456-99a1deef1558-kube-api-access-cnzlx\") pod \"25adf7ff-22b9-449b-8456-99a1deef1558\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") "
Sep 19 15:48:40.227634 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.227455    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-istio-data\") pod \"25adf7ff-22b9-449b-8456-99a1deef1558\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") "
Sep 19 15:48:40.227634 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.227471    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25adf7ff-22b9-449b-8456-99a1deef1558-istio-token\") pod \"25adf7ff-22b9-449b-8456-99a1deef1558\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") "
Sep 19 15:48:40.227634 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.227590    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-credential-socket\") pod \"25adf7ff-22b9-449b-8456-99a1deef1558\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") "
Sep 19 15:48:40.227634 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.227633    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-istio-envoy\") pod \"25adf7ff-22b9-449b-8456-99a1deef1558\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") "
Sep 19 15:48:40.227849 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.227655    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "25adf7ff-22b9-449b-8456-99a1deef1558" (UID: "25adf7ff-22b9-449b-8456-99a1deef1558"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:48:40.227849 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.227672    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-workload-certs\") pod \"25adf7ff-22b9-449b-8456-99a1deef1558\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") "
Sep 19 15:48:40.227849 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.227673    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-istio-data" (OuterVolumeSpecName: "istio-data") pod "25adf7ff-22b9-449b-8456-99a1deef1558" (UID: "25adf7ff-22b9-449b-8456-99a1deef1558"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:48:40.227849 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.227708    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25adf7ff-22b9-449b-8456-99a1deef1558-istiod-ca-cert\") pod \"25adf7ff-22b9-449b-8456-99a1deef1558\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") "
Sep 19 15:48:40.227849 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.227765    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25adf7ff-22b9-449b-8456-99a1deef1558-istio-podinfo\") pod \"25adf7ff-22b9-449b-8456-99a1deef1558\" (UID: \"25adf7ff-22b9-449b-8456-99a1deef1558\") "
Sep 19 15:48:40.228788 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.227858    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "25adf7ff-22b9-449b-8456-99a1deef1558" (UID: "25adf7ff-22b9-449b-8456-99a1deef1558"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:48:40.228788 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.227870    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "25adf7ff-22b9-449b-8456-99a1deef1558" (UID: "25adf7ff-22b9-449b-8456-99a1deef1558"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:48:40.228788 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.228111    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25adf7ff-22b9-449b-8456-99a1deef1558-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "25adf7ff-22b9-449b-8456-99a1deef1558" (UID: "25adf7ff-22b9-449b-8456-99a1deef1558"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:48:40.228788 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.228130    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-workload-socket\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:40.228788 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.228153    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-istio-data\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:40.228788 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.228169    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-credential-socket\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:40.228788 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.228226    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-workload-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:40.230030 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.230005    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25adf7ff-22b9-449b-8456-99a1deef1558-istio-token" (OuterVolumeSpecName: "istio-token") pod "25adf7ff-22b9-449b-8456-99a1deef1558" (UID: "25adf7ff-22b9-449b-8456-99a1deef1558"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:48:40.230030 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.230013    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/25adf7ff-22b9-449b-8456-99a1deef1558-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "25adf7ff-22b9-449b-8456-99a1deef1558" (UID: "25adf7ff-22b9-449b-8456-99a1deef1558"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 15:48:40.230260 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.230239    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25adf7ff-22b9-449b-8456-99a1deef1558-kube-api-access-cnzlx" (OuterVolumeSpecName: "kube-api-access-cnzlx") pod "25adf7ff-22b9-449b-8456-99a1deef1558" (UID: "25adf7ff-22b9-449b-8456-99a1deef1558"). InnerVolumeSpecName "kube-api-access-cnzlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:48:40.230318 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.230297    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "25adf7ff-22b9-449b-8456-99a1deef1558" (UID: "25adf7ff-22b9-449b-8456-99a1deef1558"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:48:40.329472 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.329438    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnzlx\" (UniqueName: \"kubernetes.io/projected/25adf7ff-22b9-449b-8456-99a1deef1558-kube-api-access-cnzlx\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:40.329472 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.329469    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25adf7ff-22b9-449b-8456-99a1deef1558-istio-token\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:40.329472 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.329478    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25adf7ff-22b9-449b-8456-99a1deef1558-istio-envoy\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:40.329472 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.329485    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25adf7ff-22b9-449b-8456-99a1deef1558-istiod-ca-cert\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:40.329744 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.329494    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25adf7ff-22b9-449b-8456-99a1deef1558-istio-podinfo\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:40.674184 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.674096    2563 generic.go:356] "Generic (PLEG): container finished" podID="25adf7ff-22b9-449b-8456-99a1deef1558" containerID="e3925414e1afa59d3e0566ca1579dbe2f1e4a0e9ccca72eeb61f3744112fab3d" exitCode=0
Sep 19 15:48:40.674184 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.674146    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"
Sep 19 15:48:40.674184 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.674173    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb" event={"ID":"25adf7ff-22b9-449b-8456-99a1deef1558","Type":"ContainerDied","Data":"e3925414e1afa59d3e0566ca1579dbe2f1e4a0e9ccca72eeb61f3744112fab3d"}
Sep 19 15:48:40.674409 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.674229    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb" event={"ID":"25adf7ff-22b9-449b-8456-99a1deef1558","Type":"ContainerDied","Data":"c5d0a77d10ff33fec3b4eca81d85ee708fc060810fc13182adafcdc731e62b1b"}
Sep 19 15:48:40.674409 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.674255    2563 scope.go:117] "RemoveContainer" containerID="e3925414e1afa59d3e0566ca1579dbe2f1e4a0e9ccca72eeb61f3744112fab3d"
Sep 19 15:48:40.684685 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.684669    2563 scope.go:117] "RemoveContainer" containerID="c74785b4184d67ca21dbe48c9913f546d7db28885460bdce3005ffb86a966529"
Sep 19 15:48:40.693879 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.693860    2563 scope.go:117] "RemoveContainer" containerID="e3925414e1afa59d3e0566ca1579dbe2f1e4a0e9ccca72eeb61f3744112fab3d"
Sep 19 15:48:40.694190 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:48:40.694172    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3925414e1afa59d3e0566ca1579dbe2f1e4a0e9ccca72eeb61f3744112fab3d\": container with ID starting with e3925414e1afa59d3e0566ca1579dbe2f1e4a0e9ccca72eeb61f3744112fab3d not found: ID does not exist" containerID="e3925414e1afa59d3e0566ca1579dbe2f1e4a0e9ccca72eeb61f3744112fab3d"
Sep 19 15:48:40.694243 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.694197    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3925414e1afa59d3e0566ca1579dbe2f1e4a0e9ccca72eeb61f3744112fab3d"} err="failed to get container status \"e3925414e1afa59d3e0566ca1579dbe2f1e4a0e9ccca72eeb61f3744112fab3d\": rpc error: code = NotFound desc = could not find container \"e3925414e1afa59d3e0566ca1579dbe2f1e4a0e9ccca72eeb61f3744112fab3d\": container with ID starting with e3925414e1afa59d3e0566ca1579dbe2f1e4a0e9ccca72eeb61f3744112fab3d not found: ID does not exist"
Sep 19 15:48:40.694243 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.694214    2563 scope.go:117] "RemoveContainer" containerID="c74785b4184d67ca21dbe48c9913f546d7db28885460bdce3005ffb86a966529"
Sep 19 15:48:40.694463 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:48:40.694446    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c74785b4184d67ca21dbe48c9913f546d7db28885460bdce3005ffb86a966529\": container with ID starting with c74785b4184d67ca21dbe48c9913f546d7db28885460bdce3005ffb86a966529 not found: ID does not exist" containerID="c74785b4184d67ca21dbe48c9913f546d7db28885460bdce3005ffb86a966529"
Sep 19 15:48:40.694500 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.694466    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c74785b4184d67ca21dbe48c9913f546d7db28885460bdce3005ffb86a966529"} err="failed to get container status \"c74785b4184d67ca21dbe48c9913f546d7db28885460bdce3005ffb86a966529\": rpc error: code = NotFound desc = could not find container \"c74785b4184d67ca21dbe48c9913f546d7db28885460bdce3005ffb86a966529\": container with ID starting with c74785b4184d67ca21dbe48c9913f546d7db28885460bdce3005ffb86a966529 not found: ID does not exist"
Sep 19 15:48:40.696141 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.696120    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"]
Sep 19 15:48:40.699420 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:40.699397    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb"]
Sep 19 15:48:41.641625 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:41.641592    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25adf7ff-22b9-449b-8456-99a1deef1558" path="/var/lib/kubelet/pods/25adf7ff-22b9-449b-8456-99a1deef1558/volumes"
Sep 19 15:48:45.709865 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:45.709834    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"]
Sep 19 15:48:45.710355 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:45.710100    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn" podUID="194098ee-e6b4-454c-947f-214580634bff" containerName="maas-api" containerID="cri-o://06e82f2c6294aacf9396976a0dc1bed8400557f3cba02e3feeb7e5b7df099b9e" gracePeriod=30
Sep 19 15:48:45.966624 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:45.966555    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"
Sep 19 15:48:46.082643 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:46.082610    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glkcs\" (UniqueName: \"kubernetes.io/projected/194098ee-e6b4-454c-947f-214580634bff-kube-api-access-glkcs\") pod \"194098ee-e6b4-454c-947f-214580634bff\" (UID: \"194098ee-e6b4-454c-947f-214580634bff\") "
Sep 19 15:48:46.082643 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:46.082654    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/194098ee-e6b4-454c-947f-214580634bff-maas-api-tls\") pod \"194098ee-e6b4-454c-947f-214580634bff\" (UID: \"194098ee-e6b4-454c-947f-214580634bff\") "
Sep 19 15:48:46.082936 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:46.082740    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/194098ee-e6b4-454c-947f-214580634bff-metrics-certs\") pod \"194098ee-e6b4-454c-947f-214580634bff\" (UID: \"194098ee-e6b4-454c-947f-214580634bff\") "
Sep 19 15:48:46.082936 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:46.082803    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/194098ee-e6b4-454c-947f-214580634bff-openshift-service-ca\") pod \"194098ee-e6b4-454c-947f-214580634bff\" (UID: \"194098ee-e6b4-454c-947f-214580634bff\") "
Sep 19 15:48:46.083424 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:46.083391    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/194098ee-e6b4-454c-947f-214580634bff-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "194098ee-e6b4-454c-947f-214580634bff" (UID: "194098ee-e6b4-454c-947f-214580634bff"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:48:46.085292 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:46.085264    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/194098ee-e6b4-454c-947f-214580634bff-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "194098ee-e6b4-454c-947f-214580634bff" (UID: "194098ee-e6b4-454c-947f-214580634bff"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:48:46.086239 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:46.086204    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/194098ee-e6b4-454c-947f-214580634bff-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "194098ee-e6b4-454c-947f-214580634bff" (UID: "194098ee-e6b4-454c-947f-214580634bff"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:48:46.086352 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:46.086250    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/194098ee-e6b4-454c-947f-214580634bff-kube-api-access-glkcs" (OuterVolumeSpecName: "kube-api-access-glkcs") pod "194098ee-e6b4-454c-947f-214580634bff" (UID: "194098ee-e6b4-454c-947f-214580634bff"). InnerVolumeSpecName "kube-api-access-glkcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:48:46.184240 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:46.184202    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glkcs\" (UniqueName: \"kubernetes.io/projected/194098ee-e6b4-454c-947f-214580634bff-kube-api-access-glkcs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:46.184240 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:46.184229    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/194098ee-e6b4-454c-947f-214580634bff-maas-api-tls\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:46.184240 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:46.184238    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/194098ee-e6b4-454c-947f-214580634bff-metrics-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:46.184240 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:46.184247    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/194098ee-e6b4-454c-947f-214580634bff-openshift-service-ca\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:46.717739 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:46.717707    2563 generic.go:356] "Generic (PLEG): container finished" podID="194098ee-e6b4-454c-947f-214580634bff" containerID="06e82f2c6294aacf9396976a0dc1bed8400557f3cba02e3feeb7e5b7df099b9e" exitCode=0
Sep 19 15:48:46.718254 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:46.717747    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"
Sep 19 15:48:46.718254 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:46.717753    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn" event={"ID":"194098ee-e6b4-454c-947f-214580634bff","Type":"ContainerDied","Data":"06e82f2c6294aacf9396976a0dc1bed8400557f3cba02e3feeb7e5b7df099b9e"}
Sep 19 15:48:46.718254 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:46.717795    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn" event={"ID":"194098ee-e6b4-454c-947f-214580634bff","Type":"ContainerDied","Data":"27ad9c87cfab39e638c2a67c9ca640e90cbbb68fa604d88ae835dbba51baaaa1"}
Sep 19 15:48:46.718254 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:46.717817    2563 scope.go:117] "RemoveContainer" containerID="06e82f2c6294aacf9396976a0dc1bed8400557f3cba02e3feeb7e5b7df099b9e"
Sep 19 15:48:46.728366 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:46.728347    2563 scope.go:117] "RemoveContainer" containerID="06e82f2c6294aacf9396976a0dc1bed8400557f3cba02e3feeb7e5b7df099b9e"
Sep 19 15:48:46.728741 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:48:46.728721    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06e82f2c6294aacf9396976a0dc1bed8400557f3cba02e3feeb7e5b7df099b9e\": container with ID starting with 06e82f2c6294aacf9396976a0dc1bed8400557f3cba02e3feeb7e5b7df099b9e not found: ID does not exist" containerID="06e82f2c6294aacf9396976a0dc1bed8400557f3cba02e3feeb7e5b7df099b9e"
Sep 19 15:48:46.728811 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:46.728755    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06e82f2c6294aacf9396976a0dc1bed8400557f3cba02e3feeb7e5b7df099b9e"} err="failed to get container status \"06e82f2c6294aacf9396976a0dc1bed8400557f3cba02e3feeb7e5b7df099b9e\": rpc error: code = NotFound desc = could not find container \"06e82f2c6294aacf9396976a0dc1bed8400557f3cba02e3feeb7e5b7df099b9e\": container with ID starting with 06e82f2c6294aacf9396976a0dc1bed8400557f3cba02e3feeb7e5b7df099b9e not found: ID does not exist"
Sep 19 15:48:46.738635 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:46.738605    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"]
Sep 19 15:48:46.741178 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:46.741155    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f9c5c2-857bf5bd-r6lmn"]
Sep 19 15:48:47.641533 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:47.641500    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="194098ee-e6b4-454c-947f-214580634bff" path="/var/lib/kubelet/pods/194098ee-e6b4-454c-947f-214580634bff/volumes"
Sep 19 15:48:52.497561 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:52.497525    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"]
Sep 19 15:48:52.497972 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:52.497777    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h" podUID="4db1e571-acde-4ae3-903a-444ea2e57a39" containerName="istio-proxy" containerID="cri-o://dafea10cb4c578c6f6e0470fd02026365f578e231336994f33abffe80a15fc71" gracePeriod=30
Sep 19 15:48:54.583706 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:54.583671    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8c69b6595-j7cbb"]
Sep 19 15:48:54.584180 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:54.583865    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8c69b6595-j7cbb" podUID="b9b9a9db-4880-4668-b9d7-2c078453c2d7" containerName="manager" containerID="cri-o://3e197d3a152534d6c3f51134fab0e3be73de32f13b99f150618c12f184ad4135" gracePeriod=30
Sep 19 15:48:54.767031 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:54.767001    2563 generic.go:356] "Generic (PLEG): container finished" podID="b9b9a9db-4880-4668-b9d7-2c078453c2d7" containerID="3e197d3a152534d6c3f51134fab0e3be73de32f13b99f150618c12f184ad4135" exitCode=0
Sep 19 15:48:54.767174 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:54.767067    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c69b6595-j7cbb" event={"ID":"b9b9a9db-4880-4668-b9d7-2c078453c2d7","Type":"ContainerDied","Data":"3e197d3a152534d6c3f51134fab0e3be73de32f13b99f150618c12f184ad4135"}
Sep 19 15:48:54.830495 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:54.830473    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c69b6595-j7cbb"
Sep 19 15:48:54.964576 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:54.964545    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kh7bj\" (UniqueName: \"kubernetes.io/projected/b9b9a9db-4880-4668-b9d7-2c078453c2d7-kube-api-access-kh7bj\") pod \"b9b9a9db-4880-4668-b9d7-2c078453c2d7\" (UID: \"b9b9a9db-4880-4668-b9d7-2c078453c2d7\") "
Sep 19 15:48:54.964745 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:54.964628    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b9b9a9db-4880-4668-b9d7-2c078453c2d7-webhook-cert\") pod \"b9b9a9db-4880-4668-b9d7-2c078453c2d7\" (UID: \"b9b9a9db-4880-4668-b9d7-2c078453c2d7\") "
Sep 19 15:48:54.964745 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:54.964718    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9b9a9db-4880-4668-b9d7-2c078453c2d7-metrics-certs\") pod \"b9b9a9db-4880-4668-b9d7-2c078453c2d7\" (UID: \"b9b9a9db-4880-4668-b9d7-2c078453c2d7\") "
Sep 19 15:48:54.967087 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:54.967060    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9b9a9db-4880-4668-b9d7-2c078453c2d7-kube-api-access-kh7bj" (OuterVolumeSpecName: "kube-api-access-kh7bj") pod "b9b9a9db-4880-4668-b9d7-2c078453c2d7" (UID: "b9b9a9db-4880-4668-b9d7-2c078453c2d7"). InnerVolumeSpecName "kube-api-access-kh7bj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:48:54.967234 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:54.967188    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9b9a9db-4880-4668-b9d7-2c078453c2d7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b9b9a9db-4880-4668-b9d7-2c078453c2d7" (UID: "b9b9a9db-4880-4668-b9d7-2c078453c2d7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:48:54.967234 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:54.967209    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9b9a9db-4880-4668-b9d7-2c078453c2d7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b9b9a9db-4880-4668-b9d7-2c078453c2d7" (UID: "b9b9a9db-4880-4668-b9d7-2c078453c2d7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:48:55.065639 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:55.065606    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b9b9a9db-4880-4668-b9d7-2c078453c2d7-webhook-cert\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:55.065639 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:55.065634    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9b9a9db-4880-4668-b9d7-2c078453c2d7-metrics-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:55.065639 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:55.065643    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh7bj\" (UniqueName: \"kubernetes.io/projected/b9b9a9db-4880-4668-b9d7-2c078453c2d7-kube-api-access-kh7bj\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:55.774867 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:55.774839    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c69b6595-j7cbb"
Sep 19 15:48:55.775273 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:55.774839    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c69b6595-j7cbb" event={"ID":"b9b9a9db-4880-4668-b9d7-2c078453c2d7","Type":"ContainerDied","Data":"2f8f225bd1adad5a0a63ab5fb5def1de2a61414c5506ef8e553d02d4f41247dd"}
Sep 19 15:48:55.775273 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:55.774962    2563 scope.go:117] "RemoveContainer" containerID="3e197d3a152534d6c3f51134fab0e3be73de32f13b99f150618c12f184ad4135"
Sep 19 15:48:55.791300 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:55.791276    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8c69b6595-j7cbb"]
Sep 19 15:48:55.794302 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:55.794275    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8c69b6595-j7cbb"]
Sep 19 15:48:56.470434 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:56.470398    2563 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 15:48:56.470604 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:56.470480    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h" podUID="4db1e571-acde-4ae3-903a-444ea2e57a39" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 15:48:57.642054 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.642022    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9b9a9db-4880-4668-b9d7-2c078453c2d7" path="/var/lib/kubelet/pods/b9b9a9db-4880-4668-b9d7-2c078453c2d7/volumes"
Sep 19 15:48:57.748073 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.748048    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:48:57.790484 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.790397    2563 generic.go:356] "Generic (PLEG): container finished" podID="4db1e571-acde-4ae3-903a-444ea2e57a39" containerID="dafea10cb4c578c6f6e0470fd02026365f578e231336994f33abffe80a15fc71" exitCode=0
Sep 19 15:48:57.790484 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.790433    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h" event={"ID":"4db1e571-acde-4ae3-903a-444ea2e57a39","Type":"ContainerDied","Data":"dafea10cb4c578c6f6e0470fd02026365f578e231336994f33abffe80a15fc71"}
Sep 19 15:48:57.790484 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.790476    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"
Sep 19 15:48:57.790740 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.790497    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h" event={"ID":"4db1e571-acde-4ae3-903a-444ea2e57a39","Type":"ContainerDied","Data":"317046d0369aedbae6e3da2f827716cac770039db414aeaf21f71dd6c05b2ffe"}
Sep 19 15:48:57.790740 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.790528    2563 scope.go:117] "RemoveContainer" containerID="dafea10cb4c578c6f6e0470fd02026365f578e231336994f33abffe80a15fc71"
Sep 19 15:48:57.799953 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.799937    2563 scope.go:117] "RemoveContainer" containerID="24f483c5474560fcde351ad436db23b2007aa2c60bda3908c7baf02a60e9ef45"
Sep 19 15:48:57.808964 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.808948    2563 scope.go:117] "RemoveContainer" containerID="dafea10cb4c578c6f6e0470fd02026365f578e231336994f33abffe80a15fc71"
Sep 19 15:48:57.809270 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:48:57.809252    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dafea10cb4c578c6f6e0470fd02026365f578e231336994f33abffe80a15fc71\": container with ID starting with dafea10cb4c578c6f6e0470fd02026365f578e231336994f33abffe80a15fc71 not found: ID does not exist" containerID="dafea10cb4c578c6f6e0470fd02026365f578e231336994f33abffe80a15fc71"
Sep 19 15:48:57.809324 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.809279    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dafea10cb4c578c6f6e0470fd02026365f578e231336994f33abffe80a15fc71"} err="failed to get container status \"dafea10cb4c578c6f6e0470fd02026365f578e231336994f33abffe80a15fc71\": rpc error: code = NotFound desc = could not find container \"dafea10cb4c578c6f6e0470fd02026365f578e231336994f33abffe80a15fc71\": container with ID starting with dafea10cb4c578c6f6e0470fd02026365f578e231336994f33abffe80a15fc71 not found: ID does not exist"
Sep 19 15:48:57.809324 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.809299    2563 scope.go:117] "RemoveContainer" containerID="24f483c5474560fcde351ad436db23b2007aa2c60bda3908c7baf02a60e9ef45"
Sep 19 15:48:57.809585 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:48:57.809561    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24f483c5474560fcde351ad436db23b2007aa2c60bda3908c7baf02a60e9ef45\": container with ID starting with 24f483c5474560fcde351ad436db23b2007aa2c60bda3908c7baf02a60e9ef45 not found: ID does not exist" containerID="24f483c5474560fcde351ad436db23b2007aa2c60bda3908c7baf02a60e9ef45"
Sep 19 15:48:57.809638 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.809587    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24f483c5474560fcde351ad436db23b2007aa2c60bda3908c7baf02a60e9ef45"} err="failed to get container status \"24f483c5474560fcde351ad436db23b2007aa2c60bda3908c7baf02a60e9ef45\": rpc error: code = NotFound desc = could not find container \"24f483c5474560fcde351ad436db23b2007aa2c60bda3908c7baf02a60e9ef45\": container with ID starting with 24f483c5474560fcde351ad436db23b2007aa2c60bda3908c7baf02a60e9ef45 not found: ID does not exist"
Sep 19 15:48:57.891885 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.891853    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-envoy\") pod \"4db1e571-acde-4ae3-903a-444ea2e57a39\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") "
Sep 19 15:48:57.892072 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.891930    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-data\") pod \"4db1e571-acde-4ae3-903a-444ea2e57a39\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") "
Sep 19 15:48:57.892072 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.891977    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4db1e571-acde-4ae3-903a-444ea2e57a39-istiod-ca-cert\") pod \"4db1e571-acde-4ae3-903a-444ea2e57a39\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") "
Sep 19 15:48:57.892072 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.892024    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-token\") pod \"4db1e571-acde-4ae3-903a-444ea2e57a39\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") "
Sep 19 15:48:57.892072 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.892057    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-credential-socket\") pod \"4db1e571-acde-4ae3-903a-444ea2e57a39\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") "
Sep 19 15:48:57.892343 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.892096    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-workload-certs\") pod \"4db1e571-acde-4ae3-903a-444ea2e57a39\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") "
Sep 19 15:48:57.892343 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.892132    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-podinfo\") pod \"4db1e571-acde-4ae3-903a-444ea2e57a39\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") "
Sep 19 15:48:57.892343 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.892195    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bm7h5\" (UniqueName: \"kubernetes.io/projected/4db1e571-acde-4ae3-903a-444ea2e57a39-kube-api-access-bm7h5\") pod \"4db1e571-acde-4ae3-903a-444ea2e57a39\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") "
Sep 19 15:48:57.892343 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.892213    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-data" (OuterVolumeSpecName: "istio-data") pod "4db1e571-acde-4ae3-903a-444ea2e57a39" (UID: "4db1e571-acde-4ae3-903a-444ea2e57a39"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:48:57.892343 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.892244    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-workload-socket\") pod \"4db1e571-acde-4ae3-903a-444ea2e57a39\" (UID: \"4db1e571-acde-4ae3-903a-444ea2e57a39\") "
Sep 19 15:48:57.892654 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.892421    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4db1e571-acde-4ae3-903a-444ea2e57a39" (UID: "4db1e571-acde-4ae3-903a-444ea2e57a39"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:48:57.892654 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.892450    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4db1e571-acde-4ae3-903a-444ea2e57a39-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4db1e571-acde-4ae3-903a-444ea2e57a39" (UID: "4db1e571-acde-4ae3-903a-444ea2e57a39"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:48:57.892654 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.892607    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4db1e571-acde-4ae3-903a-444ea2e57a39" (UID: "4db1e571-acde-4ae3-903a-444ea2e57a39"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:48:57.892654 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.892621    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-workload-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:57.892654 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.892638    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-data\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:57.892654 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.892651    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4db1e571-acde-4ae3-903a-444ea2e57a39-istiod-ca-cert\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:57.892935 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.892720    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4db1e571-acde-4ae3-903a-444ea2e57a39" (UID: "4db1e571-acde-4ae3-903a-444ea2e57a39"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:48:57.894240 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.894220    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4db1e571-acde-4ae3-903a-444ea2e57a39" (UID: "4db1e571-acde-4ae3-903a-444ea2e57a39"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 15:48:57.894442 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.894425    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4db1e571-acde-4ae3-903a-444ea2e57a39-kube-api-access-bm7h5" (OuterVolumeSpecName: "kube-api-access-bm7h5") pod "4db1e571-acde-4ae3-903a-444ea2e57a39" (UID: "4db1e571-acde-4ae3-903a-444ea2e57a39"). InnerVolumeSpecName "kube-api-access-bm7h5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:48:57.894722 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.894702    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4db1e571-acde-4ae3-903a-444ea2e57a39" (UID: "4db1e571-acde-4ae3-903a-444ea2e57a39"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 15:48:57.894824 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.894736    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-token" (OuterVolumeSpecName: "istio-token") pod "4db1e571-acde-4ae3-903a-444ea2e57a39" (UID: "4db1e571-acde-4ae3-903a-444ea2e57a39"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:48:57.993660 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.993605    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-token\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:57.993660 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.993655    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-credential-socket\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:57.993660 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.993666    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-podinfo\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:57.993660 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.993674    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bm7h5\" (UniqueName: \"kubernetes.io/projected/4db1e571-acde-4ae3-903a-444ea2e57a39-kube-api-access-bm7h5\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:57.993660 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.993683    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-workload-socket\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:57.993992 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:57.993692    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4db1e571-acde-4ae3-903a-444ea2e57a39-istio-envoy\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:48:58.110114 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:58.110084    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"]
Sep 19 15:48:58.115542 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:58.115517    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h"]
Sep 19 15:48:59.641254 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:48:59.641222    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4db1e571-acde-4ae3-903a-444ea2e57a39" path="/var/lib/kubelet/pods/4db1e571-acde-4ae3-903a-444ea2e57a39/volumes"
Sep 19 15:49:56.597656 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.597565    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8c69b6595-9bfbk"]
Sep 19 15:49:56.598255 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598156    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="194098ee-e6b4-454c-947f-214580634bff" containerName="maas-api"
Sep 19 15:49:56.598255 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598178    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="194098ee-e6b4-454c-947f-214580634bff" containerName="maas-api"
Sep 19 15:49:56.598255 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598194    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25adf7ff-22b9-449b-8456-99a1deef1558" containerName="istio-proxy"
Sep 19 15:49:56.598255 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598206    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="25adf7ff-22b9-449b-8456-99a1deef1558" containerName="istio-proxy"
Sep 19 15:49:56.598255 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598224    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="153d5b94-f0c7-4296-b5af-4f5f85878cf2" containerName="maas-api"
Sep 19 15:49:56.598255 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598232    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="153d5b94-f0c7-4296-b5af-4f5f85878cf2" containerName="maas-api"
Sep 19 15:49:56.598255 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598245    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="045b6834-4806-41ab-932f-e7eeb786ef2a" containerName="payload-pre-processing"
Sep 19 15:49:56.598255 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598252    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="045b6834-4806-41ab-932f-e7eeb786ef2a" containerName="payload-pre-processing"
Sep 19 15:49:56.598665 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598262    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fa503d6-642c-40d7-9968-01b21e0d477f" containerName="payload-processing"
Sep 19 15:49:56.598665 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598270    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fa503d6-642c-40d7-9968-01b21e0d477f" containerName="payload-processing"
Sep 19 15:49:56.598665 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598289    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9b9a9db-4880-4668-b9d7-2c078453c2d7" containerName="manager"
Sep 19 15:49:56.598665 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598296    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9b9a9db-4880-4668-b9d7-2c078453c2d7" containerName="manager"
Sep 19 15:49:56.598665 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598306    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4db1e571-acde-4ae3-903a-444ea2e57a39" containerName="istio-proxy"
Sep 19 15:49:56.598665 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598314    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4db1e571-acde-4ae3-903a-444ea2e57a39" containerName="istio-proxy"
Sep 19 15:49:56.598665 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598332    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d65ba35c-20c1-4873-a9ad-5ada19776fdc" containerName="maas-api"
Sep 19 15:49:56.598665 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598340    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d65ba35c-20c1-4873-a9ad-5ada19776fdc" containerName="maas-api"
Sep 19 15:49:56.598665 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598438    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="045b6834-4806-41ab-932f-e7eeb786ef2a" containerName="payload-pre-processing"
Sep 19 15:49:56.598665 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598451    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4db1e571-acde-4ae3-903a-444ea2e57a39" containerName="istio-proxy"
Sep 19 15:49:56.598665 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598461    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="194098ee-e6b4-454c-947f-214580634bff" containerName="maas-api"
Sep 19 15:49:56.598665 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598470    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="25adf7ff-22b9-449b-8456-99a1deef1558" containerName="istio-proxy"
Sep 19 15:49:56.598665 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598478    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d65ba35c-20c1-4873-a9ad-5ada19776fdc" containerName="maas-api"
Sep 19 15:49:56.598665 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598491    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fa503d6-642c-40d7-9968-01b21e0d477f" containerName="payload-processing"
Sep 19 15:49:56.598665 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598499    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="153d5b94-f0c7-4296-b5af-4f5f85878cf2" containerName="maas-api"
Sep 19 15:49:56.598665 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598507    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9b9a9db-4880-4668-b9d7-2c078453c2d7" containerName="manager"
Sep 19 15:49:56.598665 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.598517    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="25adf7ff-22b9-449b-8456-99a1deef1558" containerName="istio-proxy"
Sep 19 15:49:56.601997 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.601976    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c69b6595-9bfbk"
Sep 19 15:49:56.605589 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.605566    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 19 15:49:56.605680 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.605576    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 19 15:49:56.605864 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.605848    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 19 15:49:56.605935 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.605917    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6lzmn\""
Sep 19 15:49:56.616281 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.616260    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8c69b6595-9bfbk"]
Sep 19 15:49:56.691347 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.691314    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c05725fe-e73b-4ce5-aea9-5d808464917e-webhook-cert\") pod \"maas-controller-8c69b6595-9bfbk\" (UID: \"c05725fe-e73b-4ce5-aea9-5d808464917e\") " pod="opendatahub/maas-controller-8c69b6595-9bfbk"
Sep 19 15:49:56.691529 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.691386    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c05725fe-e73b-4ce5-aea9-5d808464917e-metrics-certs\") pod \"maas-controller-8c69b6595-9bfbk\" (UID: \"c05725fe-e73b-4ce5-aea9-5d808464917e\") " pod="opendatahub/maas-controller-8c69b6595-9bfbk"
Sep 19 15:49:56.691529 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.691417    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh4xb\" (UniqueName: \"kubernetes.io/projected/c05725fe-e73b-4ce5-aea9-5d808464917e-kube-api-access-sh4xb\") pod \"maas-controller-8c69b6595-9bfbk\" (UID: \"c05725fe-e73b-4ce5-aea9-5d808464917e\") " pod="opendatahub/maas-controller-8c69b6595-9bfbk"
Sep 19 15:49:56.792875 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.792837    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c05725fe-e73b-4ce5-aea9-5d808464917e-metrics-certs\") pod \"maas-controller-8c69b6595-9bfbk\" (UID: \"c05725fe-e73b-4ce5-aea9-5d808464917e\") " pod="opendatahub/maas-controller-8c69b6595-9bfbk"
Sep 19 15:49:56.793129 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.792931    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh4xb\" (UniqueName: \"kubernetes.io/projected/c05725fe-e73b-4ce5-aea9-5d808464917e-kube-api-access-sh4xb\") pod \"maas-controller-8c69b6595-9bfbk\" (UID: \"c05725fe-e73b-4ce5-aea9-5d808464917e\") " pod="opendatahub/maas-controller-8c69b6595-9bfbk"
Sep 19 15:49:56.793129 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.792990    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c05725fe-e73b-4ce5-aea9-5d808464917e-webhook-cert\") pod \"maas-controller-8c69b6595-9bfbk\" (UID: \"c05725fe-e73b-4ce5-aea9-5d808464917e\") " pod="opendatahub/maas-controller-8c69b6595-9bfbk"
Sep 19 15:49:56.795590 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.795562    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c05725fe-e73b-4ce5-aea9-5d808464917e-webhook-cert\") pod \"maas-controller-8c69b6595-9bfbk\" (UID: \"c05725fe-e73b-4ce5-aea9-5d808464917e\") " pod="opendatahub/maas-controller-8c69b6595-9bfbk"
Sep 19 15:49:56.795706 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.795631    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c05725fe-e73b-4ce5-aea9-5d808464917e-metrics-certs\") pod \"maas-controller-8c69b6595-9bfbk\" (UID: \"c05725fe-e73b-4ce5-aea9-5d808464917e\") " pod="opendatahub/maas-controller-8c69b6595-9bfbk"
Sep 19 15:49:56.803095 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.803076    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh4xb\" (UniqueName: \"kubernetes.io/projected/c05725fe-e73b-4ce5-aea9-5d808464917e-kube-api-access-sh4xb\") pod \"maas-controller-8c69b6595-9bfbk\" (UID: \"c05725fe-e73b-4ce5-aea9-5d808464917e\") " pod="opendatahub/maas-controller-8c69b6595-9bfbk"
Sep 19 15:49:56.912087 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:56.911995    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c69b6595-9bfbk"
Sep 19 15:49:57.184552 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:57.184525    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8c69b6595-9bfbk"]
Sep 19 15:49:57.186517 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:49:57.186492    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc05725fe_e73b_4ce5_aea9_5d808464917e.slice/crio-5e9e1512fb2dfa89a81922057da367df09b573483466384846f558af1ec52e36 WatchSource:0}: Error finding container 5e9e1512fb2dfa89a81922057da367df09b573483466384846f558af1ec52e36: Status 404 returned error can't find the container with id 5e9e1512fb2dfa89a81922057da367df09b573483466384846f558af1ec52e36
Sep 19 15:49:58.123279 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:58.123187    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c69b6595-9bfbk" event={"ID":"c05725fe-e73b-4ce5-aea9-5d808464917e","Type":"ContainerStarted","Data":"a968b465d33647923511812098b79a77f152c80099d67a620ecd7842091243fb"}
Sep 19 15:49:58.123279 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:58.123244    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c69b6595-9bfbk" event={"ID":"c05725fe-e73b-4ce5-aea9-5d808464917e","Type":"ContainerStarted","Data":"5e9e1512fb2dfa89a81922057da367df09b573483466384846f558af1ec52e36"}
Sep 19 15:49:58.123679 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:58.123285    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8c69b6595-9bfbk"
Sep 19 15:49:58.161115 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:49:58.161068    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8c69b6595-9bfbk" podStartSLOduration=1.4858781429999999 podStartE2EDuration="2.161053055s" totalImagesPullingTime="675.174912ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:49:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:49:58.157759642 +0000 UTC m=+2273.046959356" watchObservedRunningTime="2026-09-19 15:49:58.161053055 +0000 UTC m=+2273.050252795"
Sep 19 15:50:09.131055 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:09.131025    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8c69b6595-9bfbk"
Sep 19 15:50:18.432504 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:18.432462    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8c69b6595-9bfbk"]
Sep 19 15:50:18.433027 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:18.432794    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8c69b6595-9bfbk" podUID="c05725fe-e73b-4ce5-aea9-5d808464917e" containerName="manager" containerID="cri-o://a968b465d33647923511812098b79a77f152c80099d67a620ecd7842091243fb" gracePeriod=30
Sep 19 15:50:18.777655 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:18.777625    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c69b6595-9bfbk"
Sep 19 15:50:18.895488 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:18.895455    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c05725fe-e73b-4ce5-aea9-5d808464917e-metrics-certs\") pod \"c05725fe-e73b-4ce5-aea9-5d808464917e\" (UID: \"c05725fe-e73b-4ce5-aea9-5d808464917e\") "
Sep 19 15:50:18.895670 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:18.895524    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c05725fe-e73b-4ce5-aea9-5d808464917e-webhook-cert\") pod \"c05725fe-e73b-4ce5-aea9-5d808464917e\" (UID: \"c05725fe-e73b-4ce5-aea9-5d808464917e\") "
Sep 19 15:50:18.895670 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:18.895562    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sh4xb\" (UniqueName: \"kubernetes.io/projected/c05725fe-e73b-4ce5-aea9-5d808464917e-kube-api-access-sh4xb\") pod \"c05725fe-e73b-4ce5-aea9-5d808464917e\" (UID: \"c05725fe-e73b-4ce5-aea9-5d808464917e\") "
Sep 19 15:50:18.897630 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:18.897598    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c05725fe-e73b-4ce5-aea9-5d808464917e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c05725fe-e73b-4ce5-aea9-5d808464917e" (UID: "c05725fe-e73b-4ce5-aea9-5d808464917e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:50:18.897787 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:18.897768    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c05725fe-e73b-4ce5-aea9-5d808464917e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c05725fe-e73b-4ce5-aea9-5d808464917e" (UID: "c05725fe-e73b-4ce5-aea9-5d808464917e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:50:18.897832 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:18.897785    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c05725fe-e73b-4ce5-aea9-5d808464917e-kube-api-access-sh4xb" (OuterVolumeSpecName: "kube-api-access-sh4xb") pod "c05725fe-e73b-4ce5-aea9-5d808464917e" (UID: "c05725fe-e73b-4ce5-aea9-5d808464917e"). InnerVolumeSpecName "kube-api-access-sh4xb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:50:18.996693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:18.996609    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c05725fe-e73b-4ce5-aea9-5d808464917e-webhook-cert\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:50:18.996693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:18.996637    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sh4xb\" (UniqueName: \"kubernetes.io/projected/c05725fe-e73b-4ce5-aea9-5d808464917e-kube-api-access-sh4xb\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:50:18.996693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:18.996648    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c05725fe-e73b-4ce5-aea9-5d808464917e-metrics-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:50:19.241876 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:19.241838    2563 generic.go:356] "Generic (PLEG): container finished" podID="c05725fe-e73b-4ce5-aea9-5d808464917e" containerID="a968b465d33647923511812098b79a77f152c80099d67a620ecd7842091243fb" exitCode=0
Sep 19 15:50:19.242063 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:19.241882    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c69b6595-9bfbk"
Sep 19 15:50:19.242063 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:19.241924    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c69b6595-9bfbk" event={"ID":"c05725fe-e73b-4ce5-aea9-5d808464917e","Type":"ContainerDied","Data":"a968b465d33647923511812098b79a77f152c80099d67a620ecd7842091243fb"}
Sep 19 15:50:19.242063 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:19.241981    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c69b6595-9bfbk" event={"ID":"c05725fe-e73b-4ce5-aea9-5d808464917e","Type":"ContainerDied","Data":"5e9e1512fb2dfa89a81922057da367df09b573483466384846f558af1ec52e36"}
Sep 19 15:50:19.242063 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:19.242004    2563 scope.go:117] "RemoveContainer" containerID="a968b465d33647923511812098b79a77f152c80099d67a620ecd7842091243fb"
Sep 19 15:50:19.251719 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:19.251702    2563 scope.go:117] "RemoveContainer" containerID="a968b465d33647923511812098b79a77f152c80099d67a620ecd7842091243fb"
Sep 19 15:50:19.252021 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:50:19.252002    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a968b465d33647923511812098b79a77f152c80099d67a620ecd7842091243fb\": container with ID starting with a968b465d33647923511812098b79a77f152c80099d67a620ecd7842091243fb not found: ID does not exist" containerID="a968b465d33647923511812098b79a77f152c80099d67a620ecd7842091243fb"
Sep 19 15:50:19.252080 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:19.252029    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a968b465d33647923511812098b79a77f152c80099d67a620ecd7842091243fb"} err="failed to get container status \"a968b465d33647923511812098b79a77f152c80099d67a620ecd7842091243fb\": rpc error: code = NotFound desc = could not find container \"a968b465d33647923511812098b79a77f152c80099d67a620ecd7842091243fb\": container with ID starting with a968b465d33647923511812098b79a77f152c80099d67a620ecd7842091243fb not found: ID does not exist"
Sep 19 15:50:19.262545 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:19.262522    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8c69b6595-9bfbk"]
Sep 19 15:50:19.265807 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:19.265785    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8c69b6595-9bfbk"]
Sep 19 15:50:19.641192 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:19.641112    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c05725fe-e73b-4ce5-aea9-5d808464917e" path="/var/lib/kubelet/pods/c05725fe-e73b-4ce5-aea9-5d808464917e/volumes"
Sep 19 15:50:20.218995 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.218879    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8c69b6595-tz2fv"]
Sep 19 15:50:20.219288 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.219274    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4db1e571-acde-4ae3-903a-444ea2e57a39" containerName="istio-proxy"
Sep 19 15:50:20.219338 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.219290    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4db1e571-acde-4ae3-903a-444ea2e57a39" containerName="istio-proxy"
Sep 19 15:50:20.219338 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.219309    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c05725fe-e73b-4ce5-aea9-5d808464917e" containerName="manager"
Sep 19 15:50:20.219338 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.219315    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c05725fe-e73b-4ce5-aea9-5d808464917e" containerName="manager"
Sep 19 15:50:20.219338 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.219322    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25adf7ff-22b9-449b-8456-99a1deef1558" containerName="istio-proxy"
Sep 19 15:50:20.219338 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.219327    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="25adf7ff-22b9-449b-8456-99a1deef1558" containerName="istio-proxy"
Sep 19 15:50:20.219498 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.219390    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c05725fe-e73b-4ce5-aea9-5d808464917e" containerName="manager"
Sep 19 15:50:20.219498 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.219397    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4db1e571-acde-4ae3-903a-444ea2e57a39" containerName="istio-proxy"
Sep 19 15:50:20.223809 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.223791    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c69b6595-tz2fv"
Sep 19 15:50:20.226096 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.226072    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 19 15:50:20.227002 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.226783    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 19 15:50:20.227002 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.226851    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 19 15:50:20.227002 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.226971    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6lzmn\""
Sep 19 15:50:20.230589 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.230568    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8c69b6595-tz2fv"]
Sep 19 15:50:20.411065 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.411026    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dt9n\" (UniqueName: \"kubernetes.io/projected/ab3f5d1d-5e64-421b-b022-d0e6107471fc-kube-api-access-4dt9n\") pod \"maas-controller-8c69b6595-tz2fv\" (UID: \"ab3f5d1d-5e64-421b-b022-d0e6107471fc\") " pod="opendatahub/maas-controller-8c69b6595-tz2fv"
Sep 19 15:50:20.411213 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.411155    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab3f5d1d-5e64-421b-b022-d0e6107471fc-webhook-cert\") pod \"maas-controller-8c69b6595-tz2fv\" (UID: \"ab3f5d1d-5e64-421b-b022-d0e6107471fc\") " pod="opendatahub/maas-controller-8c69b6595-tz2fv"
Sep 19 15:50:20.411213 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.411182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3f5d1d-5e64-421b-b022-d0e6107471fc-metrics-certs\") pod \"maas-controller-8c69b6595-tz2fv\" (UID: \"ab3f5d1d-5e64-421b-b022-d0e6107471fc\") " pod="opendatahub/maas-controller-8c69b6595-tz2fv"
Sep 19 15:50:20.512519 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.512433    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab3f5d1d-5e64-421b-b022-d0e6107471fc-webhook-cert\") pod \"maas-controller-8c69b6595-tz2fv\" (UID: \"ab3f5d1d-5e64-421b-b022-d0e6107471fc\") " pod="opendatahub/maas-controller-8c69b6595-tz2fv"
Sep 19 15:50:20.512519 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.512471    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3f5d1d-5e64-421b-b022-d0e6107471fc-metrics-certs\") pod \"maas-controller-8c69b6595-tz2fv\" (UID: \"ab3f5d1d-5e64-421b-b022-d0e6107471fc\") " pod="opendatahub/maas-controller-8c69b6595-tz2fv"
Sep 19 15:50:20.512519 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.512513    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dt9n\" (UniqueName: \"kubernetes.io/projected/ab3f5d1d-5e64-421b-b022-d0e6107471fc-kube-api-access-4dt9n\") pod \"maas-controller-8c69b6595-tz2fv\" (UID: \"ab3f5d1d-5e64-421b-b022-d0e6107471fc\") " pod="opendatahub/maas-controller-8c69b6595-tz2fv"
Sep 19 15:50:20.515109 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.515075    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3f5d1d-5e64-421b-b022-d0e6107471fc-metrics-certs\") pod \"maas-controller-8c69b6595-tz2fv\" (UID: \"ab3f5d1d-5e64-421b-b022-d0e6107471fc\") " pod="opendatahub/maas-controller-8c69b6595-tz2fv"
Sep 19 15:50:20.515238 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.515108    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab3f5d1d-5e64-421b-b022-d0e6107471fc-webhook-cert\") pod \"maas-controller-8c69b6595-tz2fv\" (UID: \"ab3f5d1d-5e64-421b-b022-d0e6107471fc\") " pod="opendatahub/maas-controller-8c69b6595-tz2fv"
Sep 19 15:50:20.520166 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.520143    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dt9n\" (UniqueName: \"kubernetes.io/projected/ab3f5d1d-5e64-421b-b022-d0e6107471fc-kube-api-access-4dt9n\") pod \"maas-controller-8c69b6595-tz2fv\" (UID: \"ab3f5d1d-5e64-421b-b022-d0e6107471fc\") " pod="opendatahub/maas-controller-8c69b6595-tz2fv"
Sep 19 15:50:20.536954 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.536927    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c69b6595-tz2fv"
Sep 19 15:50:20.810872 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:20.810845    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8c69b6595-tz2fv"]
Sep 19 15:50:20.812228 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:50:20.812199    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab3f5d1d_5e64_421b_b022_d0e6107471fc.slice/crio-a2c6442073a46d73991c864269ce1ebffa6cecdd8207b25c94c13a0bf2027791 WatchSource:0}: Error finding container a2c6442073a46d73991c864269ce1ebffa6cecdd8207b25c94c13a0bf2027791: Status 404 returned error can't find the container with id a2c6442073a46d73991c864269ce1ebffa6cecdd8207b25c94c13a0bf2027791
Sep 19 15:50:21.257540 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:21.257500    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c69b6595-tz2fv" event={"ID":"ab3f5d1d-5e64-421b-b022-d0e6107471fc","Type":"ContainerStarted","Data":"daf4b301386025ad3e55b8d902b9074ed4489c2da23efce7a596070c574921fd"}
Sep 19 15:50:21.257712 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:21.257560    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c69b6595-tz2fv" event={"ID":"ab3f5d1d-5e64-421b-b022-d0e6107471fc","Type":"ContainerStarted","Data":"a2c6442073a46d73991c864269ce1ebffa6cecdd8207b25c94c13a0bf2027791"}
Sep 19 15:50:21.257712 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:21.257610    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8c69b6595-tz2fv"
Sep 19 15:50:21.274715 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:21.274666    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8c69b6595-tz2fv" podStartSLOduration=0.943772941 podStartE2EDuration="1.274652189s" totalImagesPullingTime="330.879248ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:50:21.271718023 +0000 UTC m=+2296.160917758" watchObservedRunningTime="2026-09-19 15:50:21.274652189 +0000 UTC m=+2296.163851931"
Sep 19 15:50:32.266030 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:50:32.266000    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8c69b6595-tz2fv"
Sep 19 15:52:05.807837 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:52:05.807721    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/1.log"
Sep 19 15:52:05.821261 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:52:05.821241    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/1.log"
Sep 19 15:54:18.675258 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:18.675225    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-546445c5bc-gqpmh"]
Sep 19 15:54:18.678727 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:18.678707    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-546445c5bc-gqpmh"
Sep 19 15:54:18.697694 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:18.697665    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-546445c5bc-gqpmh"]
Sep 19 15:54:18.788175 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:18.788142    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bce3d6b1-ec3a-4b6f-b389-1783076dd2bd-maas-api-tls\") pod \"maas-api-546445c5bc-gqpmh\" (UID: \"bce3d6b1-ec3a-4b6f-b389-1783076dd2bd\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-gqpmh"
Sep 19 15:54:18.788359 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:18.788183    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bce3d6b1-ec3a-4b6f-b389-1783076dd2bd-openshift-service-ca\") pod \"maas-api-546445c5bc-gqpmh\" (UID: \"bce3d6b1-ec3a-4b6f-b389-1783076dd2bd\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-gqpmh"
Sep 19 15:54:18.788359 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:18.788253    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8bz7\" (UniqueName: \"kubernetes.io/projected/bce3d6b1-ec3a-4b6f-b389-1783076dd2bd-kube-api-access-f8bz7\") pod \"maas-api-546445c5bc-gqpmh\" (UID: \"bce3d6b1-ec3a-4b6f-b389-1783076dd2bd\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-gqpmh"
Sep 19 15:54:18.788359 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:18.788302    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bce3d6b1-ec3a-4b6f-b389-1783076dd2bd-metrics-certs\") pod \"maas-api-546445c5bc-gqpmh\" (UID: \"bce3d6b1-ec3a-4b6f-b389-1783076dd2bd\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-gqpmh"
Sep 19 15:54:18.889302 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:18.889265    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bce3d6b1-ec3a-4b6f-b389-1783076dd2bd-maas-api-tls\") pod \"maas-api-546445c5bc-gqpmh\" (UID: \"bce3d6b1-ec3a-4b6f-b389-1783076dd2bd\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-gqpmh"
Sep 19 15:54:18.889302 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:18.889309    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bce3d6b1-ec3a-4b6f-b389-1783076dd2bd-openshift-service-ca\") pod \"maas-api-546445c5bc-gqpmh\" (UID: \"bce3d6b1-ec3a-4b6f-b389-1783076dd2bd\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-gqpmh"
Sep 19 15:54:18.889515 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:18.889367    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8bz7\" (UniqueName: \"kubernetes.io/projected/bce3d6b1-ec3a-4b6f-b389-1783076dd2bd-kube-api-access-f8bz7\") pod \"maas-api-546445c5bc-gqpmh\" (UID: \"bce3d6b1-ec3a-4b6f-b389-1783076dd2bd\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-gqpmh"
Sep 19 15:54:18.889515 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:18.889398    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bce3d6b1-ec3a-4b6f-b389-1783076dd2bd-metrics-certs\") pod \"maas-api-546445c5bc-gqpmh\" (UID: \"bce3d6b1-ec3a-4b6f-b389-1783076dd2bd\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-gqpmh"
Sep 19 15:54:18.890129 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:18.890109    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bce3d6b1-ec3a-4b6f-b389-1783076dd2bd-openshift-service-ca\") pod \"maas-api-546445c5bc-gqpmh\" (UID: \"bce3d6b1-ec3a-4b6f-b389-1783076dd2bd\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-gqpmh"
Sep 19 15:54:18.892015 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:18.891994    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bce3d6b1-ec3a-4b6f-b389-1783076dd2bd-metrics-certs\") pod \"maas-api-546445c5bc-gqpmh\" (UID: \"bce3d6b1-ec3a-4b6f-b389-1783076dd2bd\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-gqpmh"
Sep 19 15:54:18.892125 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:18.892039    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bce3d6b1-ec3a-4b6f-b389-1783076dd2bd-maas-api-tls\") pod \"maas-api-546445c5bc-gqpmh\" (UID: \"bce3d6b1-ec3a-4b6f-b389-1783076dd2bd\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-gqpmh"
Sep 19 15:54:18.896639 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:18.896617    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8bz7\" (UniqueName: \"kubernetes.io/projected/bce3d6b1-ec3a-4b6f-b389-1783076dd2bd-kube-api-access-f8bz7\") pod \"maas-api-546445c5bc-gqpmh\" (UID: \"bce3d6b1-ec3a-4b6f-b389-1783076dd2bd\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-gqpmh"
Sep 19 15:54:18.990073 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:18.990038    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-546445c5bc-gqpmh"
Sep 19 15:54:19.261344 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:19.261316    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-546445c5bc-gqpmh"]
Sep 19 15:54:19.262922 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:54:19.262873    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbce3d6b1_ec3a_4b6f_b389_1783076dd2bd.slice/crio-db0cc0eaba19174f53fe4a087fdb99006d2c3a982520be87f02f523471080648 WatchSource:0}: Error finding container db0cc0eaba19174f53fe4a087fdb99006d2c3a982520be87f02f523471080648: Status 404 returned error can't find the container with id db0cc0eaba19174f53fe4a087fdb99006d2c3a982520be87f02f523471080648
Sep 19 15:54:19.264309 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:19.264288    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 15:54:19.596473 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:19.596387    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-546445c5bc-gqpmh" event={"ID":"bce3d6b1-ec3a-4b6f-b389-1783076dd2bd","Type":"ContainerStarted","Data":"db0cc0eaba19174f53fe4a087fdb99006d2c3a982520be87f02f523471080648"}
Sep 19 15:54:20.602956 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:20.602917    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-546445c5bc-gqpmh" event={"ID":"bce3d6b1-ec3a-4b6f-b389-1783076dd2bd","Type":"ContainerStarted","Data":"e7e9eaeb1d509401693474ef711f26d55cf6c96d76c41de9b70483d94b6909a4"}
Sep 19 15:54:20.603345 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:20.603008    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-546445c5bc-gqpmh"
Sep 19 15:54:20.621134 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:20.621080    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-546445c5bc-gqpmh" podStartSLOduration=2.2259184 podStartE2EDuration="2.621062804s" totalImagesPullingTime="395.144404ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 15:54:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:54:20.617581363 +0000 UTC m=+2535.506781076" watchObservedRunningTime="2026-09-19 15:54:20.621062804 +0000 UTC m=+2535.510262545"
Sep 19 15:54:26.615824 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:26.615793    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-546445c5bc-gqpmh"
Sep 19 15:54:26.661555 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:26.661522    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-f47b4794c-k624k"]
Sep 19 15:54:26.661787 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:26.661759    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k" podUID="6b24be02-6567-471e-bea5-6acd600d0a07" containerName="maas-api" containerID="cri-o://d03da3bae6f58c9c4996bedfffd9191a1d186d33f001eb3ddf5a01bb491539f6" gracePeriod=30
Sep 19 15:54:27.912009 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:27.911988    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k"
Sep 19 15:54:27.973935 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:27.973834    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b24be02-6567-471e-bea5-6acd600d0a07-openshift-service-ca\") pod \"6b24be02-6567-471e-bea5-6acd600d0a07\" (UID: \"6b24be02-6567-471e-bea5-6acd600d0a07\") "
Sep 19 15:54:27.973935 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:27.973874    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b24be02-6567-471e-bea5-6acd600d0a07-maas-api-tls\") pod \"6b24be02-6567-471e-bea5-6acd600d0a07\" (UID: \"6b24be02-6567-471e-bea5-6acd600d0a07\") "
Sep 19 15:54:27.974142 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:27.973939    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b24be02-6567-471e-bea5-6acd600d0a07-metrics-certs\") pod \"6b24be02-6567-471e-bea5-6acd600d0a07\" (UID: \"6b24be02-6567-471e-bea5-6acd600d0a07\") "
Sep 19 15:54:27.974142 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:27.973985    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rvhl\" (UniqueName: \"kubernetes.io/projected/6b24be02-6567-471e-bea5-6acd600d0a07-kube-api-access-5rvhl\") pod \"6b24be02-6567-471e-bea5-6acd600d0a07\" (UID: \"6b24be02-6567-471e-bea5-6acd600d0a07\") "
Sep 19 15:54:27.974262 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:27.974233    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b24be02-6567-471e-bea5-6acd600d0a07-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6b24be02-6567-471e-bea5-6acd600d0a07" (UID: "6b24be02-6567-471e-bea5-6acd600d0a07"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 15:54:27.976260 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:27.976226    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b24be02-6567-471e-bea5-6acd600d0a07-kube-api-access-5rvhl" (OuterVolumeSpecName: "kube-api-access-5rvhl") pod "6b24be02-6567-471e-bea5-6acd600d0a07" (UID: "6b24be02-6567-471e-bea5-6acd600d0a07"). InnerVolumeSpecName "kube-api-access-5rvhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 15:54:27.976260 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:27.976234    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b24be02-6567-471e-bea5-6acd600d0a07-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6b24be02-6567-471e-bea5-6acd600d0a07" (UID: "6b24be02-6567-471e-bea5-6acd600d0a07"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:54:27.976435 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:27.976269    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b24be02-6567-471e-bea5-6acd600d0a07-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6b24be02-6567-471e-bea5-6acd600d0a07" (UID: "6b24be02-6567-471e-bea5-6acd600d0a07"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 15:54:28.075399 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:28.075359    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b24be02-6567-471e-bea5-6acd600d0a07-metrics-certs\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:54:28.075399 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:28.075388    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rvhl\" (UniqueName: \"kubernetes.io/projected/6b24be02-6567-471e-bea5-6acd600d0a07-kube-api-access-5rvhl\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:54:28.075399 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:28.075409    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b24be02-6567-471e-bea5-6acd600d0a07-openshift-service-ca\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:54:28.075648 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:28.075418    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b24be02-6567-471e-bea5-6acd600d0a07-maas-api-tls\") on node \"ip-10-0-136-237.ec2.internal\" DevicePath \"\""
Sep 19 15:54:28.649157 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:28.649117    2563 generic.go:356] "Generic (PLEG): container finished" podID="6b24be02-6567-471e-bea5-6acd600d0a07" containerID="d03da3bae6f58c9c4996bedfffd9191a1d186d33f001eb3ddf5a01bb491539f6" exitCode=0
Sep 19 15:54:28.649327 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:28.649163    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k"
Sep 19 15:54:28.649327 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:28.649205    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k" event={"ID":"6b24be02-6567-471e-bea5-6acd600d0a07","Type":"ContainerDied","Data":"d03da3bae6f58c9c4996bedfffd9191a1d186d33f001eb3ddf5a01bb491539f6"}
Sep 19 15:54:28.649327 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:28.649264    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f47b4794c-k624k" event={"ID":"6b24be02-6567-471e-bea5-6acd600d0a07","Type":"ContainerDied","Data":"97d3c675930d76d91fe7a41c150b3fabba3c91da5492cfe4dccd7077615832a7"}
Sep 19 15:54:28.649327 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:28.649288    2563 scope.go:117] "RemoveContainer" containerID="d03da3bae6f58c9c4996bedfffd9191a1d186d33f001eb3ddf5a01bb491539f6"
Sep 19 15:54:28.659067 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:28.659042    2563 scope.go:117] "RemoveContainer" containerID="d03da3bae6f58c9c4996bedfffd9191a1d186d33f001eb3ddf5a01bb491539f6"
Sep 19 15:54:28.659383 ip-10-0-136-237 kubenswrapper[2563]: E0919 15:54:28.659358    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d03da3bae6f58c9c4996bedfffd9191a1d186d33f001eb3ddf5a01bb491539f6\": container with ID starting with d03da3bae6f58c9c4996bedfffd9191a1d186d33f001eb3ddf5a01bb491539f6 not found: ID does not exist" containerID="d03da3bae6f58c9c4996bedfffd9191a1d186d33f001eb3ddf5a01bb491539f6"
Sep 19 15:54:28.659491 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:28.659390    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d03da3bae6f58c9c4996bedfffd9191a1d186d33f001eb3ddf5a01bb491539f6"} err="failed to get container status \"d03da3bae6f58c9c4996bedfffd9191a1d186d33f001eb3ddf5a01bb491539f6\": rpc error: code = NotFound desc = could not find container \"d03da3bae6f58c9c4996bedfffd9191a1d186d33f001eb3ddf5a01bb491539f6\": container with ID starting with d03da3bae6f58c9c4996bedfffd9191a1d186d33f001eb3ddf5a01bb491539f6 not found: ID does not exist"
Sep 19 15:54:28.669520 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:28.669486    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-f47b4794c-k624k"]
Sep 19 15:54:28.673094 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:28.673065    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-f47b4794c-k624k"]
Sep 19 15:54:29.641171 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:29.641134    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b24be02-6567-471e-bea5-6acd600d0a07" path="/var/lib/kubelet/pods/6b24be02-6567-471e-bea5-6acd600d0a07/volumes"
Sep 19 15:54:54.105447 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:54.105417    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-654f84df5-5lqml_3b5c7338-dd99-4112-a139-b8cacae92730/manager/0.log"
Sep 19 15:54:54.338661 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:54.338630    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-krv5g_3279a3b7-0e88-4d97-a784-e24f87a9b0ee/manager/0.log"
Sep 19 15:54:54.458482 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:54.458423    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8c69b6595-tz2fv_ab3f5d1d-5e64-421b-b022-d0e6107471fc/manager/0.log"
Sep 19 15:54:55.073146 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:55.073112    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d8c7f66c-mhhw4_45bd5440-7824-4bbe-affc-ca64cf03148a/copy-manifests/0.log"
Sep 19 15:54:55.080086 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:55.080056    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d8c7f66c-mhhw4_45bd5440-7824-4bbe-affc-ca64cf03148a/manager/0.log"
Sep 19 15:54:55.420052 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:55.419971    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-546445c5bc-gqpmh_bce3d6b1-ec3a-4b6f-b389-1783076dd2bd/maas-api/0.log"
Sep 19 15:54:55.847310 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:55.847278    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-rqmpr_dc45f96e-2139-41f0-9ef1-e2d708a894b4/postgres/0.log"
Sep 19 15:54:56.710388 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:56.710356    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-764dn_c1ebbd5b-8964-4d42-a2e2-357b609eb06f/manager/0.log"
Sep 19 15:54:56.818867 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:56.818832    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-9wcr6_aa149697-f733-4a71-bd29-0b3fe03670ff/manager/0.log"
Sep 19 15:54:57.263693 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:57.263653    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-djbvx_806158dc-1328-47c2-b42e-b68423c266fe/manager/0.log"
Sep 19 15:54:57.732522 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:57.732484    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pcbnn_ef0a73c1-6b87-4013-a212-ff814e4e5b78/discovery/0.log"
Sep 19 15:54:57.944019 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:57.943974    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dc4565f8d-kgbgb_0d5f90ed-7d2d-43b1-b71d-98a44e14e056/kube-auth-proxy/0.log"
Sep 19 15:54:58.166729 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:58.166646    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-76f657cdc4-797pq_2aceba6c-8f11-4a56-8f0c-26a686fec108/payload-pre-processing/0.log"
Sep 19 15:54:58.274328 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:58.274299    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-85fd65c94c-d9qjb_84b17b0d-760c-4abd-a213-03033d4ddab7/payload-processing/0.log"
Sep 19 15:54:58.382984 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:58.382953    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76d56ddb5b-flrvn_92c14079-3000-467d-8823-9a2c8d6c6730/router/0.log"
Sep 19 15:54:58.818320 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:58.818288    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-6pv4k_0eed00e0-c460-4dc9-8fbf-e481d74339be/main/0.log"
Sep 19 15:54:59.252944 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:54:59.252914    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-jxll6_1767d542-ecff-439c-98fc-c45374c228ec/main/0.log"
Sep 19 15:55:06.129533 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:06.129505    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-654f84df5-5lqml_3b5c7338-dd99-4112-a139-b8cacae92730/manager/0.log"
Sep 19 15:55:06.360386 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:06.360301    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-krv5g_3279a3b7-0e88-4d97-a784-e24f87a9b0ee/manager/0.log"
Sep 19 15:55:06.481140 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:06.481107    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8c69b6595-tz2fv_ab3f5d1d-5e64-421b-b022-d0e6107471fc/manager/0.log"
Sep 19 15:55:07.058981 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:07.058954    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d8c7f66c-mhhw4_45bd5440-7824-4bbe-affc-ca64cf03148a/copy-manifests/0.log"
Sep 19 15:55:07.065042 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:07.065015    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d8c7f66c-mhhw4_45bd5440-7824-4bbe-affc-ca64cf03148a/manager/0.log"
Sep 19 15:55:07.395980 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:07.395880    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-546445c5bc-gqpmh_bce3d6b1-ec3a-4b6f-b389-1783076dd2bd/maas-api/0.log"
Sep 19 15:55:07.849093 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:07.849065    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-rqmpr_dc45f96e-2139-41f0-9ef1-e2d708a894b4/postgres/0.log"
Sep 19 15:55:08.733838 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:08.733810    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-764dn_c1ebbd5b-8964-4d42-a2e2-357b609eb06f/manager/0.log"
Sep 19 15:55:08.841788 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:08.841764    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-9wcr6_aa149697-f733-4a71-bd29-0b3fe03670ff/manager/0.log"
Sep 19 15:55:09.328784 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:09.328754    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-djbvx_806158dc-1328-47c2-b42e-b68423c266fe/manager/0.log"
Sep 19 15:55:09.780708 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:09.780678    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pcbnn_ef0a73c1-6b87-4013-a212-ff814e4e5b78/discovery/0.log"
Sep 19 15:55:10.001446 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:10.001406    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dc4565f8d-kgbgb_0d5f90ed-7d2d-43b1-b71d-98a44e14e056/kube-auth-proxy/0.log"
Sep 19 15:55:10.223734 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:10.223681    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-76f657cdc4-797pq_2aceba6c-8f11-4a56-8f0c-26a686fec108/payload-pre-processing/0.log"
Sep 19 15:55:10.334973 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:10.334941    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-85fd65c94c-d9qjb_84b17b0d-760c-4abd-a213-03033d4ddab7/payload-processing/0.log"
Sep 19 15:55:10.448428 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:10.448386    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76d56ddb5b-flrvn_92c14079-3000-467d-8823-9a2c8d6c6730/router/0.log"
Sep 19 15:55:10.885965 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:10.885936    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-6pv4k_0eed00e0-c460-4dc9-8fbf-e481d74339be/main/0.log"
Sep 19 15:55:11.327511 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:11.327471    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-jxll6_1767d542-ecff-439c-98fc-c45374c228ec/main/0.log"
Sep 19 15:55:28.600057 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:28.599969    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8c69b6595-tz2fv_ab3f5d1d-5e64-421b-b022-d0e6107471fc/manager/0.log"
Sep 19 15:55:28.757196 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:28.757158    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8c69b6595-tz2fv_ab3f5d1d-5e64-421b-b022-d0e6107471fc/manager/0.log"
Sep 19 15:55:29.211758 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:29.211723    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-85fd65c94c-d9qjb_84b17b0d-760c-4abd-a213-03033d4ddab7/payload-processing/0.log"
Sep 19 15:55:29.322055 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:29.322022    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-85fd65c94c-d9qjb_84b17b0d-760c-4abd-a213-03033d4ddab7/payload-processing/0.log"
Sep 19 15:55:32.546633 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:32.546599    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-c44rt_825442d3-29e0-41cb-82ef-99f7b9cf9529/global-pull-secret-syncer/0.log"
Sep 19 15:55:32.836286 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:32.836207    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-86pbw_421a4ada-19fe-4af6-a892-b5531c5d1928/konnectivity-agent/0.log"
Sep 19 15:55:32.878766 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:32.878735    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-237.ec2.internal_4704ab0c7c799113b04cd82d197e4ed2/haproxy/0.log"
Sep 19 15:55:37.188021 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:37.187989    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-764dn_c1ebbd5b-8964-4d42-a2e2-357b609eb06f/manager/0.log"
Sep 19 15:55:37.214400 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:37.214374    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-9wcr6_aa149697-f733-4a71-bd29-0b3fe03670ff/manager/0.log"
Sep 19 15:55:37.397706 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:37.397669    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-djbvx_806158dc-1328-47c2-b42e-b68423c266fe/manager/0.log"
Sep 19 15:55:39.220810 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:39.220774    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-p9bwc_8925bba2-d5a0-4386-9ccc-9ef824dfd7bd/cluster-monitoring-operator/0.log"
Sep 19 15:55:39.357700 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:39.357663    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9l5jm_821d59ce-9fad-436d-b71c-bbeaaec11fb3/node-exporter/0.log"
Sep 19 15:55:39.373194 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:39.373165    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9l5jm_821d59ce-9fad-436d-b71c-bbeaaec11fb3/kube-rbac-proxy/0.log"
Sep 19 15:55:39.392111 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:39.392087    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9l5jm_821d59ce-9fad-436d-b71c-bbeaaec11fb3/init-textfile/0.log"
Sep 19 15:55:39.826734 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:39.826698    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-x4hm2_acb4fb7b-aab4-4e1d-9442-b8439354e5c7/prometheus-operator/0.log"
Sep 19 15:55:39.844429 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:39.844407    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-x4hm2_acb4fb7b-aab4-4e1d-9442-b8439354e5c7/kube-rbac-proxy/0.log"
Sep 19 15:55:41.578638 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:41.578609    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-9kjxw_e5fee3ed-19c1-4c0c-9006-4524c20d9ed8/networking-console-plugin/0.log"
Sep 19 15:55:42.210746 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:42.210705    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/1.log"
Sep 19 15:55:42.220821 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:42.220782    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-g2qck_9177bc4f-c634-4722-8a81-74946afb6a3d/console-operator/2.log"
Sep 19 15:55:42.835417 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:42.835378    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5"]
Sep 19 15:55:42.835804 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:42.835791    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b24be02-6567-471e-bea5-6acd600d0a07" containerName="maas-api"
Sep 19 15:55:42.835852 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:42.835806    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b24be02-6567-471e-bea5-6acd600d0a07" containerName="maas-api"
Sep 19 15:55:42.835887 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:42.835869    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b24be02-6567-471e-bea5-6acd600d0a07" containerName="maas-api"
Sep 19 15:55:42.838913 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:42.838876    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5"
Sep 19 15:55:42.840862 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:42.840837    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-79whr\"/\"default-dockercfg-dqvw7\""
Sep 19 15:55:42.841627 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:42.841606    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-79whr\"/\"openshift-service-ca.crt\""
Sep 19 15:55:42.841740 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:42.841627    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-79whr\"/\"kube-root-ca.crt\""
Sep 19 15:55:42.846654 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:42.846339    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5"]
Sep 19 15:55:42.925850 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:42.925815    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5859ae47-cc1c-4a6a-833f-2dfa07fae9ee-podres\") pod \"perf-node-gather-daemonset-r2kj5\" (UID: \"5859ae47-cc1c-4a6a-833f-2dfa07fae9ee\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5"
Sep 19 15:55:42.926050 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:42.925857    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmbld\" (UniqueName: \"kubernetes.io/projected/5859ae47-cc1c-4a6a-833f-2dfa07fae9ee-kube-api-access-bmbld\") pod \"perf-node-gather-daemonset-r2kj5\" (UID: \"5859ae47-cc1c-4a6a-833f-2dfa07fae9ee\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5"
Sep 19 15:55:42.926050 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:42.925874    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5859ae47-cc1c-4a6a-833f-2dfa07fae9ee-sys\") pod \"perf-node-gather-daemonset-r2kj5\" (UID: \"5859ae47-cc1c-4a6a-833f-2dfa07fae9ee\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5"
Sep 19 15:55:42.926050 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:42.925910    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5859ae47-cc1c-4a6a-833f-2dfa07fae9ee-lib-modules\") pod \"perf-node-gather-daemonset-r2kj5\" (UID: \"5859ae47-cc1c-4a6a-833f-2dfa07fae9ee\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5"
Sep 19 15:55:42.926050 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:42.925987    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5859ae47-cc1c-4a6a-833f-2dfa07fae9ee-proc\") pod \"perf-node-gather-daemonset-r2kj5\" (UID: \"5859ae47-cc1c-4a6a-833f-2dfa07fae9ee\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5"
Sep 19 15:55:43.027094 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:43.027050    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5859ae47-cc1c-4a6a-833f-2dfa07fae9ee-proc\") pod \"perf-node-gather-daemonset-r2kj5\" (UID: \"5859ae47-cc1c-4a6a-833f-2dfa07fae9ee\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5"
Sep 19 15:55:43.027277 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:43.027115    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5859ae47-cc1c-4a6a-833f-2dfa07fae9ee-podres\") pod \"perf-node-gather-daemonset-r2kj5\" (UID: \"5859ae47-cc1c-4a6a-833f-2dfa07fae9ee\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5"
Sep 19 15:55:43.027277 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:43.027152    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmbld\" (UniqueName: \"kubernetes.io/projected/5859ae47-cc1c-4a6a-833f-2dfa07fae9ee-kube-api-access-bmbld\") pod \"perf-node-gather-daemonset-r2kj5\" (UID: \"5859ae47-cc1c-4a6a-833f-2dfa07fae9ee\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5"
Sep 19 15:55:43.027277 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:43.027169    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5859ae47-cc1c-4a6a-833f-2dfa07fae9ee-sys\") pod \"perf-node-gather-daemonset-r2kj5\" (UID: \"5859ae47-cc1c-4a6a-833f-2dfa07fae9ee\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5"
Sep 19 15:55:43.027277 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:43.027188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5859ae47-cc1c-4a6a-833f-2dfa07fae9ee-lib-modules\") pod \"perf-node-gather-daemonset-r2kj5\" (UID: \"5859ae47-cc1c-4a6a-833f-2dfa07fae9ee\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5"
Sep 19 15:55:43.027277 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:43.027234    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5859ae47-cc1c-4a6a-833f-2dfa07fae9ee-proc\") pod \"perf-node-gather-daemonset-r2kj5\" (UID: \"5859ae47-cc1c-4a6a-833f-2dfa07fae9ee\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5"
Sep 19 15:55:43.027277 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:43.027234    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5859ae47-cc1c-4a6a-833f-2dfa07fae9ee-podres\") pod \"perf-node-gather-daemonset-r2kj5\" (UID: \"5859ae47-cc1c-4a6a-833f-2dfa07fae9ee\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5"
Sep 19 15:55:43.027580 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:43.027289    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5859ae47-cc1c-4a6a-833f-2dfa07fae9ee-sys\") pod \"perf-node-gather-daemonset-r2kj5\" (UID: \"5859ae47-cc1c-4a6a-833f-2dfa07fae9ee\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5"
Sep 19 15:55:43.027580 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:43.027367    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5859ae47-cc1c-4a6a-833f-2dfa07fae9ee-lib-modules\") pod \"perf-node-gather-daemonset-r2kj5\" (UID: \"5859ae47-cc1c-4a6a-833f-2dfa07fae9ee\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5"
Sep 19 15:55:43.037908 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:43.037865    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmbld\" (UniqueName: \"kubernetes.io/projected/5859ae47-cc1c-4a6a-833f-2dfa07fae9ee-kube-api-access-bmbld\") pod \"perf-node-gather-daemonset-r2kj5\" (UID: \"5859ae47-cc1c-4a6a-833f-2dfa07fae9ee\") " pod="openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5"
Sep 19 15:55:43.149986 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:43.149876    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5"
Sep 19 15:55:43.422582 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:43.422555    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5"]
Sep 19 15:55:43.423588 ip-10-0-136-237 kubenswrapper[2563]: W0919 15:55:43.423559    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5859ae47_cc1c_4a6a_833f_2dfa07fae9ee.slice/crio-2fc6be7bea5b37ec0b2810259dcc3640b97064203137c242d68cb22e4a3487bc WatchSource:0}: Error finding container 2fc6be7bea5b37ec0b2810259dcc3640b97064203137c242d68cb22e4a3487bc: Status 404 returned error can't find the container with id 2fc6be7bea5b37ec0b2810259dcc3640b97064203137c242d68cb22e4a3487bc
Sep 19 15:55:43.544696 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:43.544665    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-mjpvx_e56103e3-9eb1-4204-bd40-b82464d93412/volume-data-source-validator/0.log"
Sep 19 15:55:44.059410 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:44.059366    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5" event={"ID":"5859ae47-cc1c-4a6a-833f-2dfa07fae9ee","Type":"ContainerStarted","Data":"6b9537b362ccfec16b56760fc886436cc5bcae2bf3abcd9de21d5a6deeededbe"}
Sep 19 15:55:44.059810 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:44.059425    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5" event={"ID":"5859ae47-cc1c-4a6a-833f-2dfa07fae9ee","Type":"ContainerStarted","Data":"2fc6be7bea5b37ec0b2810259dcc3640b97064203137c242d68cb22e4a3487bc"}
Sep 19 15:55:44.059810 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:44.059525    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5"
Sep 19 15:55:44.075136 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:44.075086    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5" podStartSLOduration=2.075073141 podStartE2EDuration="2.075073141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 15:55:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 15:55:44.073049805 +0000 UTC m=+2618.962249518" watchObservedRunningTime="2026-09-19 15:55:44.075073141 +0000 UTC m=+2618.964272854"
Sep 19 15:55:44.740697 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:44.740668    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-przrv_fea819f6-340a-495e-9a03-f9c11485c8e7/dns/0.log"
Sep 19 15:55:44.759497 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:44.759468    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-przrv_fea819f6-340a-495e-9a03-f9c11485c8e7/kube-rbac-proxy/0.log"
Sep 19 15:55:44.867508 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:44.867477    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kpxxp_fad92208-d2d8-4b9d-bb3b-8b7b4bef3220/dns-node-resolver/0.log"
Sep 19 15:55:45.424783 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:45.424754    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sxpzd_5057e7a5-e158-4b18-acad-f53613c707c0/node-ca/0.log"
Sep 19 15:55:47.030760 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:47.030726    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pcbnn_ef0a73c1-6b87-4013-a212-ff814e4e5b78/discovery/0.log"
Sep 19 15:55:47.076828 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:47.076798    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dc4565f8d-kgbgb_0d5f90ed-7d2d-43b1-b71d-98a44e14e056/kube-auth-proxy/0.log"
Sep 19 15:55:47.124811 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:47.124779    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-76f657cdc4-797pq_2aceba6c-8f11-4a56-8f0c-26a686fec108/payload-pre-processing/0.log"
Sep 19 15:55:47.146557 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:47.146525    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-85fd65c94c-d9qjb_84b17b0d-760c-4abd-a213-03033d4ddab7/payload-processing/0.log"
Sep 19 15:55:47.172955 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:47.172927    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76d56ddb5b-flrvn_92c14079-3000-467d-8823-9a2c8d6c6730/router/0.log"
Sep 19 15:55:48.078759 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:48.078733    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-42lfw_a29dd07f-cdb8-4df8-9b5c-a3993af1bebf/serve-healthcheck-canary/0.log"
Sep 19 15:55:48.649031 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:48.649001    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-fz6j8_fc3705a0-4a6c-40a1-9233-776b60b77090/insights-operator/0.log"
Sep 19 15:55:48.649922 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:48.649882    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-fz6j8_fc3705a0-4a6c-40a1-9233-776b60b77090/insights-operator/1.log"
Sep 19 15:55:48.669237 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:48.669209    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5kpc7_fd34628c-f7ee-45bd-bd7a-78cf975cdd59/kube-rbac-proxy/0.log"
Sep 19 15:55:48.688760 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:48.688724    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5kpc7_fd34628c-f7ee-45bd-bd7a-78cf975cdd59/exporter/0.log"
Sep 19 15:55:48.707270 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:48.707237    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5kpc7_fd34628c-f7ee-45bd-bd7a-78cf975cdd59/extractor/0.log"
Sep 19 15:55:50.075007 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:50.074978    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-79whr/perf-node-gather-daemonset-r2kj5"
Sep 19 15:55:50.822411 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:50.822386    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-654f84df5-5lqml_3b5c7338-dd99-4112-a139-b8cacae92730/manager/0.log"
Sep 19 15:55:51.260473 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:51.260420    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-krv5g_3279a3b7-0e88-4d97-a784-e24f87a9b0ee/manager/0.log"
Sep 19 15:55:51.328834 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:51.328802    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8c69b6595-tz2fv_ab3f5d1d-5e64-421b-b022-d0e6107471fc/manager/0.log"
Sep 19 15:55:51.625510 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:51.625427    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d8c7f66c-mhhw4_45bd5440-7824-4bbe-affc-ca64cf03148a/manager/0.log"
Sep 19 15:55:51.645334 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:51.645313    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d8c7f66c-mhhw4_45bd5440-7824-4bbe-affc-ca64cf03148a/copy-manifests/0.log"
Sep 19 15:55:53.630986 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:53.630954    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pcbnn_ef0a73c1-6b87-4013-a212-ff814e4e5b78/discovery/0.log"
Sep 19 15:55:53.657251 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:53.657208    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dc4565f8d-kgbgb_0d5f90ed-7d2d-43b1-b71d-98a44e14e056/kube-auth-proxy/0.log"
Sep 19 15:55:53.692920 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:53.692879    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-76f657cdc4-797pq_2aceba6c-8f11-4a56-8f0c-26a686fec108/payload-pre-processing/0.log"
Sep 19 15:55:53.706052 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:53.706023    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-85fd65c94c-d9qjb_84b17b0d-760c-4abd-a213-03033d4ddab7/payload-processing/0.log"
Sep 19 15:55:53.723873 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:53.723839    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76d56ddb5b-flrvn_92c14079-3000-467d-8823-9a2c8d6c6730/router/0.log"
Sep 19 15:55:55.881039 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:55.881003    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pcbnn_ef0a73c1-6b87-4013-a212-ff814e4e5b78/discovery/0.log"
Sep 19 15:55:55.918094 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:55.918067    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dc4565f8d-kgbgb_0d5f90ed-7d2d-43b1-b71d-98a44e14e056/kube-auth-proxy/0.log"
Sep 19 15:55:55.957830 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:55.957800    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-76f657cdc4-797pq_2aceba6c-8f11-4a56-8f0c-26a686fec108/payload-pre-processing/0.log"
Sep 19 15:55:55.970461 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:55.970432    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-85fd65c94c-d9qjb_84b17b0d-760c-4abd-a213-03033d4ddab7/payload-processing/0.log"
Sep 19 15:55:55.991527 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:55.991503    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76d56ddb5b-flrvn_92c14079-3000-467d-8823-9a2c8d6c6730/router/0.log"
Sep 19 15:55:58.219469 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:58.219441    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-q4r9g_2a62045b-6663-436f-871a-3597bc37718a/migrator/0.log"
Sep 19 15:55:58.236918 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:58.236868    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-q4r9g_2a62045b-6663-436f-871a-3597bc37718a/graceful-termination/0.log"
Sep 19 15:55:58.561446 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:58.561378    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-87hpj_6e954267-9310-40da-9df9-939865cb489a/kube-storage-version-migrator-operator/1.log"
Sep 19 15:55:58.563416 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:58.563394    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-87hpj_6e954267-9310-40da-9df9-939865cb489a/kube-storage-version-migrator-operator/0.log"
Sep 19 15:55:59.603909 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:59.603857    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8x2gb_5096ad14-e350-4fbc-bf9b-e35c1e0d4014/kube-multus/0.log"
Sep 19 15:55:59.912281 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:59.912199    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s88xt_7dfc2b45-4bf9-4ca1-80ca-83e1dc131492/kube-multus-additional-cni-plugins/0.log"
Sep 19 15:55:59.932098 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:59.932070    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s88xt_7dfc2b45-4bf9-4ca1-80ca-83e1dc131492/egress-router-binary-copy/0.log"
Sep 19 15:55:59.954689 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:59.954667    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s88xt_7dfc2b45-4bf9-4ca1-80ca-83e1dc131492/cni-plugins/0.log"
Sep 19 15:55:59.975140 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:59.975118    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s88xt_7dfc2b45-4bf9-4ca1-80ca-83e1dc131492/bond-cni-plugin/0.log"
Sep 19 15:55:59.995298 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:55:59.995264    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s88xt_7dfc2b45-4bf9-4ca1-80ca-83e1dc131492/routeoverride-cni/0.log"
Sep 19 15:56:00.015697 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:56:00.015675    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s88xt_7dfc2b45-4bf9-4ca1-80ca-83e1dc131492/whereabouts-cni-bincopy/0.log"
Sep 19 15:56:00.035737 ip-10-0-136-237 kubenswrapper[2563]: I0919 15:56:00.035712    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s88xt_7dfc2b45-4bf9-4ca1-80ca-83e1dc131492/whereabouts-cni/0.log"