Sep 07 21:01:43.626615 ip-10-0-143-142 systemd[1]: Starting Kubernetes Kubelet...
Sep 07 21:01:44.041236 ip-10-0-143-142 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 21:01:44.041236 ip-10-0-143-142 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 07 21:01:44.041236 ip-10-0-143-142 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 21:01:44.041236 ip-10-0-143-142 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 07 21:01:44.041236 ip-10-0-143-142 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 21:01:44.042413 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.042322    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 07 21:01:44.047305 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047288    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 21:01:44.047305 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047304    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 21:01:44.047305 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047320    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 21:01:44.047305 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047323    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 21:01:44.047305 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047326    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 21:01:44.047461 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047329    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 21:01:44.047461 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047333    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 21:01:44.047461 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047335    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 21:01:44.047461 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047339    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 21:01:44.047461 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047341    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 21:01:44.047461 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047344    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 21:01:44.047461 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047347    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 21:01:44.047461 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047349    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 21:01:44.047461 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047352    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 21:01:44.047461 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047358    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 21:01:44.047461 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047362    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 21:01:44.047461 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047364    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 21:01:44.047461 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047367    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 21:01:44.047461 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047370    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 21:01:44.047461 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047373    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 21:01:44.047461 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047375    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 21:01:44.047461 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047378    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 21:01:44.047461 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047381    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 21:01:44.047461 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047383    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 21:01:44.047461 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047386    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 21:01:44.047934 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047388    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 21:01:44.047934 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047391    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 21:01:44.047934 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047394    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 21:01:44.047934 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047397    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 21:01:44.047934 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047399    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 21:01:44.047934 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047402    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 21:01:44.047934 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047405    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 21:01:44.047934 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047407    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 21:01:44.047934 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047410    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 21:01:44.047934 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047413    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 21:01:44.047934 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047415    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 21:01:44.047934 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047418    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 21:01:44.047934 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047420    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 21:01:44.047934 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047425    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 21:01:44.047934 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047428    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 21:01:44.047934 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047431    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 21:01:44.047934 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047433    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 21:01:44.047934 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047436    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 21:01:44.047934 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047439    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 21:01:44.047934 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047442    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 21:01:44.048479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047444    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 21:01:44.048479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047447    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 21:01:44.048479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047450    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 21:01:44.048479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047453    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 21:01:44.048479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047455    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 21:01:44.048479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047458    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 21:01:44.048479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047460    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 21:01:44.048479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047465    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 21:01:44.048479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047467    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 21:01:44.048479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047473    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 21:01:44.048479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047477    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 21:01:44.048479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047480    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 21:01:44.048479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047483    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 21:01:44.048479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047486    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 21:01:44.048479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047489    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 21:01:44.048479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047492    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 21:01:44.048479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047495    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 21:01:44.048479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047498    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 21:01:44.048479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047501    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 21:01:44.048938 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047504    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 21:01:44.048938 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047507    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 21:01:44.048938 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047510    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 21:01:44.048938 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047512    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 21:01:44.048938 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047514    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 21:01:44.048938 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047517    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 21:01:44.048938 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047520    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 21:01:44.048938 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047523    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 21:01:44.048938 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047526    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 21:01:44.048938 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047529    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 21:01:44.048938 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047532    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 21:01:44.048938 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047535    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 21:01:44.048938 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047538    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 21:01:44.048938 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047541    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 21:01:44.048938 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047544    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 21:01:44.048938 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047546    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 21:01:44.048938 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047551    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 21:01:44.048938 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047554    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 21:01:44.048938 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047556    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 21:01:44.049425 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047559    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 21:01:44.049425 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047562    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 21:01:44.049425 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047565    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 21:01:44.049425 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047568    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 21:01:44.049425 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047572    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 21:01:44.049425 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047575    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 21:01:44.049425 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047579    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 21:01:44.049425 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047583    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 21:01:44.049425 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047586    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 21:01:44.049425 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047589    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 21:01:44.049425 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047592    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 21:01:44.049425 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047595    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 21:01:44.049425 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047598    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 21:01:44.049425 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047601    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 21:01:44.049425 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047604    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 21:01:44.049425 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.047606    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 21:01:44.049425 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048299    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 21:01:44.049425 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048305    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 21:01:44.049425 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048323    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 21:01:44.049894 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048327    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 21:01:44.049894 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048330    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 21:01:44.049894 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048333    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 21:01:44.049894 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048336    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 21:01:44.049894 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048338    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 21:01:44.049894 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048341    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 21:01:44.049894 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048344    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 21:01:44.049894 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048347    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 21:01:44.049894 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048350    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 21:01:44.049894 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048352    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 21:01:44.049894 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048355    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 21:01:44.049894 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048358    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 21:01:44.049894 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048360    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 21:01:44.049894 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048363    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 21:01:44.049894 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048365    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 21:01:44.049894 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048368    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 21:01:44.049894 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048371    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 21:01:44.049894 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048375    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 21:01:44.049894 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048378    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 21:01:44.049894 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048381    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 21:01:44.050489 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048384    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 21:01:44.050489 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048386    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 21:01:44.050489 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048389    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 21:01:44.050489 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048391    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 21:01:44.050489 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048394    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 21:01:44.050489 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048396    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 21:01:44.050489 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048399    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 21:01:44.050489 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048401    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 21:01:44.050489 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048404    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 21:01:44.050489 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048406    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 21:01:44.050489 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048409    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 21:01:44.050489 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048411    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 21:01:44.050489 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048414    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 21:01:44.050489 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048417    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 21:01:44.050489 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048419    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 21:01:44.050489 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048423    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 21:01:44.050489 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048426    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 21:01:44.050489 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048429    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 21:01:44.050489 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048431    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 21:01:44.050489 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048434    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 21:01:44.050982 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048437    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 21:01:44.050982 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048439    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 21:01:44.050982 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048441    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 21:01:44.050982 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048444    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 21:01:44.050982 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048446    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 21:01:44.050982 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048449    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 21:01:44.050982 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048451    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 21:01:44.050982 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048454    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 21:01:44.050982 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048456    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 21:01:44.050982 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048459    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 21:01:44.050982 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048461    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 21:01:44.050982 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048465    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 21:01:44.050982 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048467    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 21:01:44.050982 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048470    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 21:01:44.050982 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048473    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 21:01:44.050982 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048475    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 21:01:44.050982 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048478    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 21:01:44.050982 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048481    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 21:01:44.050982 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048483    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 21:01:44.050982 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048486    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 21:01:44.051483 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048489    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 21:01:44.051483 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048491    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 21:01:44.051483 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048497    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 21:01:44.051483 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048500    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 21:01:44.051483 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048503    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 21:01:44.051483 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048506    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 21:01:44.051483 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048509    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 21:01:44.051483 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048511    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 21:01:44.051483 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048514    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 21:01:44.051483 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048517    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 21:01:44.051483 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048519    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 21:01:44.051483 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048522    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 21:01:44.051483 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048525    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 21:01:44.051483 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048527    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 21:01:44.051483 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048530    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 21:01:44.051483 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048532    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 21:01:44.051483 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048534    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 21:01:44.051483 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048537    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 21:01:44.051483 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048540    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 21:01:44.051962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048544    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 21:01:44.051962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048548    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 21:01:44.051962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048551    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 21:01:44.051962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048561    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 21:01:44.051962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048564    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 21:01:44.051962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048567    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 21:01:44.051962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048570    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 21:01:44.051962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048573    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 21:01:44.051962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048576    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 21:01:44.051962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048579    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 21:01:44.051962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048582    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 21:01:44.051962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048584    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 21:01:44.051962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048587    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 21:01:44.051962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048589    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 21:01:44.051962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048592    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 21:01:44.051962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048595    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 21:01:44.051962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048597    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 21:01:44.051962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048982    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 21:01:44.051962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048988    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 21:01:44.051962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048990    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 21:01:44.052486 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048993    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 21:01:44.052486 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048997    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 21:01:44.052486 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.048999    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 21:01:44.052486 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049002    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 21:01:44.052486 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049005    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 21:01:44.052486 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049008    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 21:01:44.052486 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049010    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 21:01:44.052486 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049013    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 21:01:44.052486 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049016    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 21:01:44.052486 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049018    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 21:01:44.052486 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049021    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 21:01:44.052486 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049023    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 21:01:44.052486 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049028    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 21:01:44.052486 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049032    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 21:01:44.052486 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049035    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 21:01:44.052486 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049038    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 21:01:44.052486 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049041    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 21:01:44.052486 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049044    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 21:01:44.052486 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049047    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 21:01:44.052962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049050    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 21:01:44.052962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049053    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 21:01:44.052962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049056    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 21:01:44.052962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049059    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 21:01:44.052962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049061    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 21:01:44.052962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049063    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 21:01:44.052962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049066    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 21:01:44.052962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049069    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 21:01:44.052962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049071    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 21:01:44.052962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049074    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 21:01:44.052962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049077    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 21:01:44.052962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049081    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 21:01:44.052962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049084    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 21:01:44.052962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049087    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 21:01:44.052962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049089    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 21:01:44.052962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049093    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 21:01:44.052962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049095    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 21:01:44.052962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049098    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 21:01:44.052962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049101    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 21:01:44.052962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049103    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 21:01:44.053479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049105    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 21:01:44.053479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049108    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 21:01:44.053479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049111    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 21:01:44.053479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049113    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 21:01:44.053479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049116    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 21:01:44.053479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049118    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 21:01:44.053479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049121    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 21:01:44.053479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049124    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 21:01:44.053479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049126    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 21:01:44.053479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049129    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 21:01:44.053479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049132    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 21:01:44.053479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049134    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 21:01:44.053479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049137    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 21:01:44.053479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049140    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 21:01:44.053479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049143    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 21:01:44.053479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049145    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 21:01:44.053479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049148    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 21:01:44.053479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049150    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 21:01:44.053479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049153    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 21:01:44.053479 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049155    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 21:01:44.053996 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049158    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 21:01:44.053996 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049160    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 21:01:44.053996 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049163    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 21:01:44.053996 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049165    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 21:01:44.053996 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049168    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 21:01:44.053996 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049170    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 21:01:44.053996 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049173    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 21:01:44.053996 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049175    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 21:01:44.053996 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049179    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 21:01:44.053996 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049183    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 21:01:44.053996 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049186    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 21:01:44.053996 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049189    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 21:01:44.053996 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049191    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 21:01:44.053996 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049194    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 21:01:44.053996 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049197    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 21:01:44.053996 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049199    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 21:01:44.053996 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049202    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 21:01:44.053996 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049205    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 21:01:44.053996 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049207    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 21:01:44.054469 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049210    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 21:01:44.054469 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049212    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 21:01:44.054469 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049215    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 21:01:44.054469 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049217    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 21:01:44.054469 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049220    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 21:01:44.054469 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049222    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 21:01:44.054469 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049225    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 21:01:44.054469 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049227    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 21:01:44.054469 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049230    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 21:01:44.054469 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049232    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 21:01:44.054469 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049235    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 21:01:44.054469 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049237    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 21:01:44.054469 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049240    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 21:01:44.054469 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049242    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 21:01:44.054469 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049245    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 21:01:44.054469 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049247    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 21:01:44.054469 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049250    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 21:01:44.054469 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.049253    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 21:01:44.054469 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049349    2558 flags.go:64] FLAG: --address="0.0.0.0"
Sep 07 21:01:44.054469 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049382    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 07 21:01:44.054469 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049389    2558 flags.go:64] FLAG: --anonymous-auth="true"
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049394    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049399    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049402    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049407    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049412    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049415    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049418    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049421    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049425    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049431    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049434    2558 flags.go:64] FLAG: --cgroup-root=""
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049438    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049441    2558 flags.go:64] FLAG: --client-ca-file=""
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049444    2558 flags.go:64] FLAG: --cloud-provider="external"
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049447    2558 flags.go:64] FLAG: --cluster-dns="[]"
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049451    2558 flags.go:64] FLAG: --cluster-domain=""
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049456    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049459    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049462    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049466    2558 flags.go:64] FLAG: --container-log-max-files="5"
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049469    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049472    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 07 21:01:44.054984 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049476    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049479    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049482    2558 flags.go:64] FLAG: --contention-profiling="false"
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049485    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049488    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049492    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049495    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049499    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049502    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049505    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049508    2558 flags.go:64] FLAG: --enable-load-reader="false"
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049511    2558 flags.go:64] FLAG: --enable-server="true"
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049515    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049520    2558 flags.go:64] FLAG: --event-burst="100"
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049523    2558 flags.go:64] FLAG: --event-qps="50"
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049526    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049529    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049532    2558 flags.go:64] FLAG: --eviction-hard=""
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049536    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049540    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049543    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049546    2558 flags.go:64] FLAG: --eviction-soft=""
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049549    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049553    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049555    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 07 21:01:44.055599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049558    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049563    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049566    2558 flags.go:64] FLAG: --fail-swap-on="true"
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049569    2558 flags.go:64] FLAG: --feature-gates=""
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049573    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049576    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049579    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049582    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049585    2558 flags.go:64] FLAG: --healthz-port="10248"
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049588    2558 flags.go:64] FLAG: --help="false"
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049591    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-143-142.ec2.internal"
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049595    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049598    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049601    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049604    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049607    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049610    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049613    2558 flags.go:64] FLAG: --image-service-endpoint=""
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049616    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049619    2558 flags.go:64] FLAG: --kube-api-burst="100"
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049628    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049631    2558 flags.go:64] FLAG: --kube-api-qps="50"
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049634    2558 flags.go:64] FLAG: --kube-reserved=""
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049637    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 07 21:01:44.056212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049640    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049642    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049647    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049650    2558 flags.go:64] FLAG: --lock-file=""
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049652    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049655    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049659    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049664    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049667    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049671    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049674    2558 flags.go:64] FLAG: --logging-format="text"
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049677    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049680    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049683    2558 flags.go:64] FLAG: --manifest-url=""
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049686    2558 flags.go:64] FLAG: --manifest-url-header=""
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049690    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049694    2558 flags.go:64] FLAG: --max-open-files="1000000"
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049698    2558 flags.go:64] FLAG: --max-pods="110"
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049701    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049704    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049706    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049709    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049712    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049715    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049725    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 07 21:01:44.056842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049733    2558 flags.go:64] FLAG: --node-status-max-images="50"
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049736    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049739    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049742    2558 flags.go:64] FLAG: --pod-cidr=""
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049754    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049759    2558 flags.go:64] FLAG: --pod-manifest-path=""
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049762    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049766    2558 flags.go:64] FLAG: --pods-per-core="0"
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049768    2558 flags.go:64] FLAG: --port="10250"
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049771    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049776    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ab678905df940d57"
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049779    2558 flags.go:64] FLAG: --qos-reserved=""
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049782    2558 flags.go:64] FLAG: --read-only-port="10255"
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049785    2558 flags.go:64] FLAG: --register-node="true"
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049788    2558 flags.go:64] FLAG: --register-with-taints=""
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049795    2558 flags.go:64] FLAG: --registry-burst="10"
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049799    2558 flags.go:64] FLAG: --registry-qps="5"
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049802    2558 flags.go:64] FLAG: --reserved-cpus=""
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049805    2558 flags.go:64] FLAG: --reserved-memory=""
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049809    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049812    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049815    2558 flags.go:64] FLAG: --rotate-certificates="false"
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049818    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049821    2558 flags.go:64] FLAG: --runonce="false"
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049824    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 07 21:01:44.057479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049827    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049830    2558 flags.go:64] FLAG: --seccomp-default="false"
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049833    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049836    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049839    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049842    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049845    2558 flags.go:64] FLAG: --storage-driver-password="root"
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049848    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049851    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049854    2558 flags.go:64] FLAG: --storage-driver-user="root"
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049857    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049860    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049864    2558 flags.go:64] FLAG: --system-cgroups=""
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049866    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049872    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049875    2558 flags.go:64] FLAG: --tls-cert-file=""
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049878    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049885    2558 flags.go:64] FLAG: --tls-min-version=""
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049888    2558 flags.go:64] FLAG: --tls-private-key-file=""
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049891    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049894    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049898    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049901    2558 flags.go:64] FLAG: --v="2"
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049907    2558 flags.go:64] FLAG: --version="false"
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049911    2558 flags.go:64] FLAG: --vmodule=""
Sep 07 21:01:44.058082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049915    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 07 21:01:44.058750 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.049918    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 07 21:01:44.058750 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050049    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 21:01:44.058750 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050053    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 21:01:44.058750 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050056    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 21:01:44.058750 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050059    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 21:01:44.058750 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050062    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 21:01:44.058750 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050064    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 21:01:44.058750 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050067    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 21:01:44.058750 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050069    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 21:01:44.058750 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050072    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 21:01:44.058750 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050074    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 21:01:44.058750 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050077    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 21:01:44.058750 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050080    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 21:01:44.058750 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050082    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 21:01:44.058750 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050085    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 21:01:44.058750 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050087    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 21:01:44.058750 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050090    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 21:01:44.058750 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050092    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 21:01:44.058750 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050095    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 21:01:44.058750 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050098    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 21:01:44.059226 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050101    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 21:01:44.059226 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050103    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 21:01:44.059226 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050106    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 21:01:44.059226 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050109    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 21:01:44.059226 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050111    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 21:01:44.059226 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050114    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 21:01:44.059226 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050116    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 21:01:44.059226 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050119    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 21:01:44.059226 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050121    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 21:01:44.059226 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050126    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 21:01:44.059226 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050128    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 21:01:44.059226 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050131    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 21:01:44.059226 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050133    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 21:01:44.059226 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050136    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 21:01:44.059226 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050138    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 21:01:44.059226 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050141    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 21:01:44.059226 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050144    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 21:01:44.059226 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050146    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 21:01:44.059226 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050148    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 21:01:44.059226 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050151    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 21:01:44.059739 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050154    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 21:01:44.059739 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050156    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 21:01:44.059739 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050158    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 21:01:44.059739 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050161    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 21:01:44.059739 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050165    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 21:01:44.059739 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050169    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 21:01:44.059739 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050172    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 21:01:44.059739 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050175    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 21:01:44.059739 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050178    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 21:01:44.059739 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050181    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 21:01:44.059739 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050184    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 21:01:44.059739 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050186    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 21:01:44.059739 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050189    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 21:01:44.059739 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050192    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 21:01:44.059739 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050194    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 21:01:44.059739 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050197    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 21:01:44.059739 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050200    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 21:01:44.059739 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050202    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 21:01:44.059739 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050205    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 21:01:44.060204 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050209    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 21:01:44.060204 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050212    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 21:01:44.060204 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050217    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 21:01:44.060204 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050219    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 21:01:44.060204 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050222    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 21:01:44.060204 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050224    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 21:01:44.060204 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050227    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 21:01:44.060204 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050229    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 21:01:44.060204 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050232    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 21:01:44.060204 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050235    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 21:01:44.060204 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050238    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 21:01:44.060204 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050240    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 21:01:44.060204 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050243    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 21:01:44.060204 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050245    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 21:01:44.060204 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050248    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 21:01:44.060204 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050250    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 21:01:44.060204 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050253    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 21:01:44.060204 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050255    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 21:01:44.060204 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050258    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 21:01:44.060204 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050261    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 21:01:44.060778 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050263    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 21:01:44.060778 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050265    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 21:01:44.060778 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050268    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 21:01:44.060778 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050271    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 21:01:44.060778 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050273    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 21:01:44.060778 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050275    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 21:01:44.060778 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050278    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 21:01:44.060778 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050281    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 21:01:44.060778 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050284    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 21:01:44.060778 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050287    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 21:01:44.060778 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050289    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 21:01:44.060778 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050292    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 21:01:44.060778 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050295    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 21:01:44.060778 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050299    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 21:01:44.060778 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050303    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 21:01:44.060778 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050318    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 21:01:44.060778 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050321    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 21:01:44.060778 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050323    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 21:01:44.060778 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050326    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 21:01:44.061249 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050328    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 21:01:44.061249 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.050331    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 21:01:44.061249 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.051057    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 21:01:44.061249 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.058562    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 07 21:01:44.061249 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.058581    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 07 21:01:44.061249 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.058602    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 07 21:01:44.061249 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.058611    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 07 21:01:44.061249 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058674    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 21:01:44.061249 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058679    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 21:01:44.061249 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058683    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 21:01:44.061249 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058686    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 21:01:44.061249 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058689    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 21:01:44.061249 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058692    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 21:01:44.061249 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058694    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 21:01:44.061249 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058697    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 21:01:44.061663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058700    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 21:01:44.061663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058702    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 21:01:44.061663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058705    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 21:01:44.061663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058708    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 21:01:44.061663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058710    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 21:01:44.061663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058715    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 21:01:44.061663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058718    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 21:01:44.061663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058721    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 21:01:44.061663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058724    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 21:01:44.061663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058727    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 21:01:44.061663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058730    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 21:01:44.061663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058733    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 21:01:44.061663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058735    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 21:01:44.061663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058738    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 21:01:44.061663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058740    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 21:01:44.061663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058743    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 21:01:44.061663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058745    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 21:01:44.061663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058748    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 21:01:44.061663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058750    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 21:01:44.061663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058753    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 21:01:44.062148 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058756    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 21:01:44.062148 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058765    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 21:01:44.062148 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058768    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 21:01:44.062148 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058771    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 21:01:44.062148 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058774    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 21:01:44.062148 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058777    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 21:01:44.062148 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058779    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 21:01:44.062148 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058782    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 21:01:44.062148 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058786    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 21:01:44.062148 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058790    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 21:01:44.062148 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058792    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 21:01:44.062148 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058795    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 21:01:44.062148 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058799    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 21:01:44.062148 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058803    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 21:01:44.062148 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058806    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 21:01:44.062148 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058810    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 21:01:44.062148 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058813    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 21:01:44.062148 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058816    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 21:01:44.062148 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058818    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 21:01:44.062663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058821    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 21:01:44.062663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058824    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 21:01:44.062663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058827    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 21:01:44.062663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058829    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 21:01:44.062663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058832    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 21:01:44.062663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058835    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 21:01:44.062663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058837    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 21:01:44.062663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058840    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 21:01:44.062663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058842    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 21:01:44.062663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058845    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 21:01:44.062663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058847    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 21:01:44.062663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058850    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 21:01:44.062663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058852    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 21:01:44.062663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058855    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 21:01:44.062663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058858    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 21:01:44.062663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058867    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 21:01:44.062663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058869    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 21:01:44.062663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058872    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 21:01:44.062663 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058875    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 21:01:44.063120 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058877    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 21:01:44.063120 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058880    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 21:01:44.063120 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058882    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 21:01:44.063120 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058885    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 21:01:44.063120 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058888    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 21:01:44.063120 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058890    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 21:01:44.063120 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058893    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 21:01:44.063120 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058895    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 21:01:44.063120 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058898    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 21:01:44.063120 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058900    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 21:01:44.063120 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058903    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 21:01:44.063120 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058905    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 21:01:44.063120 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058908    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 21:01:44.063120 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058910    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 21:01:44.063120 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058912    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 21:01:44.063120 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058915    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 21:01:44.063120 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058918    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 21:01:44.063120 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058920    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 21:01:44.063120 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058923    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 21:01:44.063120 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058925    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 21:01:44.063614 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058928    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 21:01:44.063614 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058931    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 21:01:44.063614 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058933    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 21:01:44.063614 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058936    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 21:01:44.063614 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058938    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 21:01:44.063614 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058941    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 21:01:44.063614 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058944    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 21:01:44.063614 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058947    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 21:01:44.063614 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058950    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 21:01:44.063614 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058959    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 21:01:44.063614 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058962    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 21:01:44.063614 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058964    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 21:01:44.063614 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.058967    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 21:01:44.063614 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.058971    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 21:01:44.063614 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059124    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 21:01:44.063986 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059130    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 21:01:44.063986 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059133    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 21:01:44.063986 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059136    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 21:01:44.063986 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059139    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 21:01:44.063986 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059141    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 21:01:44.063986 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059144    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 21:01:44.063986 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059147    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 21:01:44.063986 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059149    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 21:01:44.063986 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059152    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 21:01:44.063986 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059154    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 21:01:44.063986 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059157    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 21:01:44.063986 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059160    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 21:01:44.063986 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059162    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 21:01:44.063986 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059164    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 21:01:44.063986 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059167    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 21:01:44.063986 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059169    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 21:01:44.063986 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059172    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 21:01:44.063986 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059175    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 21:01:44.063986 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059177    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 21:01:44.063986 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059180    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 21:01:44.064646 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059182    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 21:01:44.064646 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059185    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 21:01:44.064646 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059188    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 21:01:44.064646 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059191    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 21:01:44.064646 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059194    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 21:01:44.064646 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059196    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 21:01:44.064646 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059199    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 21:01:44.064646 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059207    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 21:01:44.064646 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059210    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 21:01:44.064646 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059212    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 21:01:44.064646 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059215    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 21:01:44.064646 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059217    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 21:01:44.064646 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059220    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 21:01:44.064646 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059223    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 21:01:44.064646 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059225    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 21:01:44.064646 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059228    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 21:01:44.064646 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059230    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 21:01:44.064646 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059233    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 21:01:44.064646 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059236    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 21:01:44.064646 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059239    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 21:01:44.065448 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059242    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 21:01:44.065448 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059244    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 21:01:44.065448 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059247    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 21:01:44.065448 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059250    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 21:01:44.065448 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059254    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 21:01:44.065448 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059257    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 21:01:44.065448 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059260    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 21:01:44.065448 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059263    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 21:01:44.065448 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059266    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 21:01:44.065448 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059268    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 21:01:44.065448 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059271    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 21:01:44.065448 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059273    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 21:01:44.065448 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059276    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 21:01:44.065448 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059278    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 21:01:44.065448 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059281    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 21:01:44.065448 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059285    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 21:01:44.065448 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059288    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 21:01:44.065448 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059291    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 21:01:44.065448 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059294    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 21:01:44.066160 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059297    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 21:01:44.066160 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059305    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 21:01:44.066160 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059323    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 21:01:44.066160 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059328    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 21:01:44.066160 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059332    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 21:01:44.066160 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059337    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 21:01:44.066160 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059340    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 21:01:44.066160 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059343    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 21:01:44.066160 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059345    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 21:01:44.066160 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059348    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 21:01:44.066160 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059350    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 21:01:44.066160 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059353    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 21:01:44.066160 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059355    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 21:01:44.066160 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059358    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 21:01:44.066160 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059361    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 21:01:44.066160 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059363    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 21:01:44.066160 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059366    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 21:01:44.066160 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059369    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 21:01:44.066160 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059371    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 21:01:44.066160 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059374    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 21:01:44.066751 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059376    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 21:01:44.066751 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059379    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 21:01:44.066751 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059381    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 21:01:44.066751 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059384    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 21:01:44.066751 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059386    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 21:01:44.066751 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059389    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 21:01:44.066751 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059391    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 21:01:44.066751 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059394    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 21:01:44.066751 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059397    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 21:01:44.066751 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059399    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 21:01:44.066751 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059402    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 21:01:44.066751 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059405    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 21:01:44.066751 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059407    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 21:01:44.066751 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059410    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 21:01:44.066751 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059419    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 21:01:44.066751 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059422    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 21:01:44.066751 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059424    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 21:01:44.066751 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059427    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 21:01:44.066751 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:44.059429    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 21:01:44.067214 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.059434    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 21:01:44.067214 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.059574    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 07 21:01:44.067214 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.061602    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 07 21:01:44.067214 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.062606    2558 server.go:1019] "Starting client certificate rotation"
Sep 07 21:01:44.067214 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.062704    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 21:01:44.067214 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.062739    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 21:01:44.067787 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.067769    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 21:01:44.068966 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.068948    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 21:01:44.081151 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.081131    2558 log.go:25] "Validated CRI v1 runtime API"
Sep 07 21:01:44.084776 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.084755    2558 log.go:25] "Validated CRI v1 image API"
Sep 07 21:01:44.085750 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.085734    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 07 21:01:44.088190 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.088170    2558 fs.go:135] Filesystem UUIDs: map[62b6a9c5-dd33-4888-a997-8e2c4c42b749:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ac6386c5-24c3-4c6a-b2c6-d7c561ab6c7b:/dev/nvme0n1p4]
Sep 07 21:01:44.088271 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.088189    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 07 21:01:44.094809 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.094672    2558 manager.go:216] Machine: {Timestamp:2026-09-07 21:01:44.093357681 +0000 UTC m=+0.353174934 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103337 MemoryCapacity:33164468224 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22a945a467f6ba7bf0d955d3c68502 SystemUUID:ec22a945-a467-f6ba-7bf0-d955d3c68502 BootID:dab761d7-8291-43e3-b433-2737392c5395 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582234112 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:45:d6:58:61:c9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:45:d6:58:61:c9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:30:e1:28:5c:54 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164468224 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 07 21:01:44.094809 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.094803    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 07 21:01:44.094920 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.094908    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 07 21:01:44.096731 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.096715    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 21:01:44.097909 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.097877    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 07 21:01:44.098065 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.097912    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-142.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 07 21:01:44.098768 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.098755    2558 topology_manager.go:138] "Creating topology manager with none policy"
Sep 07 21:01:44.098801 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.098769    2558 container_manager_linux.go:309] "Creating device plugin manager"
Sep 07 21:01:44.098801 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.098777    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 21:01:44.099577 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.099567    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 21:01:44.100382 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.100372    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 07 21:01:44.104220 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.104207    2558 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 21:01:44.104372 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.104362    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 07 21:01:44.104410 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.104397    2558 kubelet.go:486] "Attempting to sync node with API server"
Sep 07 21:01:44.104442 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.104421    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 07 21:01:44.104442 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.104437    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 07 21:01:44.104496 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.104464    2558 kubelet.go:398] "Adding apiserver pod source"
Sep 07 21:01:44.104539 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.104531    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 07 21:01:44.105026 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.105014    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 21:01:44.105074 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.105069    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 21:01:44.109132 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.107430    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 07 21:01:44.111194 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.111178    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 07 21:01:44.111277 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.111209    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 07 21:01:44.113147 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.113130    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 07 21:01:44.113147 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.113151    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 07 21:01:44.113276 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.113157    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 07 21:01:44.113276 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.113163    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 07 21:01:44.113276 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.113172    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 07 21:01:44.113276 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.113178    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 07 21:01:44.113276 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.113191    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 07 21:01:44.113276 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.113196    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 07 21:01:44.113276 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.113204    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 07 21:01:44.113276 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.113209    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 07 21:01:44.113276 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.113223    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 07 21:01:44.113276 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.113228    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 07 21:01:44.113862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.113852    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 07 21:01:44.113862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.113862    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 07 21:01:44.115416 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.115381    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 07 21:01:44.115416 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.115404    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-142.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 07 21:01:44.115529 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.115414    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-142.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 07 21:01:44.117771 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.117757    2558 server.go:1268] "Started kubelet"
Sep 07 21:01:44.117834 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.117805    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 07 21:01:44.117893 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.117843    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 07 21:01:44.117925 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.117915    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 07 21:01:44.118656 ip-10-0-143-142 systemd[1]: Started Kubernetes Kubelet.
Sep 07 21:01:44.121411 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.121221    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 07 21:01:44.121651 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.121639    2558 server.go:310] "Adding debug handlers to kubelet server"
Sep 07 21:01:44.124497 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.124480    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rhh5q"
Sep 07 21:01:44.126289 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.126268    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 07 21:01:44.126390 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.126290    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 07 21:01:44.126390 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.126324    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 07 21:01:44.126497 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.126393    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found"
Sep 07 21:01:44.126902 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.126845    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 07 21:01:44.126902 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.126848    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 07 21:01:44.126902 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.126869    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 07 21:01:44.127075 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.127063    2558 reconstruct.go:97] "Volume reconstruction finished"
Sep 07 21:01:44.127075 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.127074    2558 reconciler.go:29] "Reconciler: start to sync state"
Sep 07 21:01:44.127651 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.127632    2558 factory.go:55] Registering systemd factory
Sep 07 21:01:44.127753 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.127671    2558 factory.go:223] Registration of the systemd container factory successfully
Sep 07 21:01:44.127897 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.127885    2558 factory.go:153] Registering CRI-O factory
Sep 07 21:01:44.127958 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.127899    2558 factory.go:223] Registration of the crio container factory successfully
Sep 07 21:01:44.127958 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.127940    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 07 21:01:44.127958 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.127957    2558 factory.go:103] Registering Raw factory
Sep 07 21:01:44.128098 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.127968    2558 manager.go:1196] Started watching for new ooms in manager
Sep 07 21:01:44.129300 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.129285    2558 manager.go:349] Starting recovery of all containers
Sep 07 21:01:44.134005 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.133982    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rhh5q"
Sep 07 21:01:44.134140 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.134118    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-142.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 07 21:01:44.134272 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.134247    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 07 21:01:44.135109 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.134139    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-142.ec2.internal.18d325ad80dc8906  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-142.ec2.internal,UID:ip-10-0-143-142.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-142.ec2.internal,},FirstTimestamp:2026-09-07 21:01:44.117725446 +0000 UTC m=+0.377542680,LastTimestamp:2026-09-07 21:01:44.117725446 +0000 UTC m=+0.377542680,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-142.ec2.internal,}"
Sep 07 21:01:44.141200 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.141178    2558 manager.go:354] Recovery completed
Sep 07 21:01:44.143533 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.143507    2558 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 07 21:01:44.147663 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.147650    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 21:01:44.149668 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.149650    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 21:01:44.149738 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.149685    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 21:01:44.149738 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.149700    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientPID"
Sep 07 21:01:44.150277 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.150263    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 07 21:01:44.150277 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.150271    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 21:01:44.150277 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.150277    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 07 21:01:44.150446 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.150295    2558 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 21:01:44.151013 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.150998    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 21:01:44.151061 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.151032    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 21:01:44.151061 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.151047    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientPID"
Sep 07 21:01:44.151766 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.151688    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-142.ec2.internal.18d325ad82c3f5bf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-142.ec2.internal,UID:ip-10-0-143-142.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-142.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-142.ec2.internal,},FirstTimestamp:2026-09-07 21:01:44.149669311 +0000 UTC m=+0.409486551,LastTimestamp:2026-09-07 21:01:44.149669311 +0000 UTC m=+0.409486551,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-142.ec2.internal,}"
Sep 07 21:01:44.152503 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.152488    2558 policy_none.go:49] "None policy: Start"
Sep 07 21:01:44.152503 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.152506    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 07 21:01:44.152591 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.152516    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 07 21:01:44.154677 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.154661    2558 policy_none.go:47] "Start"
Sep 07 21:01:44.207324 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.197932    2558 manager.go:337] "Starting Device Plugin manager"
Sep 07 21:01:44.207324 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.197976    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 07 21:01:44.207324 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.197989    2558 server.go:87] "Starting device plugin registration server"
Sep 07 21:01:44.207324 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.198504    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 07 21:01:44.207324 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.198531    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 07 21:01:44.207324 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.198616    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 07 21:01:44.207324 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.198717    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 07 21:01:44.207324 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.198726    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 07 21:01:44.207324 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.199270    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 07 21:01:44.207324 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.199329    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-142.ec2.internal\" not found"
Sep 07 21:01:44.210555 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.210539    2558 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2597 into the system container \"/system.slice\": <nil>"
Sep 07 21:01:44.298726 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.298636    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 21:01:44.299677 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.299653    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 21:01:44.299778 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.299697    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 21:01:44.299778 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.299713    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientPID"
Sep 07 21:01:44.299778 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.299747    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-142.ec2.internal"
Sep 07 21:01:44.300655 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.300626    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 07 21:01:44.301913 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.301890    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 07 21:01:44.302025 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.301945    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 07 21:01:44.302025 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.301968    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 07 21:01:44.302025 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.302011    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 07 21:01:44.303846 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.303823    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 21:01:44.305564 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.305547    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-142.ec2.internal"
Sep 07 21:01:44.305639 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.305571    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-142.ec2.internal\": node \"ip-10-0-143-142.ec2.internal\" not found"
Sep 07 21:01:44.351065 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.351030    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found"
Sep 07 21:01:44.402394 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.402357    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-142.ec2.internal"]
Sep 07 21:01:44.402524 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.402453    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 21:01:44.403472 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.403455    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 21:01:44.403579 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.403489    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 21:01:44.403579 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.403502    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientPID"
Sep 07 21:01:44.405817 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.405801    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 21:01:44.405944 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.405929    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal"
Sep 07 21:01:44.405982 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.405960    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 21:01:44.406585 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.406570    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 21:01:44.406655 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.406592    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 21:01:44.406655 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.406602    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientPID"
Sep 07 21:01:44.406655 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.406576    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 21:01:44.406792 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.406674    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 21:01:44.406792 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.406690    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientPID"
Sep 07 21:01:44.408757 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.408736    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-142.ec2.internal"
Sep 07 21:01:44.408845 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.408768    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 21:01:44.409534 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.409518    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 21:01:44.409534 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.409537    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 21:01:44.409661 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.409547    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientPID"
Sep 07 21:01:44.422864 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.422840    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-142.ec2.internal\" not found" node="ip-10-0-143-142.ec2.internal"
Sep 07 21:01:44.426557 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.426540    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-142.ec2.internal\" not found" node="ip-10-0-143-142.ec2.internal"
Sep 07 21:01:44.428657 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.428641    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a45eb752f2f6694c52afb404dc72d7b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal\" (UID: \"8a45eb752f2f6694c52afb404dc72d7b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal"
Sep 07 21:01:44.428701 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.428664    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a45eb752f2f6694c52afb404dc72d7b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal\" (UID: \"8a45eb752f2f6694c52afb404dc72d7b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal"
Sep 07 21:01:44.428701 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.428685    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/59c9c5e403678a260928e5c39ca263d2-config\") pod \"kube-apiserver-proxy-ip-10-0-143-142.ec2.internal\" (UID: \"59c9c5e403678a260928e5c39ca263d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-142.ec2.internal"
Sep 07 21:01:44.451926 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.451906    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found"
Sep 07 21:01:44.529583 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.529550    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a45eb752f2f6694c52afb404dc72d7b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal\" (UID: \"8a45eb752f2f6694c52afb404dc72d7b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal"
Sep 07 21:01:44.529583 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.529580    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a45eb752f2f6694c52afb404dc72d7b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal\" (UID: \"8a45eb752f2f6694c52afb404dc72d7b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal"
Sep 07 21:01:44.529754 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.529597    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/59c9c5e403678a260928e5c39ca263d2-config\") pod \"kube-apiserver-proxy-ip-10-0-143-142.ec2.internal\" (UID: \"59c9c5e403678a260928e5c39ca263d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-142.ec2.internal"
Sep 07 21:01:44.529754 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.529638    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a45eb752f2f6694c52afb404dc72d7b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal\" (UID: \"8a45eb752f2f6694c52afb404dc72d7b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal"
Sep 07 21:01:44.529754 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.529680    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a45eb752f2f6694c52afb404dc72d7b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal\" (UID: \"8a45eb752f2f6694c52afb404dc72d7b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal"
Sep 07 21:01:44.529754 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.529680    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/59c9c5e403678a260928e5c39ca263d2-config\") pod \"kube-apiserver-proxy-ip-10-0-143-142.ec2.internal\" (UID: \"59c9c5e403678a260928e5c39ca263d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-142.ec2.internal"
Sep 07 21:01:44.552717 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.552657    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found"
Sep 07 21:01:44.653476 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.653435    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found"
Sep 07 21:01:44.724586 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.724559    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal"
Sep 07 21:01:44.729656 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:44.729459    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-142.ec2.internal"
Sep 07 21:01:44.754086 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.754057    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found"
Sep 07 21:01:44.854645 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.854549    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found"
Sep 07 21:01:44.955055 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:44.955026    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found"
Sep 07 21:01:45.021936 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:45.021913    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 21:01:45.056137 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:45.056101    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found"
Sep 07 21:01:45.062795 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:45.062763    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 07 21:01:45.062963 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:45.062944    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 07 21:01:45.063008 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:45.062973    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 07 21:01:45.139867 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:45.139832    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 20:56:44 +0000 UTC" deadline="2028-02-18 08:31:38.653432277 +0000 UTC"
Sep 07 21:01:45.139867 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:45.139862    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12683h29m53.513574469s"
Sep 07 21:01:45.157137 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:45.157102    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found"
Sep 07 21:01:45.252271 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:45.252221    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a45eb752f2f6694c52afb404dc72d7b.slice/crio-9726ae5b11f380cc53e284ad887c00597778f228b517498a80c0d20553f1b2e8 WatchSource:0}: Error finding container 9726ae5b11f380cc53e284ad887c00597778f228b517498a80c0d20553f1b2e8: Status 404 returned error can't find the container with id 9726ae5b11f380cc53e284ad887c00597778f228b517498a80c0d20553f1b2e8
Sep 07 21:01:45.257249 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:45.257227    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found"
Sep 07 21:01:45.259225 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:45.259203    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 21:01:45.262934 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:45.262774    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c9c5e403678a260928e5c39ca263d2.slice/crio-110df578869cd8e0b5feda1493623e1136290df6a2ab74e957ef128529de1a2e WatchSource:0}: Error finding container 110df578869cd8e0b5feda1493623e1136290df6a2ab74e957ef128529de1a2e: Status 404 returned error can't find the container with id 110df578869cd8e0b5feda1493623e1136290df6a2ab74e957ef128529de1a2e
Sep 07 21:01:45.305862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:45.305815    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-142.ec2.internal" event={"ID":"59c9c5e403678a260928e5c39ca263d2","Type":"ContainerStarted","Data":"110df578869cd8e0b5feda1493623e1136290df6a2ab74e957ef128529de1a2e"}
Sep 07 21:01:45.306872 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:45.306850    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal" event={"ID":"8a45eb752f2f6694c52afb404dc72d7b","Type":"ContainerStarted","Data":"9726ae5b11f380cc53e284ad887c00597778f228b517498a80c0d20553f1b2e8"}
Sep 07 21:01:45.357457 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:45.357413    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found"
Sep 07 21:01:45.433282 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:45.433205    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 21:01:45.530921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:45.530889    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-142.ec2.internal"
Sep 07 21:01:45.541014 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:45.540992    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 21:01:45.543031 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:45.543016    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal"
Sep 07 21:01:45.553385 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:45.553369    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 21:01:45.719921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:45.719829    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 21:01:46.036899 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.036647    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 21:01:46.106175 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.106147    2558 apiserver.go:52] "Watching apiserver"
Sep 07 21:01:46.111770 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.111673    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 07 21:01:46.113302 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.113271    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-n9n5j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal","openshift-multus/multus-additional-cni-plugins-xgnwf","openshift-network-operator/iptables-alerter-htq6b","openshift-ovn-kubernetes/ovnkube-node-s6r7l","kube-system/kube-apiserver-proxy-ip-10-0-143-142.ec2.internal","openshift-cluster-node-tuning-operator/tuned-gmmxg","openshift-dns/node-resolver-v85rk","openshift-multus/multus-95cj9","openshift-multus/network-metrics-daemon-67mj7","openshift-network-diagnostics/network-check-target-rwdbk","kube-system/global-pull-secret-syncer-59tw4","kube-system/konnectivity-agent-lpqw2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"]
Sep 07 21:01:46.116154 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.116132    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.119012 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.118829    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 07 21:01:46.119119 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.119106    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4fjgz\""
Sep 07 21:01:46.119210 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.119180    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 07 21:01:46.119442 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.119427    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 07 21:01:46.119583 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.119558    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 07 21:01:46.119656 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.119599    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 07 21:01:46.119656 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.119632    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 07 21:01:46.119780 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.119764    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lpqw2"
Sep 07 21:01:46.121952 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.121929    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-w7lbz\""
Sep 07 21:01:46.122280 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.122257    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 07 21:01:46.122538 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.122519    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 07 21:01:46.122773 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.122756    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.124360 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.124340    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v85rk"
Sep 07 21:01:46.124915 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.124894    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 07 21:01:46.125031 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.125010    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4whtr\""
Sep 07 21:01:46.125361 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.125343    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 07 21:01:46.125690 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.125667    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 07 21:01:46.125886 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.125867    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 07 21:01:46.126706 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.126369    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 07 21:01:46.126706 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.126574    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 07 21:01:46.126915 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.126849    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-n6824\""
Sep 07 21:01:46.127230 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.127210    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 07 21:01:46.129042 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.129021    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.131277 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.131258    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 07 21:01:46.131372 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.131282    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 07 21:01:46.131556 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.131536    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-28ww5\""
Sep 07 21:01:46.131624 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.131549    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n9n5j"
Sep 07 21:01:46.134791 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.134771    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bshp8\""
Sep 07 21:01:46.134903 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.134827    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 07 21:01:46.134963 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.134955    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-htq6b"
Sep 07 21:01:46.135540 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.135519    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 07 21:01:46.135761 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.135736    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 07 21:01:46.137790 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.137675    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6950b669-151a-4c2e-a928-be0eca0f92ee-hosts-file\") pod \"node-resolver-v85rk\" (UID: \"6950b669-151a-4c2e-a928-be0eca0f92ee\") " pod="openshift-dns/node-resolver-v85rk"
Sep 07 21:01:46.137790 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.137714    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.137790 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.137729    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-lib-modules\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.138019 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.137815    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7drnw\" (UniqueName: \"kubernetes.io/projected/bda5f620-4586-4b21-8caf-fe98b649e93c-kube-api-access-7drnw\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.138019 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.137854    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-system-cni-dir\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.138019 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.137889    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c318991f-ebca-4f61-8ff5-c09ea86743fa-cni-binary-copy\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.138019 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.137955    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-log-socket\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.138019 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.137989    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-var-lib-kubelet\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.138304 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138022    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d4745ec-df88-4612-ab32-e7760d88135f-agent-certs\") pod \"konnectivity-agent-lpqw2\" (UID: \"7d4745ec-df88-4612-ab32-e7760d88135f\") " pod="kube-system/konnectivity-agent-lpqw2"
Sep 07 21:01:46.138304 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138059    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-etc-modprobe-d\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.138304 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138116    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-var-lib-openvswitch\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.138304 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138153    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bda5f620-4586-4b21-8caf-fe98b649e93c-env-overrides\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.138304 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138211    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bda5f620-4586-4b21-8caf-fe98b649e93c-ovn-node-metrics-cert\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.138304 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138247    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-host-var-lib-cni-multus\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.138304 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138282    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-etc-kubernetes\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.138734 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138315    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-sys\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.138734 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138324    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 07 21:01:46.138734 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138349    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6950b669-151a-4c2e-a928-be0eca0f92ee-tmp-dir\") pod \"node-resolver-v85rk\" (UID: \"6950b669-151a-4c2e-a928-be0eca0f92ee\") " pod="openshift-dns/node-resolver-v85rk"
Sep 07 21:01:46.138734 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138378    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tp48\" (UniqueName: \"kubernetes.io/projected/a04464db-cc33-476d-8256-0cd81b0f81af-kube-api-access-5tp48\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.138734 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138427    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bda5f620-4586-4b21-8caf-fe98b649e93c-ovnkube-config\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.138734 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138490    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fr8q\" (UniqueName: \"kubernetes.io/projected/c318991f-ebca-4f61-8ff5-c09ea86743fa-kube-api-access-7fr8q\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.138734 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138566    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-multus-cni-dir\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.138734 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138604    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-host-run-k8s-cni-cncf-io\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.138734 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138634    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-host-run-netns\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.138734 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138670    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-hostroot\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.138734 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138699    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pbgdv\""
Sep 07 21:01:46.138734 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138717    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-multus-conf-dir\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.140921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138752    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bda5f620-4586-4b21-8caf-fe98b649e93c-ovnkube-script-lib\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.140921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138785    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-host-var-lib-kubelet\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.140921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138812    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-run-openvswitch\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.140921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138855    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-etc-sysconfig\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.140921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138887    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-run-systemd\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.140921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138920    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-node-log\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.140921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138953    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-host-cni-bin\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.140921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138982    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-host-cni-netd\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.140921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.139027    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-systemd-units\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.140921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.138956    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 07 21:01:46.140921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.139179    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-etc-sysctl-d\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.140921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.139209    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-host-kubelet\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.140921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.139247    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-host-run-netns\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.140921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.139305    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-host-run-ovn-kubernetes\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.140921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.139339    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d4745ec-df88-4612-ab32-e7760d88135f-konnectivity-ca\") pod \"konnectivity-agent-lpqw2\" (UID: \"7d4745ec-df88-4612-ab32-e7760d88135f\") " pod="kube-system/konnectivity-agent-lpqw2"
Sep 07 21:01:46.140921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.139453    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-host-var-lib-cni-bin\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.140921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.139500    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-etc-systemd\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.141862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.139533    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c318991f-ebca-4f61-8ff5-c09ea86743fa-multus-daemon-config\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.141862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.139558    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-etc-kubernetes\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.141862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.139623    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-etc-sysctl-conf\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.141862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.139772    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 07 21:01:46.141862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.139802    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a04464db-cc33-476d-8256-0cd81b0f81af-tmp\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.141862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.139852    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-multus-socket-dir-parent\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.141862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.139887    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-host-run-multus-certs\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.141862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.139923    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a04464db-cc33-476d-8256-0cd81b0f81af-etc-tuned\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.141862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.139952    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-host-slash\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.141862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.139954    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 07 21:01:46.141862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.140108    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-etc-openvswitch\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.141862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.140142    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-run\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.141862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.140176    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-run-ovn\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.141862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.140215    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.141862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.140267    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-cnibin\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.141862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.140314    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lcx7\" (UniqueName: \"kubernetes.io/projected/6950b669-151a-4c2e-a928-be0eca0f92ee-kube-api-access-7lcx7\") pod \"node-resolver-v85rk\" (UID: \"6950b669-151a-4c2e-a928-be0eca0f92ee\") " pod="openshift-dns/node-resolver-v85rk"
Sep 07 21:01:46.141862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.140348    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-host\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.141862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.140826    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pls2p\""
Sep 07 21:01:46.141862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.140897    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:01:46.142862 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:46.140995    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67mj7" podUID="0439cb5a-ba34-4a77-9469-f790e6d37dbc"
Sep 07 21:01:46.142862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.141479    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 07 21:01:46.143850 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.143831    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:01:46.143965 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:46.143936    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwdbk" podUID="48ada37c-2a5c-47cd-8fa4-986e554a7288"
Sep 07 21:01:46.144628 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.144608    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 21:01:46.146941 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.146922    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:01:46.147026 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:46.146977    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-59tw4" podUID="fe0c1618-8f48-4a50-8791-83c8e388f13d"
Sep 07 21:01:46.149208 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.149186    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.152532 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.151526    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 07 21:01:46.152532 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.151827    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 07 21:01:46.152532 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.152048    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-l9hlf\""
Sep 07 21:01:46.152532 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.152233    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 07 21:01:46.171751 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.171604    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gp2z8"
Sep 07 21:01:46.179743 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.179724    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gp2z8"
Sep 07 21:01:46.228558 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.228533    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 07 21:01:46.241461 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.241426    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lcx7\" (UniqueName: \"kubernetes.io/projected/6950b669-151a-4c2e-a928-be0eca0f92ee-kube-api-access-7lcx7\") pod \"node-resolver-v85rk\" (UID: \"6950b669-151a-4c2e-a928-be0eca0f92ee\") " pod="openshift-dns/node-resolver-v85rk"
Sep 07 21:01:46.241590 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.241462    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-host\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.241590 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.241490    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6950b669-151a-4c2e-a928-be0eca0f92ee-hosts-file\") pod \"node-resolver-v85rk\" (UID: \"6950b669-151a-4c2e-a928-be0eca0f92ee\") " pod="openshift-dns/node-resolver-v85rk"
Sep 07 21:01:46.241590 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.241515    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-lib-modules\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.241590 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.241540    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7drnw\" (UniqueName: \"kubernetes.io/projected/bda5f620-4586-4b21-8caf-fe98b649e93c-kube-api-access-7drnw\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.241590 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.241586    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-system-cni-dir\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.241852 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.241613    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c318991f-ebca-4f61-8ff5-c09ea86743fa-cni-binary-copy\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.241852 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.241639    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-log-socket\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.241852 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.241668    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c90a86fc-5b8f-44e5-a429-1cd91bed305f-host\") pod \"node-ca-n9n5j\" (UID: \"c90a86fc-5b8f-44e5-a429-1cd91bed305f\") " pod="openshift-image-registry/node-ca-n9n5j"
Sep 07 21:01:46.241852 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.241696    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkgrl\" (UniqueName: \"kubernetes.io/projected/c90a86fc-5b8f-44e5-a429-1cd91bed305f-kube-api-access-fkgrl\") pod \"node-ca-n9n5j\" (UID: \"c90a86fc-5b8f-44e5-a429-1cd91bed305f\") " pod="openshift-image-registry/node-ca-n9n5j"
Sep 07 21:01:46.241852 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.241721    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c408a63-b108-4aa8-9ab4-ee0470087616-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9ztk6\" (UID: \"8c408a63-b108-4aa8-9ab4-ee0470087616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.241852 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.241746    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-var-lib-kubelet\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.241852 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.241770    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d4745ec-df88-4612-ab32-e7760d88135f-agent-certs\") pod \"konnectivity-agent-lpqw2\" (UID: \"7d4745ec-df88-4612-ab32-e7760d88135f\") " pod="kube-system/konnectivity-agent-lpqw2"
Sep 07 21:01:46.241852 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.241796    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xgnwf\" (UID: \"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5\") " pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.241852 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.241823    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-etc-modprobe-d\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.241852 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.241849    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-var-lib-openvswitch\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.242310 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.241874    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bda5f620-4586-4b21-8caf-fe98b649e93c-env-overrides\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.242310 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.241905    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bda5f620-4586-4b21-8caf-fe98b649e93c-ovn-node-metrics-cert\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.242310 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.241931    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-host-var-lib-cni-multus\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.242310 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.241956    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-etc-kubernetes\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.242310 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.241998    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fe0c1618-8f48-4a50-8791-83c8e388f13d-kubelet-config\") pod \"global-pull-secret-syncer-59tw4\" (UID: \"fe0c1618-8f48-4a50-8791-83c8e388f13d\") " pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:01:46.242310 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242023    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-sys\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.242310 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242048    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6950b669-151a-4c2e-a928-be0eca0f92ee-tmp-dir\") pod \"node-resolver-v85rk\" (UID: \"6950b669-151a-4c2e-a928-be0eca0f92ee\") " pod="openshift-dns/node-resolver-v85rk"
Sep 07 21:01:46.242310 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242075    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tp48\" (UniqueName: \"kubernetes.io/projected/a04464db-cc33-476d-8256-0cd81b0f81af-kube-api-access-5tp48\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.242310 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242108    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bda5f620-4586-4b21-8caf-fe98b649e93c-ovnkube-config\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.242310 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242135    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fr8q\" (UniqueName: \"kubernetes.io/projected/c318991f-ebca-4f61-8ff5-c09ea86743fa-kube-api-access-7fr8q\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.242310 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242159    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c90a86fc-5b8f-44e5-a429-1cd91bed305f-serviceca\") pod \"node-ca-n9n5j\" (UID: \"c90a86fc-5b8f-44e5-a429-1cd91bed305f\") " pod="openshift-image-registry/node-ca-n9n5j"
Sep 07 21:01:46.242310 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242184    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c408a63-b108-4aa8-9ab4-ee0470087616-registration-dir\") pod \"aws-ebs-csi-driver-node-9ztk6\" (UID: \"8c408a63-b108-4aa8-9ab4-ee0470087616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.242310 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242211    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c408a63-b108-4aa8-9ab4-ee0470087616-device-dir\") pod \"aws-ebs-csi-driver-node-9ztk6\" (UID: \"8c408a63-b108-4aa8-9ab4-ee0470087616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.242310 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242239    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-multus-cni-dir\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.242310 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242265    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-host-run-k8s-cni-cncf-io\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.242310 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242305    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-host-run-netns\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.242899 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242330    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-hostroot\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.242899 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242360    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-multus-conf-dir\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.242899 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242386    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5-system-cni-dir\") pod \"multus-additional-cni-plugins-xgnwf\" (UID: \"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5\") " pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.242899 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242427    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80a1f3da-f0d8-4428-b7d5-d62035a3015b-host-slash\") pod \"iptables-alerter-htq6b\" (UID: \"80a1f3da-f0d8-4428-b7d5-d62035a3015b\") " pod="openshift-network-operator/iptables-alerter-htq6b"
Sep 07 21:01:46.242899 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242436    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c318991f-ebca-4f61-8ff5-c09ea86743fa-cni-binary-copy\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.242899 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242456    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xgnwf\" (UID: \"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5\") " pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.242899 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242490    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lq4q\" (UniqueName: \"kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q\") pod \"network-check-target-rwdbk\" (UID: \"48ada37c-2a5c-47cd-8fa4-986e554a7288\") " pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:01:46.242899 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242519    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bda5f620-4586-4b21-8caf-fe98b649e93c-ovnkube-script-lib\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.242899 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242546    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-host-var-lib-kubelet\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.242899 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242571    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5-cnibin\") pod \"multus-additional-cni-plugins-xgnwf\" (UID: \"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5\") " pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.242899 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242599    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-run-openvswitch\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.242899 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242627    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-etc-sysconfig\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.242899 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242653    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-run-systemd\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.242899 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242721    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-host\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.242899 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242731    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-run-systemd\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.242899 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242759    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-node-log\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.242899 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242780    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-host-cni-bin\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.243423 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242782    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-log-socket\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.243423 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242818    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6950b669-151a-4c2e-a928-be0eca0f92ee-hosts-file\") pod \"node-resolver-v85rk\" (UID: \"6950b669-151a-4c2e-a928-be0eca0f92ee\") " pod="openshift-dns/node-resolver-v85rk"
Sep 07 21:01:46.243423 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242824    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-host-cni-bin\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.243423 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242895    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-var-lib-kubelet\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.243423 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.242942    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-lib-modules\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.243423 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.243156    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-system-cni-dir\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.243423 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.243184    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-node-log\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.243761 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.243563    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 07 21:01:46.243761 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.243688    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-var-lib-openvswitch\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.244332 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244004    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6950b669-151a-4c2e-a928-be0eca0f92ee-tmp-dir\") pod \"node-resolver-v85rk\" (UID: \"6950b669-151a-4c2e-a928-be0eca0f92ee\") " pod="openshift-dns/node-resolver-v85rk"
Sep 07 21:01:46.244332 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244058    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-multus-cni-dir\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.244332 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244118    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-host-run-k8s-cni-cncf-io\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.244332 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244148    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bda5f620-4586-4b21-8caf-fe98b649e93c-env-overrides\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.244332 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244166    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-host-run-netns\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.244332 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244195    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-etc-sysconfig\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.244332 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244198    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bda5f620-4586-4b21-8caf-fe98b649e93c-ovnkube-config\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.244332 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244205    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-hostroot\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.244332 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244246    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-multus-conf-dir\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.244332 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244264    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-run-openvswitch\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.244332 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244307    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-sys\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.244332 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244336    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-host-cni-netd\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.244332 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244339    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-etc-modprobe-d\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.244924 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244361    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80a1f3da-f0d8-4428-b7d5-d62035a3015b-iptables-alerter-script\") pod \"iptables-alerter-htq6b\" (UID: \"80a1f3da-f0d8-4428-b7d5-d62035a3015b\") " pod="openshift-network-operator/iptables-alerter-htq6b"
Sep 07 21:01:46.244924 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244428    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c408a63-b108-4aa8-9ab4-ee0470087616-socket-dir\") pod \"aws-ebs-csi-driver-node-9ztk6\" (UID: \"8c408a63-b108-4aa8-9ab4-ee0470087616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.244924 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244446    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-host-cni-netd\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.244924 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244447    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-systemd-units\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.244924 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244491    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-systemd-units\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.244924 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244491    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xgnwf\" (UID: \"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5\") " pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.244924 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244527    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-etc-sysctl-d\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.244924 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244531    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-host-var-lib-kubelet\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.244924 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244545    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-host-kubelet\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.244924 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244575    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-host-kubelet\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.244924 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244579    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-host-run-netns\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.244924 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244575    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-host-var-lib-cni-multus\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.244924 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244610    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-host-run-ovn-kubernetes\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.244924 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244662    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d4745ec-df88-4612-ab32-e7760d88135f-konnectivity-ca\") pod \"konnectivity-agent-lpqw2\" (UID: \"7d4745ec-df88-4612-ab32-e7760d88135f\") " pod="kube-system/konnectivity-agent-lpqw2"
Sep 07 21:01:46.244924 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244209    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-etc-kubernetes\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.244924 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244687    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-etc-sysctl-d\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.244924 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244712    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-host-var-lib-cni-bin\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.245678 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244793    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xmxj\" (UniqueName: \"kubernetes.io/projected/80a1f3da-f0d8-4428-b7d5-d62035a3015b-kube-api-access-6xmxj\") pod \"iptables-alerter-htq6b\" (UID: \"80a1f3da-f0d8-4428-b7d5-d62035a3015b\") " pod="openshift-network-operator/iptables-alerter-htq6b"
Sep 07 21:01:46.245678 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244840    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5-cni-binary-copy\") pod \"multus-additional-cni-plugins-xgnwf\" (UID: \"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5\") " pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.245678 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244872    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-etc-systemd\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.245678 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244905    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c318991f-ebca-4f61-8ff5-c09ea86743fa-multus-daemon-config\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.245678 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.244990    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret\") pod \"global-pull-secret-syncer-59tw4\" (UID: \"fe0c1618-8f48-4a50-8791-83c8e388f13d\") " pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:01:46.245678 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245032    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c408a63-b108-4aa8-9ab4-ee0470087616-sys-fs\") pod \"aws-ebs-csi-driver-node-9ztk6\" (UID: \"8c408a63-b108-4aa8-9ab4-ee0470087616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.245678 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245074    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-etc-kubernetes\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.245678 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245099    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-etc-sysctl-conf\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.245678 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245127    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a04464db-cc33-476d-8256-0cd81b0f81af-tmp\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.245678 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245153    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-multus-socket-dir-parent\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.245678 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245181    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-host-run-multus-certs\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.245678 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245207    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnfph\" (UniqueName: \"kubernetes.io/projected/0439cb5a-ba34-4a77-9469-f790e6d37dbc-kube-api-access-mnfph\") pod \"network-metrics-daemon-67mj7\" (UID: \"0439cb5a-ba34-4a77-9469-f790e6d37dbc\") " pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:01:46.245678 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245311    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2rlw\" (UniqueName: \"kubernetes.io/projected/8c408a63-b108-4aa8-9ab4-ee0470087616-kube-api-access-j2rlw\") pod \"aws-ebs-csi-driver-node-9ztk6\" (UID: \"8c408a63-b108-4aa8-9ab4-ee0470087616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.245678 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245342    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmnsk\" (UniqueName: \"kubernetes.io/projected/49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5-kube-api-access-wmnsk\") pod \"multus-additional-cni-plugins-xgnwf\" (UID: \"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5\") " pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.245678 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245360    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d4745ec-df88-4612-ab32-e7760d88135f-konnectivity-ca\") pod \"konnectivity-agent-lpqw2\" (UID: \"7d4745ec-df88-4612-ab32-e7760d88135f\") " pod="kube-system/konnectivity-agent-lpqw2"
Sep 07 21:01:46.245678 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245375    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a04464db-cc33-476d-8256-0cd81b0f81af-etc-tuned\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.245678 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245420    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-host-slash\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.246574 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245467    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-host-slash\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.246574 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245466    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-host-var-lib-cni-bin\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.246574 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245491    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-etc-openvswitch\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.246574 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245522    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-etc-kubernetes\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.246574 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245526    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c408a63-b108-4aa8-9ab4-ee0470087616-etc-selinux\") pod \"aws-ebs-csi-driver-node-9ztk6\" (UID: \"8c408a63-b108-4aa8-9ab4-ee0470087616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.246574 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245553    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-run\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.246574 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245594    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-run-ovn\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.246574 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245620    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-etc-sysctl-conf\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.246574 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245626    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.246574 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245657    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-cnibin\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.246574 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245682    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs\") pod \"network-metrics-daemon-67mj7\" (UID: \"0439cb5a-ba34-4a77-9469-f790e6d37dbc\") " pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:01:46.246574 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245709    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fe0c1618-8f48-4a50-8791-83c8e388f13d-dbus\") pod \"global-pull-secret-syncer-59tw4\" (UID: \"fe0c1618-8f48-4a50-8791-83c8e388f13d\") " pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:01:46.246574 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245801    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-run\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.246574 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245813    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bda5f620-4586-4b21-8caf-fe98b649e93c-ovnkube-script-lib\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.246574 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245831    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-host-run-ovn-kubernetes\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.246574 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245869    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c318991f-ebca-4f61-8ff5-c09ea86743fa-multus-daemon-config\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.246574 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245898    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-host-run-multus-certs\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.247377 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245915    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-etc-openvswitch\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.247377 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245922    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-host-run-netns\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.247377 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245943    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a04464db-cc33-476d-8256-0cd81b0f81af-etc-systemd\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.247377 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.245999    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-cnibin\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.247377 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.246006    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-run-ovn\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.247377 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.246065    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c318991f-ebca-4f61-8ff5-c09ea86743fa-multus-socket-dir-parent\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.247377 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.246066    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bda5f620-4586-4b21-8caf-fe98b649e93c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.249116 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.248718    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a04464db-cc33-476d-8256-0cd81b0f81af-tmp\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.249116 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.248824    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bda5f620-4586-4b21-8caf-fe98b649e93c-ovn-node-metrics-cert\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.249116 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.249019    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d4745ec-df88-4612-ab32-e7760d88135f-agent-certs\") pod \"konnectivity-agent-lpqw2\" (UID: \"7d4745ec-df88-4612-ab32-e7760d88135f\") " pod="kube-system/konnectivity-agent-lpqw2"
Sep 07 21:01:46.249464 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.249440    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a04464db-cc33-476d-8256-0cd81b0f81af-etc-tuned\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.251243 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.251221    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7drnw\" (UniqueName: \"kubernetes.io/projected/bda5f620-4586-4b21-8caf-fe98b649e93c-kube-api-access-7drnw\") pod \"ovnkube-node-s6r7l\" (UID: \"bda5f620-4586-4b21-8caf-fe98b649e93c\") " pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.251813 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.251788    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lcx7\" (UniqueName: \"kubernetes.io/projected/6950b669-151a-4c2e-a928-be0eca0f92ee-kube-api-access-7lcx7\") pod \"node-resolver-v85rk\" (UID: \"6950b669-151a-4c2e-a928-be0eca0f92ee\") " pod="openshift-dns/node-resolver-v85rk"
Sep 07 21:01:46.252008 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.251984    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tp48\" (UniqueName: \"kubernetes.io/projected/a04464db-cc33-476d-8256-0cd81b0f81af-kube-api-access-5tp48\") pod \"tuned-gmmxg\" (UID: \"a04464db-cc33-476d-8256-0cd81b0f81af\") " pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.252230 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.252211    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fr8q\" (UniqueName: \"kubernetes.io/projected/c318991f-ebca-4f61-8ff5-c09ea86743fa-kube-api-access-7fr8q\") pod \"multus-95cj9\" (UID: \"c318991f-ebca-4f61-8ff5-c09ea86743fa\") " pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.346062 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.345972    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80a1f3da-f0d8-4428-b7d5-d62035a3015b-iptables-alerter-script\") pod \"iptables-alerter-htq6b\" (UID: \"80a1f3da-f0d8-4428-b7d5-d62035a3015b\") " pod="openshift-network-operator/iptables-alerter-htq6b"
Sep 07 21:01:46.346062 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346017    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c408a63-b108-4aa8-9ab4-ee0470087616-socket-dir\") pod \"aws-ebs-csi-driver-node-9ztk6\" (UID: \"8c408a63-b108-4aa8-9ab4-ee0470087616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.346062 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346052    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xgnwf\" (UID: \"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5\") " pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.346364 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346084    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xmxj\" (UniqueName: \"kubernetes.io/projected/80a1f3da-f0d8-4428-b7d5-d62035a3015b-kube-api-access-6xmxj\") pod \"iptables-alerter-htq6b\" (UID: \"80a1f3da-f0d8-4428-b7d5-d62035a3015b\") " pod="openshift-network-operator/iptables-alerter-htq6b"
Sep 07 21:01:46.346364 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346106    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5-cni-binary-copy\") pod \"multus-additional-cni-plugins-xgnwf\" (UID: \"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5\") " pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.346364 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346131    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret\") pod \"global-pull-secret-syncer-59tw4\" (UID: \"fe0c1618-8f48-4a50-8791-83c8e388f13d\") " pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:01:46.346364 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346159    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c408a63-b108-4aa8-9ab4-ee0470087616-sys-fs\") pod \"aws-ebs-csi-driver-node-9ztk6\" (UID: \"8c408a63-b108-4aa8-9ab4-ee0470087616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.346364 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346185    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c408a63-b108-4aa8-9ab4-ee0470087616-socket-dir\") pod \"aws-ebs-csi-driver-node-9ztk6\" (UID: \"8c408a63-b108-4aa8-9ab4-ee0470087616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.346364 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346227    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c408a63-b108-4aa8-9ab4-ee0470087616-sys-fs\") pod \"aws-ebs-csi-driver-node-9ztk6\" (UID: \"8c408a63-b108-4aa8-9ab4-ee0470087616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.346364 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346258    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnfph\" (UniqueName: \"kubernetes.io/projected/0439cb5a-ba34-4a77-9469-f790e6d37dbc-kube-api-access-mnfph\") pod \"network-metrics-daemon-67mj7\" (UID: \"0439cb5a-ba34-4a77-9469-f790e6d37dbc\") " pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:01:46.346364 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346285    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2rlw\" (UniqueName: \"kubernetes.io/projected/8c408a63-b108-4aa8-9ab4-ee0470087616-kube-api-access-j2rlw\") pod \"aws-ebs-csi-driver-node-9ztk6\" (UID: \"8c408a63-b108-4aa8-9ab4-ee0470087616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.346364 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:46.346297    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 21:01:46.346364 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346311    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmnsk\" (UniqueName: \"kubernetes.io/projected/49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5-kube-api-access-wmnsk\") pod \"multus-additional-cni-plugins-xgnwf\" (UID: \"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5\") " pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.346364 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346340    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c408a63-b108-4aa8-9ab4-ee0470087616-etc-selinux\") pod \"aws-ebs-csi-driver-node-9ztk6\" (UID: \"8c408a63-b108-4aa8-9ab4-ee0470087616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.346939 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346387    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs\") pod \"network-metrics-daemon-67mj7\" (UID: \"0439cb5a-ba34-4a77-9469-f790e6d37dbc\") " pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:01:46.346939 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346413    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fe0c1618-8f48-4a50-8791-83c8e388f13d-dbus\") pod \"global-pull-secret-syncer-59tw4\" (UID: \"fe0c1618-8f48-4a50-8791-83c8e388f13d\") " pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:01:46.346939 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346447    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c90a86fc-5b8f-44e5-a429-1cd91bed305f-host\") pod \"node-ca-n9n5j\" (UID: \"c90a86fc-5b8f-44e5-a429-1cd91bed305f\") " pod="openshift-image-registry/node-ca-n9n5j"
Sep 07 21:01:46.346939 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346295    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xgnwf\" (UID: \"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5\") " pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.346939 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346474    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkgrl\" (UniqueName: \"kubernetes.io/projected/c90a86fc-5b8f-44e5-a429-1cd91bed305f-kube-api-access-fkgrl\") pod \"node-ca-n9n5j\" (UID: \"c90a86fc-5b8f-44e5-a429-1cd91bed305f\") " pod="openshift-image-registry/node-ca-n9n5j"
Sep 07 21:01:46.346939 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346518    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c408a63-b108-4aa8-9ab4-ee0470087616-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9ztk6\" (UID: \"8c408a63-b108-4aa8-9ab4-ee0470087616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.346939 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346547    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xgnwf\" (UID: \"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5\") " pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.346939 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346582    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fe0c1618-8f48-4a50-8791-83c8e388f13d-kubelet-config\") pod \"global-pull-secret-syncer-59tw4\" (UID: \"fe0c1618-8f48-4a50-8791-83c8e388f13d\") " pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:01:46.346939 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346615    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c90a86fc-5b8f-44e5-a429-1cd91bed305f-serviceca\") pod \"node-ca-n9n5j\" (UID: \"c90a86fc-5b8f-44e5-a429-1cd91bed305f\") " pod="openshift-image-registry/node-ca-n9n5j"
Sep 07 21:01:46.346939 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:46.346640    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret podName:fe0c1618-8f48-4a50-8791-83c8e388f13d nodeName:}" failed. No retries permitted until 2026-09-07 21:01:46.846613991 +0000 UTC m=+3.106431219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret") pod "global-pull-secret-syncer-59tw4" (UID: "fe0c1618-8f48-4a50-8791-83c8e388f13d") : object "kube-system"/"original-pull-secret" not registered
Sep 07 21:01:46.346939 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346645    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c408a63-b108-4aa8-9ab4-ee0470087616-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9ztk6\" (UID: \"8c408a63-b108-4aa8-9ab4-ee0470087616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.346939 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346656    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80a1f3da-f0d8-4428-b7d5-d62035a3015b-iptables-alerter-script\") pod \"iptables-alerter-htq6b\" (UID: \"80a1f3da-f0d8-4428-b7d5-d62035a3015b\") " pod="openshift-network-operator/iptables-alerter-htq6b"
Sep 07 21:01:46.346939 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346681    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c408a63-b108-4aa8-9ab4-ee0470087616-registration-dir\") pod \"aws-ebs-csi-driver-node-9ztk6\" (UID: \"8c408a63-b108-4aa8-9ab4-ee0470087616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.346939 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346701    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c90a86fc-5b8f-44e5-a429-1cd91bed305f-host\") pod \"node-ca-n9n5j\" (UID: \"c90a86fc-5b8f-44e5-a429-1cd91bed305f\") " pod="openshift-image-registry/node-ca-n9n5j"
Sep 07 21:01:46.346939 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346710    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c408a63-b108-4aa8-9ab4-ee0470087616-device-dir\") pod \"aws-ebs-csi-driver-node-9ztk6\" (UID: \"8c408a63-b108-4aa8-9ab4-ee0470087616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.346939 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346734    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fe0c1618-8f48-4a50-8791-83c8e388f13d-kubelet-config\") pod \"global-pull-secret-syncer-59tw4\" (UID: \"fe0c1618-8f48-4a50-8791-83c8e388f13d\") " pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:01:46.346939 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:46.346743    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:01:46.347757 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346745    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5-system-cni-dir\") pod \"multus-additional-cni-plugins-xgnwf\" (UID: \"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5\") " pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.347757 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346770    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80a1f3da-f0d8-4428-b7d5-d62035a3015b-host-slash\") pod \"iptables-alerter-htq6b\" (UID: \"80a1f3da-f0d8-4428-b7d5-d62035a3015b\") " pod="openshift-network-operator/iptables-alerter-htq6b"
Sep 07 21:01:46.347757 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346795    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c408a63-b108-4aa8-9ab4-ee0470087616-etc-selinux\") pod \"aws-ebs-csi-driver-node-9ztk6\" (UID: \"8c408a63-b108-4aa8-9ab4-ee0470087616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.347757 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346795    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xgnwf\" (UID: \"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5\") " pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.347757 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346826    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lq4q\" (UniqueName: \"kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q\") pod \"network-check-target-rwdbk\" (UID: \"48ada37c-2a5c-47cd-8fa4-986e554a7288\") " pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:01:46.347757 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:46.346840    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs podName:0439cb5a-ba34-4a77-9469-f790e6d37dbc nodeName:}" failed. No retries permitted until 2026-09-07 21:01:46.846825137 +0000 UTC m=+3.106642377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs") pod "network-metrics-daemon-67mj7" (UID: "0439cb5a-ba34-4a77-9469-f790e6d37dbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:01:46.347757 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346845    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c408a63-b108-4aa8-9ab4-ee0470087616-device-dir\") pod \"aws-ebs-csi-driver-node-9ztk6\" (UID: \"8c408a63-b108-4aa8-9ab4-ee0470087616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.347757 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346872    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5-cnibin\") pod \"multus-additional-cni-plugins-xgnwf\" (UID: \"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5\") " pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.347757 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346880    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c408a63-b108-4aa8-9ab4-ee0470087616-registration-dir\") pod \"aws-ebs-csi-driver-node-9ztk6\" (UID: \"8c408a63-b108-4aa8-9ab4-ee0470087616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.347757 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346932    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5-cni-binary-copy\") pod \"multus-additional-cni-plugins-xgnwf\" (UID: \"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5\") " pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.347757 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346953    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5-cnibin\") pod \"multus-additional-cni-plugins-xgnwf\" (UID: \"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5\") " pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.347757 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.346978    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5-system-cni-dir\") pod \"multus-additional-cni-plugins-xgnwf\" (UID: \"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5\") " pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.347757 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.347052    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fe0c1618-8f48-4a50-8791-83c8e388f13d-dbus\") pod \"global-pull-secret-syncer-59tw4\" (UID: \"fe0c1618-8f48-4a50-8791-83c8e388f13d\") " pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:01:46.347757 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.347052    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80a1f3da-f0d8-4428-b7d5-d62035a3015b-host-slash\") pod \"iptables-alerter-htq6b\" (UID: \"80a1f3da-f0d8-4428-b7d5-d62035a3015b\") " pod="openshift-network-operator/iptables-alerter-htq6b"
Sep 07 21:01:46.347757 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.347084    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xgnwf\" (UID: \"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5\") " pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.347757 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.347445    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xgnwf\" (UID: \"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5\") " pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.348278 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.347616    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c90a86fc-5b8f-44e5-a429-1cd91bed305f-serviceca\") pod \"node-ca-n9n5j\" (UID: \"c90a86fc-5b8f-44e5-a429-1cd91bed305f\") " pod="openshift-image-registry/node-ca-n9n5j"
Sep 07 21:01:46.355298 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:46.355276    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 21:01:46.355298 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:46.355301    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 21:01:46.355511 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:46.355313    2558 projected.go:196] Error preparing data for projected volume kube-api-access-6lq4q for pod openshift-network-diagnostics/network-check-target-rwdbk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:01:46.355511 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:46.355370    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q podName:48ada37c-2a5c-47cd-8fa4-986e554a7288 nodeName:}" failed. No retries permitted until 2026-09-07 21:01:46.855357072 +0000 UTC m=+3.115174320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6lq4q" (UniqueName: "kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q") pod "network-check-target-rwdbk" (UID: "48ada37c-2a5c-47cd-8fa4-986e554a7288") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:01:46.358177 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.358104    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xmxj\" (UniqueName: \"kubernetes.io/projected/80a1f3da-f0d8-4428-b7d5-d62035a3015b-kube-api-access-6xmxj\") pod \"iptables-alerter-htq6b\" (UID: \"80a1f3da-f0d8-4428-b7d5-d62035a3015b\") " pod="openshift-network-operator/iptables-alerter-htq6b"
Sep 07 21:01:46.358177 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.358129    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2rlw\" (UniqueName: \"kubernetes.io/projected/8c408a63-b108-4aa8-9ab4-ee0470087616-kube-api-access-j2rlw\") pod \"aws-ebs-csi-driver-node-9ztk6\" (UID: \"8c408a63-b108-4aa8-9ab4-ee0470087616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.359281 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.359257    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkgrl\" (UniqueName: \"kubernetes.io/projected/c90a86fc-5b8f-44e5-a429-1cd91bed305f-kube-api-access-fkgrl\") pod \"node-ca-n9n5j\" (UID: \"c90a86fc-5b8f-44e5-a429-1cd91bed305f\") " pod="openshift-image-registry/node-ca-n9n5j"
Sep 07 21:01:46.359570 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.359547    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmnsk\" (UniqueName: \"kubernetes.io/projected/49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5-kube-api-access-wmnsk\") pod \"multus-additional-cni-plugins-xgnwf\" (UID: \"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5\") " pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.359654 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.359616    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnfph\" (UniqueName: \"kubernetes.io/projected/0439cb5a-ba34-4a77-9469-f790e6d37dbc-kube-api-access-mnfph\") pod \"network-metrics-daemon-67mj7\" (UID: \"0439cb5a-ba34-4a77-9469-f790e6d37dbc\") " pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:01:46.431131 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.431094    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:01:46.445152 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.445124    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lpqw2"
Sep 07 21:01:46.454219 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.454191    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-95cj9"
Sep 07 21:01:46.460102 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.460079    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v85rk"
Sep 07 21:01:46.467066 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.467042    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gmmxg"
Sep 07 21:01:46.473850 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.473830    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n9n5j"
Sep 07 21:01:46.481240 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.481219    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-htq6b"
Sep 07 21:01:46.487232 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.487214    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xgnwf"
Sep 07 21:01:46.492236 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.492217    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6"
Sep 07 21:01:46.851879 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.851808    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret\") pod \"global-pull-secret-syncer-59tw4\" (UID: \"fe0c1618-8f48-4a50-8791-83c8e388f13d\") " pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:01:46.851879 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.851888    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs\") pod \"network-metrics-daemon-67mj7\" (UID: \"0439cb5a-ba34-4a77-9469-f790e6d37dbc\") " pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:01:46.852172 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:46.851978    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 21:01:46.852172 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:46.852050    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret podName:fe0c1618-8f48-4a50-8791-83c8e388f13d nodeName:}" failed. No retries permitted until 2026-09-07 21:01:47.852034233 +0000 UTC m=+4.111851456 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret") pod "global-pull-secret-syncer-59tw4" (UID: "fe0c1618-8f48-4a50-8791-83c8e388f13d") : object "kube-system"/"original-pull-secret" not registered
Sep 07 21:01:46.852172 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:46.851986    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:01:46.852172 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:46.852122    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs podName:0439cb5a-ba34-4a77-9469-f790e6d37dbc nodeName:}" failed. No retries permitted until 2026-09-07 21:01:47.852108438 +0000 UTC m=+4.111925661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs") pod "network-metrics-daemon-67mj7" (UID: "0439cb5a-ba34-4a77-9469-f790e6d37dbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:01:46.952646 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:46.952603    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lq4q\" (UniqueName: \"kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q\") pod \"network-check-target-rwdbk\" (UID: \"48ada37c-2a5c-47cd-8fa4-986e554a7288\") " pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:01:46.952851 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:46.952783    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 21:01:46.952851 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:46.952805    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 21:01:46.952851 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:46.952817    2558 projected.go:196] Error preparing data for projected volume kube-api-access-6lq4q for pod openshift-network-diagnostics/network-check-target-rwdbk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:01:46.952976 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:46.952872    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q podName:48ada37c-2a5c-47cd-8fa4-986e554a7288 nodeName:}" failed. No retries permitted until 2026-09-07 21:01:47.952857515 +0000 UTC m=+4.212674743 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6lq4q" (UniqueName: "kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q") pod "network-check-target-rwdbk" (UID: "48ada37c-2a5c-47cd-8fa4-986e554a7288") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:01:47.183217 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:47.183118    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 20:56:46 +0000 UTC" deadline="2028-04-29 17:59:46.483783825 +0000 UTC"
Sep 07 21:01:47.183217 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:47.183168    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14396h57m59.30061915s"
Sep 07 21:01:47.265659 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:47.265628    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80a1f3da_f0d8_4428_b7d5_d62035a3015b.slice/crio-e0447e29f14a9dfb7b9f62f2ac57fa031f0fc3d280526377eae5c4533194d086 WatchSource:0}: Error finding container e0447e29f14a9dfb7b9f62f2ac57fa031f0fc3d280526377eae5c4533194d086: Status 404 returned error can't find the container with id e0447e29f14a9dfb7b9f62f2ac57fa031f0fc3d280526377eae5c4533194d086
Sep 07 21:01:47.271751 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:47.271694    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b7fb02_83fe_4bd2_a1cd_d51f05fe7ee5.slice/crio-e42a6baa287ea6206bd9fe6edc1bad79e4adebcc221f908030286103cda49b81 WatchSource:0}: Error finding container e42a6baa287ea6206bd9fe6edc1bad79e4adebcc221f908030286103cda49b81: Status 404 returned error can't find the container with id e42a6baa287ea6206bd9fe6edc1bad79e4adebcc221f908030286103cda49b81
Sep 07 21:01:47.272482 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:47.272455    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c408a63_b108_4aa8_9ab4_ee0470087616.slice/crio-78978709493b0b47a8c123e3c876cbdded0eb9e36884c5366e5dc5b60e3123d9 WatchSource:0}: Error finding container 78978709493b0b47a8c123e3c876cbdded0eb9e36884c5366e5dc5b60e3123d9: Status 404 returned error can't find the container with id 78978709493b0b47a8c123e3c876cbdded0eb9e36884c5366e5dc5b60e3123d9
Sep 07 21:01:47.273680 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:47.273173    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc90a86fc_5b8f_44e5_a429_1cd91bed305f.slice/crio-a1cb4e3f2f689a3e8ea473145ec983fd4043b7229319498e9dc5a5fc28f96eff WatchSource:0}: Error finding container a1cb4e3f2f689a3e8ea473145ec983fd4043b7229319498e9dc5a5fc28f96eff: Status 404 returned error can't find the container with id a1cb4e3f2f689a3e8ea473145ec983fd4043b7229319498e9dc5a5fc28f96eff
Sep 07 21:01:47.274224 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:47.274206    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbda5f620_4586_4b21_8caf_fe98b649e93c.slice/crio-277335a425bc8b7e9c529df7778838df88e0567c8f55020eeda0523b52d9230b WatchSource:0}: Error finding container 277335a425bc8b7e9c529df7778838df88e0567c8f55020eeda0523b52d9230b: Status 404 returned error can't find the container with id 277335a425bc8b7e9c529df7778838df88e0567c8f55020eeda0523b52d9230b
Sep 07 21:01:47.275887 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:47.275867    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d4745ec_df88_4612_ab32_e7760d88135f.slice/crio-b86e43570e351f62f72548398db2e9113160dd5e9b55dc5104d50233f4f44d4d WatchSource:0}: Error finding container b86e43570e351f62f72548398db2e9113160dd5e9b55dc5104d50233f4f44d4d: Status 404 returned error can't find the container with id b86e43570e351f62f72548398db2e9113160dd5e9b55dc5104d50233f4f44d4d
Sep 07 21:01:47.277842 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:47.277685    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6950b669_151a_4c2e_a928_be0eca0f92ee.slice/crio-e4f8f65bf3a78dff334c583fcdced8e08d32c324825c72ecb863513277288ff4 WatchSource:0}: Error finding container e4f8f65bf3a78dff334c583fcdced8e08d32c324825c72ecb863513277288ff4: Status 404 returned error can't find the container with id e4f8f65bf3a78dff334c583fcdced8e08d32c324825c72ecb863513277288ff4
Sep 07 21:01:47.280485 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:01:47.280046    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda04464db_cc33_476d_8256_0cd81b0f81af.slice/crio-48bd6ac41bec2121c1e79012ce5ecc8a804ee98291759ef8f935dc55d54ce27a WatchSource:0}: Error finding container 48bd6ac41bec2121c1e79012ce5ecc8a804ee98291759ef8f935dc55d54ce27a: Status 404 returned error can't find the container with id 48bd6ac41bec2121c1e79012ce5ecc8a804ee98291759ef8f935dc55d54ce27a
Sep 07 21:01:47.310879 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:47.310811    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gmmxg" event={"ID":"a04464db-cc33-476d-8256-0cd81b0f81af","Type":"ContainerStarted","Data":"48bd6ac41bec2121c1e79012ce5ecc8a804ee98291759ef8f935dc55d54ce27a"}
Sep 07 21:01:47.312002 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:47.311974    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lpqw2" event={"ID":"7d4745ec-df88-4612-ab32-e7760d88135f","Type":"ContainerStarted","Data":"b86e43570e351f62f72548398db2e9113160dd5e9b55dc5104d50233f4f44d4d"}
Sep 07 21:01:47.313399 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:47.313361    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6" event={"ID":"8c408a63-b108-4aa8-9ab4-ee0470087616","Type":"ContainerStarted","Data":"78978709493b0b47a8c123e3c876cbdded0eb9e36884c5366e5dc5b60e3123d9"}
Sep 07 21:01:47.314590 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:47.314572    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-95cj9" event={"ID":"c318991f-ebca-4f61-8ff5-c09ea86743fa","Type":"ContainerStarted","Data":"cb9027e5129e9f75f33868767c46b7630b4233b03802e199f461946b76bf3bc0"}
Sep 07 21:01:47.315837 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:47.315812    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v85rk" event={"ID":"6950b669-151a-4c2e-a928-be0eca0f92ee","Type":"ContainerStarted","Data":"e4f8f65bf3a78dff334c583fcdced8e08d32c324825c72ecb863513277288ff4"}
Sep 07 21:01:47.317086 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:47.317059    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l" event={"ID":"bda5f620-4586-4b21-8caf-fe98b649e93c","Type":"ContainerStarted","Data":"277335a425bc8b7e9c529df7778838df88e0567c8f55020eeda0523b52d9230b"}
Sep 07 21:01:47.322871 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:47.322849    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n9n5j" event={"ID":"c90a86fc-5b8f-44e5-a429-1cd91bed305f","Type":"ContainerStarted","Data":"a1cb4e3f2f689a3e8ea473145ec983fd4043b7229319498e9dc5a5fc28f96eff"}
Sep 07 21:01:47.328146 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:47.328120    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xgnwf" event={"ID":"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5","Type":"ContainerStarted","Data":"e42a6baa287ea6206bd9fe6edc1bad79e4adebcc221f908030286103cda49b81"}
Sep 07 21:01:47.332439 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:47.332373    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-htq6b" event={"ID":"80a1f3da-f0d8-4428-b7d5-d62035a3015b","Type":"ContainerStarted","Data":"e0447e29f14a9dfb7b9f62f2ac57fa031f0fc3d280526377eae5c4533194d086"}
Sep 07 21:01:47.564032 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:47.564006    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 21:01:47.859029 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:47.858830    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret\") pod \"global-pull-secret-syncer-59tw4\" (UID: \"fe0c1618-8f48-4a50-8791-83c8e388f13d\") " pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:01:47.859029 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:47.858896    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs\") pod \"network-metrics-daemon-67mj7\" (UID: \"0439cb5a-ba34-4a77-9469-f790e6d37dbc\") " pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:01:47.859316 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:47.859056    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:01:47.859316 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:47.859143    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs podName:0439cb5a-ba34-4a77-9469-f790e6d37dbc nodeName:}" failed. No retries permitted until 2026-09-07 21:01:49.859107893 +0000 UTC m=+6.118925137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs") pod "network-metrics-daemon-67mj7" (UID: "0439cb5a-ba34-4a77-9469-f790e6d37dbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:01:47.859605 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:47.859586    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 21:01:47.859678 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:47.859642    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret podName:fe0c1618-8f48-4a50-8791-83c8e388f13d nodeName:}" failed. No retries permitted until 2026-09-07 21:01:49.859627403 +0000 UTC m=+6.119444631 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret") pod "global-pull-secret-syncer-59tw4" (UID: "fe0c1618-8f48-4a50-8791-83c8e388f13d") : object "kube-system"/"original-pull-secret" not registered
Sep 07 21:01:47.959718 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:47.959675    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lq4q\" (UniqueName: \"kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q\") pod \"network-check-target-rwdbk\" (UID: \"48ada37c-2a5c-47cd-8fa4-986e554a7288\") " pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:01:47.959912 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:47.959899    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 21:01:47.959981 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:47.959918    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 21:01:47.959981 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:47.959933    2558 projected.go:196] Error preparing data for projected volume kube-api-access-6lq4q for pod openshift-network-diagnostics/network-check-target-rwdbk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:01:47.960093 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:47.959992    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q podName:48ada37c-2a5c-47cd-8fa4-986e554a7288 nodeName:}" failed. No retries permitted until 2026-09-07 21:01:49.959972907 +0000 UTC m=+6.219790136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6lq4q" (UniqueName: "kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q") pod "network-check-target-rwdbk" (UID: "48ada37c-2a5c-47cd-8fa4-986e554a7288") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:01:48.183956 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:48.183837    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 20:56:46 +0000 UTC" deadline="2028-05-26 04:48:38.063980038 +0000 UTC"
Sep 07 21:01:48.183956 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:48.183903    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15031h46m49.880080976s"
Sep 07 21:01:48.305713 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:48.305359    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:01:48.306579 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:48.306037    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-59tw4" podUID="fe0c1618-8f48-4a50-8791-83c8e388f13d"
Sep 07 21:01:48.306579 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:48.305704    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:01:48.306579 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:48.306134    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwdbk" podUID="48ada37c-2a5c-47cd-8fa4-986e554a7288"
Sep 07 21:01:48.306579 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:48.305691    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:01:48.306579 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:48.306209    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67mj7" podUID="0439cb5a-ba34-4a77-9469-f790e6d37dbc"
Sep 07 21:01:48.340611 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:48.340571    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-142.ec2.internal" event={"ID":"59c9c5e403678a260928e5c39ca263d2","Type":"ContainerStarted","Data":"21c36ab63a58fc18b40b5a71c6eb12a2c557bc2f30a3034ff31840d7b07fe432"}
Sep 07 21:01:48.346279 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:48.346247    2558 generic.go:356] "Generic (PLEG): container finished" podID="8a45eb752f2f6694c52afb404dc72d7b" containerID="d5c9e0cede73705790faf341e0981f5d68b2c1836f61d04ecad5f1b321f8ccfe" exitCode=0
Sep 07 21:01:48.346429 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:48.346307    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal" event={"ID":"8a45eb752f2f6694c52afb404dc72d7b","Type":"ContainerDied","Data":"d5c9e0cede73705790faf341e0981f5d68b2c1836f61d04ecad5f1b321f8ccfe"}
Sep 07 21:01:48.357921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:48.357866    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-142.ec2.internal" podStartSLOduration=2.35784416 podStartE2EDuration="2.35784416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:01:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:01:48.357425794 +0000 UTC m=+4.617243076" watchObservedRunningTime="2026-09-07 21:01:48.35784416 +0000 UTC m=+4.617661408"
Sep 07 21:01:49.367905 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:49.367545    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal" event={"ID":"8a45eb752f2f6694c52afb404dc72d7b","Type":"ContainerStarted","Data":"97cf5114dcbe065e751b777fe8fa4a7c441e0a1fa8c41cc96f160c6e40f6975a"}
Sep 07 21:01:49.385037 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:49.384979    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal" podStartSLOduration=3.384952965 podStartE2EDuration="3.384952965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:01:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:01:49.383947592 +0000 UTC m=+5.643764843" watchObservedRunningTime="2026-09-07 21:01:49.384952965 +0000 UTC m=+5.644770216"
Sep 07 21:01:49.876145 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:49.876104    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret\") pod \"global-pull-secret-syncer-59tw4\" (UID: \"fe0c1618-8f48-4a50-8791-83c8e388f13d\") " pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:01:49.876419 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:49.876168    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs\") pod \"network-metrics-daemon-67mj7\" (UID: \"0439cb5a-ba34-4a77-9469-f790e6d37dbc\") " pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:01:49.876419 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:49.876304    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:01:49.876419 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:49.876396    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs podName:0439cb5a-ba34-4a77-9469-f790e6d37dbc nodeName:}" failed. No retries permitted until 2026-09-07 21:01:53.876372675 +0000 UTC m=+10.136189917 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs") pod "network-metrics-daemon-67mj7" (UID: "0439cb5a-ba34-4a77-9469-f790e6d37dbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:01:49.876879 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:49.876836    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 21:01:49.876980 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:49.876893    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret podName:fe0c1618-8f48-4a50-8791-83c8e388f13d nodeName:}" failed. No retries permitted until 2026-09-07 21:01:53.876877415 +0000 UTC m=+10.136694643 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret") pod "global-pull-secret-syncer-59tw4" (UID: "fe0c1618-8f48-4a50-8791-83c8e388f13d") : object "kube-system"/"original-pull-secret" not registered
Sep 07 21:01:49.976935 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:49.976885    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lq4q\" (UniqueName: \"kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q\") pod \"network-check-target-rwdbk\" (UID: \"48ada37c-2a5c-47cd-8fa4-986e554a7288\") " pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:01:49.977117 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:49.977067    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 21:01:49.977117 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:49.977094    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 21:01:49.977117 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:49.977107    2558 projected.go:196] Error preparing data for projected volume kube-api-access-6lq4q for pod openshift-network-diagnostics/network-check-target-rwdbk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:01:49.977297 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:49.977172    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q podName:48ada37c-2a5c-47cd-8fa4-986e554a7288 nodeName:}" failed. No retries permitted until 2026-09-07 21:01:53.977151396 +0000 UTC m=+10.236968631 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6lq4q" (UniqueName: "kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q") pod "network-check-target-rwdbk" (UID: "48ada37c-2a5c-47cd-8fa4-986e554a7288") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:01:50.303616 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:50.303485    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:01:50.303616 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:50.303512    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:01:50.303844 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:50.303649    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwdbk" podUID="48ada37c-2a5c-47cd-8fa4-986e554a7288"
Sep 07 21:01:50.304197 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:50.303933    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:01:50.304197 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:50.304063    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67mj7" podUID="0439cb5a-ba34-4a77-9469-f790e6d37dbc"
Sep 07 21:01:50.304197 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:50.304167    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-59tw4" podUID="fe0c1618-8f48-4a50-8791-83c8e388f13d"
Sep 07 21:01:52.303599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:52.303082    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:01:52.303599 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:52.303198    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67mj7" podUID="0439cb5a-ba34-4a77-9469-f790e6d37dbc"
Sep 07 21:01:52.303599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:52.303372    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:01:52.303599 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:52.303488    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwdbk" podUID="48ada37c-2a5c-47cd-8fa4-986e554a7288"
Sep 07 21:01:52.303599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:52.303556    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:01:52.304204 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:52.303635    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-59tw4" podUID="fe0c1618-8f48-4a50-8791-83c8e388f13d"
Sep 07 21:01:53.908194 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:53.908152    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret\") pod \"global-pull-secret-syncer-59tw4\" (UID: \"fe0c1618-8f48-4a50-8791-83c8e388f13d\") " pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:01:53.908655 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:53.908210    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs\") pod \"network-metrics-daemon-67mj7\" (UID: \"0439cb5a-ba34-4a77-9469-f790e6d37dbc\") " pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:01:53.908655 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:53.908380    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 21:01:53.908655 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:53.908453    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret podName:fe0c1618-8f48-4a50-8791-83c8e388f13d nodeName:}" failed. No retries permitted until 2026-09-07 21:02:01.908434938 +0000 UTC m=+18.168252173 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret") pod "global-pull-secret-syncer-59tw4" (UID: "fe0c1618-8f48-4a50-8791-83c8e388f13d") : object "kube-system"/"original-pull-secret" not registered
Sep 07 21:01:53.908655 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:53.908380    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:01:53.908655 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:53.908553    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs podName:0439cb5a-ba34-4a77-9469-f790e6d37dbc nodeName:}" failed. No retries permitted until 2026-09-07 21:02:01.90852978 +0000 UTC m=+18.168347010 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs") pod "network-metrics-daemon-67mj7" (UID: "0439cb5a-ba34-4a77-9469-f790e6d37dbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:01:54.008718 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:54.008681    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lq4q\" (UniqueName: \"kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q\") pod \"network-check-target-rwdbk\" (UID: \"48ada37c-2a5c-47cd-8fa4-986e554a7288\") " pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:01:54.008906 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:54.008881    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 21:01:54.008977 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:54.008917    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 21:01:54.008977 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:54.008932    2558 projected.go:196] Error preparing data for projected volume kube-api-access-6lq4q for pod openshift-network-diagnostics/network-check-target-rwdbk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:01:54.009072 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:54.009005    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q podName:48ada37c-2a5c-47cd-8fa4-986e554a7288 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:02.008986995 +0000 UTC m=+18.268804235 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6lq4q" (UniqueName: "kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q") pod "network-check-target-rwdbk" (UID: "48ada37c-2a5c-47cd-8fa4-986e554a7288") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:01:54.303744 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:54.303668    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:01:54.303894 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:54.303780    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwdbk" podUID="48ada37c-2a5c-47cd-8fa4-986e554a7288"
Sep 07 21:01:54.303894 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:54.303795    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:01:54.304008 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:54.303914    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-59tw4" podUID="fe0c1618-8f48-4a50-8791-83c8e388f13d"
Sep 07 21:01:54.304008 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:54.303950    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:01:54.304207 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:54.304038    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67mj7" podUID="0439cb5a-ba34-4a77-9469-f790e6d37dbc"
Sep 07 21:01:56.302614 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:56.302491    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:01:56.303056 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:56.302634    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-59tw4" podUID="fe0c1618-8f48-4a50-8791-83c8e388f13d"
Sep 07 21:01:56.303056 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:56.302491    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:01:56.303056 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:56.302741    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67mj7" podUID="0439cb5a-ba34-4a77-9469-f790e6d37dbc"
Sep 07 21:01:56.303056 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:56.302491    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:01:56.303056 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:56.302810    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwdbk" podUID="48ada37c-2a5c-47cd-8fa4-986e554a7288"
Sep 07 21:01:58.302741 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:58.302709    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:01:58.303091 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:58.302710    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:01:58.303091 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:58.302824    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67mj7" podUID="0439cb5a-ba34-4a77-9469-f790e6d37dbc"
Sep 07 21:01:58.303091 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:01:58.302850    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:01:58.303091 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:58.302908    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-59tw4" podUID="fe0c1618-8f48-4a50-8791-83c8e388f13d"
Sep 07 21:01:58.303091 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:01:58.302998    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwdbk" podUID="48ada37c-2a5c-47cd-8fa4-986e554a7288"
Sep 07 21:02:00.303196 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:00.303159    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:02:00.303710 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:00.303219    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:02:00.303710 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:00.303159    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:02:00.303710 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:00.303327    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67mj7" podUID="0439cb5a-ba34-4a77-9469-f790e6d37dbc"
Sep 07 21:02:00.303710 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:00.303397    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-59tw4" podUID="fe0c1618-8f48-4a50-8791-83c8e388f13d"
Sep 07 21:02:00.303710 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:00.303478    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwdbk" podUID="48ada37c-2a5c-47cd-8fa4-986e554a7288"
Sep 07 21:02:01.969634 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:01.969592    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret\") pod \"global-pull-secret-syncer-59tw4\" (UID: \"fe0c1618-8f48-4a50-8791-83c8e388f13d\") " pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:02:01.970099 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:01.969656    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs\") pod \"network-metrics-daemon-67mj7\" (UID: \"0439cb5a-ba34-4a77-9469-f790e6d37dbc\") " pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:02:01.970099 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:01.969773    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 21:02:01.970099 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:01.969802    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:02:01.970099 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:01.969857    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret podName:fe0c1618-8f48-4a50-8791-83c8e388f13d nodeName:}" failed. No retries permitted until 2026-09-07 21:02:17.969833276 +0000 UTC m=+34.229650521 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret") pod "global-pull-secret-syncer-59tw4" (UID: "fe0c1618-8f48-4a50-8791-83c8e388f13d") : object "kube-system"/"original-pull-secret" not registered
Sep 07 21:02:01.970099 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:01.969879    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs podName:0439cb5a-ba34-4a77-9469-f790e6d37dbc nodeName:}" failed. No retries permitted until 2026-09-07 21:02:17.969867425 +0000 UTC m=+34.229684648 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs") pod "network-metrics-daemon-67mj7" (UID: "0439cb5a-ba34-4a77-9469-f790e6d37dbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:02:02.070500 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:02.070465    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lq4q\" (UniqueName: \"kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q\") pod \"network-check-target-rwdbk\" (UID: \"48ada37c-2a5c-47cd-8fa4-986e554a7288\") " pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:02:02.070645 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:02.070622    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 21:02:02.070698 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:02.070650    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 21:02:02.070698 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:02.070661    2558 projected.go:196] Error preparing data for projected volume kube-api-access-6lq4q for pod openshift-network-diagnostics/network-check-target-rwdbk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:02:02.070768 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:02.070712    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q podName:48ada37c-2a5c-47cd-8fa4-986e554a7288 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:18.070698414 +0000 UTC m=+34.330515649 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6lq4q" (UniqueName: "kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q") pod "network-check-target-rwdbk" (UID: "48ada37c-2a5c-47cd-8fa4-986e554a7288") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:02:02.303405 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:02.302878    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:02:02.303405 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:02.302884    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:02:02.303405 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:02.303016    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwdbk" podUID="48ada37c-2a5c-47cd-8fa4-986e554a7288"
Sep 07 21:02:02.303405 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:02.303122    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-59tw4" podUID="fe0c1618-8f48-4a50-8791-83c8e388f13d"
Sep 07 21:02:02.303405 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:02.302887    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:02:02.303405 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:02.303239    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67mj7" podUID="0439cb5a-ba34-4a77-9469-f790e6d37dbc"
Sep 07 21:02:04.303158 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:04.303119    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:02:04.303660 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:04.303239    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwdbk" podUID="48ada37c-2a5c-47cd-8fa4-986e554a7288"
Sep 07 21:02:04.303660 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:04.303287    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:02:04.303660 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:04.303360    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:02:04.303660 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:04.303443    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-59tw4" podUID="fe0c1618-8f48-4a50-8791-83c8e388f13d"
Sep 07 21:02:04.303660 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:04.303519    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67mj7" podUID="0439cb5a-ba34-4a77-9469-f790e6d37dbc"
Sep 07 21:02:06.303179 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.302987    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:02:06.304076 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.302987    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:02:06.304076 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:06.303273    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-59tw4" podUID="fe0c1618-8f48-4a50-8791-83c8e388f13d"
Sep 07 21:02:06.304076 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:06.303291    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwdbk" podUID="48ada37c-2a5c-47cd-8fa4-986e554a7288"
Sep 07 21:02:06.304076 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.302996    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:02:06.304076 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:06.303395    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67mj7" podUID="0439cb5a-ba34-4a77-9469-f790e6d37dbc"
Sep 07 21:02:06.408860 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.408783    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gmmxg" event={"ID":"a04464db-cc33-476d-8256-0cd81b0f81af","Type":"ContainerStarted","Data":"3d58329c4b642e1090f871fb3e547f447f3b48fbca243d8197fa48845e8d2b47"}
Sep 07 21:02:06.410451 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.410418    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lpqw2" event={"ID":"7d4745ec-df88-4612-ab32-e7760d88135f","Type":"ContainerStarted","Data":"5cbe2ab00f7d709e9bb5548f5f931ccea88ac4536f00579652d6641bb2d58021"}
Sep 07 21:02:06.411985 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.411961    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6" event={"ID":"8c408a63-b108-4aa8-9ab4-ee0470087616","Type":"ContainerStarted","Data":"759331a03d94307bb653f520d14885d51a625b830130a56a06e18c8a47218a90"}
Sep 07 21:02:06.415572 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.415550    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-95cj9" event={"ID":"c318991f-ebca-4f61-8ff5-c09ea86743fa","Type":"ContainerStarted","Data":"32c6861a3899896ad9b7ecff7b6508f9a30822083de94e290e9615bd9ac01914"}
Sep 07 21:02:06.416888 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.416862    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v85rk" event={"ID":"6950b669-151a-4c2e-a928-be0eca0f92ee","Type":"ContainerStarted","Data":"6aa51beb032bfd50d5ebba3fd2d0db3d846fa184a584ee6156c9ac6234095b6d"}
Sep 07 21:02:06.419636 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.419613    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l" event={"ID":"bda5f620-4586-4b21-8caf-fe98b649e93c","Type":"ContainerStarted","Data":"0f816dbe350f70d98758404ceb6c91714ef227d319abf1829b8b88af9d9a64ba"}
Sep 07 21:02:06.419735 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.419672    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l" event={"ID":"bda5f620-4586-4b21-8caf-fe98b649e93c","Type":"ContainerStarted","Data":"173bb002799e5940dc1ab7043c6ca8e59e0a466034f7164f93741e512d052685"}
Sep 07 21:02:06.419735 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.419712    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l" event={"ID":"bda5f620-4586-4b21-8caf-fe98b649e93c","Type":"ContainerStarted","Data":"db02d2d02eca09566bffd4f52aa2f5b2df57602cc82e61cd03d0e76cad5bff3b"}
Sep 07 21:02:06.419816 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.419747    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l" event={"ID":"bda5f620-4586-4b21-8caf-fe98b649e93c","Type":"ContainerStarted","Data":"2da5aaa846f4623ec333086ddac170da5cc2a2e1c9720a5b65994bf93b134ca5"}
Sep 07 21:02:06.419816 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.419775    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l" event={"ID":"bda5f620-4586-4b21-8caf-fe98b649e93c","Type":"ContainerStarted","Data":"cc69a8a59f8a86aeea49aad04483cfac0af61809e48dc1711052464585fe710c"}
Sep 07 21:02:06.419816 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.419804    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l" event={"ID":"bda5f620-4586-4b21-8caf-fe98b649e93c","Type":"ContainerStarted","Data":"f9ddd8e76c636e0824fc86491ec1223773c8a2eddd6ef29ee98d2aa3c90654b1"}
Sep 07 21:02:06.420817 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.420797    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n9n5j" event={"ID":"c90a86fc-5b8f-44e5-a429-1cd91bed305f","Type":"ContainerStarted","Data":"32e334b91d5a6e5ae79ae48d7a5bfbddbfc1f3547203d3b8ef7d329d31262793"}
Sep 07 21:02:06.422028 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.422003    2558 generic.go:356] "Generic (PLEG): container finished" podID="49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5" containerID="b8fd08dc10dfdc66e27bec638bc0e046857cb77dd5b8bbd8f4fbf0f24ef5ea2b" exitCode=0
Sep 07 21:02:06.422110 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.422034    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xgnwf" event={"ID":"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5","Type":"ContainerDied","Data":"b8fd08dc10dfdc66e27bec638bc0e046857cb77dd5b8bbd8f4fbf0f24ef5ea2b"}
Sep 07 21:02:06.426964 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.426929    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gmmxg" podStartSLOduration=3.339554632 podStartE2EDuration="21.426916692s" totalImagesPullingTime="18.08736206s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:06.42646505 +0000 UTC m=+22.686282307" watchObservedRunningTime="2026-09-07 21:02:06.426916692 +0000 UTC m=+22.686733936"
Sep 07 21:02:06.441603 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.441564    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lpqw2" podStartSLOduration=4.350547422 podStartE2EDuration="22.441554862s" totalImagesPullingTime="18.09100744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:06.44108 +0000 UTC m=+22.700897259" watchObservedRunningTime="2026-09-07 21:02:06.441554862 +0000 UTC m=+22.701372105"
Sep 07 21:02:06.475483 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.475430    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-95cj9" podStartSLOduration=4.3272686799999995 podStartE2EDuration="22.475414188s" totalImagesPullingTime="18.148145508s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:06.474947521 +0000 UTC m=+22.734764775" watchObservedRunningTime="2026-09-07 21:02:06.475414188 +0000 UTC m=+22.735231430"
Sep 07 21:02:06.509432 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.509387    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v85rk" podStartSLOduration=4.413890637 podStartE2EDuration="22.509371901s" totalImagesPullingTime="18.095481264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:06.492667818 +0000 UTC m=+22.752485082" watchObservedRunningTime="2026-09-07 21:02:06.509371901 +0000 UTC m=+22.769189183"
Sep 07 21:02:06.509668 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.509650    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n9n5j" podStartSLOduration=3.409285537 podStartE2EDuration="21.509643737s" totalImagesPullingTime="18.1003582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:06.509161247 +0000 UTC m=+22.768978491" watchObservedRunningTime="2026-09-07 21:02:06.509643737 +0000 UTC m=+22.769460980"
Sep 07 21:02:06.825860 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:06.825825    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 07 21:02:07.212070 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:07.211963    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T21:02:06.82584645Z","UUID":"feb74047-14ed-494f-89e5-dad83dd66724","Handler":null,"Name":"","Endpoint":""}
Sep 07 21:02:07.213788 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:07.213765    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 07 21:02:07.213915 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:07.213802    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 07 21:02:07.427324 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:07.427189    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6" event={"ID":"8c408a63-b108-4aa8-9ab4-ee0470087616","Type":"ContainerStarted","Data":"0f232077648ad531b10c133b550e7e651fa5ecdfd9cb447ade1d3a4eb18359b6"}
Sep 07 21:02:07.428998 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:07.428967    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-htq6b" event={"ID":"80a1f3da-f0d8-4428-b7d5-d62035a3015b","Type":"ContainerStarted","Data":"8dc457cc8ef1a2bfa532ae469e9538217835e71bbcca67da629a6cb8bae9ca10"}
Sep 07 21:02:07.443562 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:07.443518    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-htq6b" podStartSLOduration=4.341663601 podStartE2EDuration="22.443500535s" totalImagesPullingTime="18.101836934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:07.442983801 +0000 UTC m=+23.702801057" watchObservedRunningTime="2026-09-07 21:02:07.443500535 +0000 UTC m=+23.703317779"
Sep 07 21:02:08.303114 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:08.303078    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:02:08.303224 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:08.303083    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:02:08.303224 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:08.303204    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwdbk" podUID="48ada37c-2a5c-47cd-8fa4-986e554a7288"
Sep 07 21:02:08.303340 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:08.303204    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:02:08.303340 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:08.303294    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67mj7" podUID="0439cb5a-ba34-4a77-9469-f790e6d37dbc"
Sep 07 21:02:08.303422 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:08.303399    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-59tw4" podUID="fe0c1618-8f48-4a50-8791-83c8e388f13d"
Sep 07 21:02:08.433771 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:08.433729    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6" event={"ID":"8c408a63-b108-4aa8-9ab4-ee0470087616","Type":"ContainerStarted","Data":"89c22e7a420bf76b4ec4f3b5d8944da2ebf09b303cfe2291ee59d55fe8f6e838"}
Sep 07 21:02:08.438126 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:08.438097    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l" event={"ID":"bda5f620-4586-4b21-8caf-fe98b649e93c","Type":"ContainerStarted","Data":"0646cb899660926ee61e161c95621ff531142b3ed8ec025fea87f8338aa0a473"}
Sep 07 21:02:08.451850 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:08.451804    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ztk6" podStartSLOduration=3.2409848820000002 podStartE2EDuration="23.451785623s" totalImagesPullingTime="20.210800741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:01:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:08.451130087 +0000 UTC m=+24.710947353" watchObservedRunningTime="2026-09-07 21:02:08.451785623 +0000 UTC m=+24.711602891"
Sep 07 21:02:10.302483 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:10.302445    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:02:10.303025 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:10.302445    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:02:10.303025 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:10.302578    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwdbk" podUID="48ada37c-2a5c-47cd-8fa4-986e554a7288"
Sep 07 21:02:10.303025 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:10.302445    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:02:10.303025 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:10.302625    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-59tw4" podUID="fe0c1618-8f48-4a50-8791-83c8e388f13d"
Sep 07 21:02:10.303025 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:10.302749    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67mj7" podUID="0439cb5a-ba34-4a77-9469-f790e6d37dbc"
Sep 07 21:02:10.847069 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:10.846905    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lpqw2"
Sep 07 21:02:10.847766 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:10.847749    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lpqw2"
Sep 07 21:02:11.450515 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:11.450478    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l" event={"ID":"bda5f620-4586-4b21-8caf-fe98b649e93c","Type":"ContainerStarted","Data":"d0c674cc71581c877654093d4bdeb444e62bc4862ec9997e1d34bb7529ecc952"}
Sep 07 21:02:11.451344 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:11.450867    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:02:11.452719 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:11.452694    2558 generic.go:356] "Generic (PLEG): container finished" podID="49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5" containerID="5eda068e2a58480e56919e56b6779f22012663f865af978a25ebe1975346c4c8" exitCode=0
Sep 07 21:02:11.452840 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:11.452780    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xgnwf" event={"ID":"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5","Type":"ContainerDied","Data":"5eda068e2a58480e56919e56b6779f22012663f865af978a25ebe1975346c4c8"}
Sep 07 21:02:11.452898 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:11.452873    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lpqw2"
Sep 07 21:02:11.453859 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:11.453369    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lpqw2"
Sep 07 21:02:11.466093 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:11.466076    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:02:11.480162 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:11.480125    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l" podStartSLOduration=9.334472623 podStartE2EDuration="27.480112446s" totalImagesPullingTime="18.145639823s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:11.479169228 +0000 UTC m=+27.738986481" watchObservedRunningTime="2026-09-07 21:02:11.480112446 +0000 UTC m=+27.739929688"
Sep 07 21:02:12.302619 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:12.302397    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:02:12.302741 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:12.302401    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:02:12.302801 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:12.302731    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-59tw4" podUID="fe0c1618-8f48-4a50-8791-83c8e388f13d"
Sep 07 21:02:12.302801 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:12.302453    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:02:12.302801 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:12.302767    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwdbk" podUID="48ada37c-2a5c-47cd-8fa4-986e554a7288"
Sep 07 21:02:12.302961 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:12.302873    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67mj7" podUID="0439cb5a-ba34-4a77-9469-f790e6d37dbc"
Sep 07 21:02:12.410204 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:12.410177    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-59tw4"]
Sep 07 21:02:12.413511 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:12.413487    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-67mj7"]
Sep 07 21:02:12.414056 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:12.414034    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rwdbk"]
Sep 07 21:02:12.459522 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:12.459406    2558 generic.go:356] "Generic (PLEG): container finished" podID="49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5" containerID="2008a7a6bbf7583b1519058f8601bd0e279a6ac1a9592efbfd2ab70883e0eb4e" exitCode=0
Sep 07 21:02:12.459522 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:12.459494    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xgnwf" event={"ID":"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5","Type":"ContainerDied","Data":"2008a7a6bbf7583b1519058f8601bd0e279a6ac1a9592efbfd2ab70883e0eb4e"}
Sep 07 21:02:12.460099 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:12.459758    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:02:12.460099 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:12.459842    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-59tw4" podUID="fe0c1618-8f48-4a50-8791-83c8e388f13d"
Sep 07 21:02:12.460099 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:12.459860    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:02:12.460099 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:12.459967    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67mj7" podUID="0439cb5a-ba34-4a77-9469-f790e6d37dbc"
Sep 07 21:02:12.460099 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:12.459987    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:02:12.460099 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:12.460062    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwdbk" podUID="48ada37c-2a5c-47cd-8fa4-986e554a7288"
Sep 07 21:02:12.461031 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:12.460492    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:02:12.461031 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:12.460543    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:02:12.475926 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:12.475901    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:02:13.463934 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:13.463849    2558 generic.go:356] "Generic (PLEG): container finished" podID="49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5" containerID="90351ef4674d6048fe33e298e410d64369dccce6d773fd1d25715c7053947f48" exitCode=0
Sep 07 21:02:13.463934 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:13.463906    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xgnwf" event={"ID":"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5","Type":"ContainerDied","Data":"90351ef4674d6048fe33e298e410d64369dccce6d773fd1d25715c7053947f48"}
Sep 07 21:02:14.304091 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:14.304060    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:02:14.304260 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:14.304154    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:02:14.304260 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:14.304169    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwdbk" podUID="48ada37c-2a5c-47cd-8fa4-986e554a7288"
Sep 07 21:02:14.304260 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:14.304219    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:02:14.304436 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:14.304327    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-59tw4" podUID="fe0c1618-8f48-4a50-8791-83c8e388f13d"
Sep 07 21:02:14.304436 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:14.304400    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67mj7" podUID="0439cb5a-ba34-4a77-9469-f790e6d37dbc"
Sep 07 21:02:16.303102 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:16.303067    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:02:16.303581 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:16.303068    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:02:16.303581 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:16.303202    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwdbk" podUID="48ada37c-2a5c-47cd-8fa4-986e554a7288"
Sep 07 21:02:16.303581 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:16.303067    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:02:16.303581 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:16.303286    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67mj7" podUID="0439cb5a-ba34-4a77-9469-f790e6d37dbc"
Sep 07 21:02:16.303581 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:16.303363    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-59tw4" podUID="fe0c1618-8f48-4a50-8791-83c8e388f13d"
Sep 07 21:02:17.988784 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:17.988612    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret\") pod \"global-pull-secret-syncer-59tw4\" (UID: \"fe0c1618-8f48-4a50-8791-83c8e388f13d\") " pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:02:17.989138 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:17.988803    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs\") pod \"network-metrics-daemon-67mj7\" (UID: \"0439cb5a-ba34-4a77-9469-f790e6d37dbc\") " pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:02:17.989138 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:17.988738    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 21:02:17.989138 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:17.988883    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:02:17.989138 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:17.988907    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret podName:fe0c1618-8f48-4a50-8791-83c8e388f13d nodeName:}" failed. No retries permitted until 2026-09-07 21:02:49.988890447 +0000 UTC m=+66.248707688 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret") pod "global-pull-secret-syncer-59tw4" (UID: "fe0c1618-8f48-4a50-8791-83c8e388f13d") : object "kube-system"/"original-pull-secret" not registered
Sep 07 21:02:17.989138 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:17.988923    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs podName:0439cb5a-ba34-4a77-9469-f790e6d37dbc nodeName:}" failed. No retries permitted until 2026-09-07 21:02:49.988915972 +0000 UTC m=+66.248733193 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs") pod "network-metrics-daemon-67mj7" (UID: "0439cb5a-ba34-4a77-9469-f790e6d37dbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:02:18.089929 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:18.089860    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lq4q\" (UniqueName: \"kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q\") pod \"network-check-target-rwdbk\" (UID: \"48ada37c-2a5c-47cd-8fa4-986e554a7288\") " pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:02:18.090050 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:18.090017    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 21:02:18.090050 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:18.090034    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 21:02:18.090050 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:18.090043    2558 projected.go:196] Error preparing data for projected volume kube-api-access-6lq4q for pod openshift-network-diagnostics/network-check-target-rwdbk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:02:18.090143 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:18.090094    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q podName:48ada37c-2a5c-47cd-8fa4-986e554a7288 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:50.090078383 +0000 UTC m=+66.349895605 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6lq4q" (UniqueName: "kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q") pod "network-check-target-rwdbk" (UID: "48ada37c-2a5c-47cd-8fa4-986e554a7288") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:02:18.303284 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:18.303253    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:02:18.303444 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:18.303254    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:02:18.303444 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:18.303403    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-67mj7" podUID="0439cb5a-ba34-4a77-9469-f790e6d37dbc"
Sep 07 21:02:18.303444 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:18.303435    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:02:18.303548 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:18.303527    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-59tw4" podUID="fe0c1618-8f48-4a50-8791-83c8e388f13d"
Sep 07 21:02:18.303640 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:18.303590    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwdbk" podUID="48ada37c-2a5c-47cd-8fa4-986e554a7288"
Sep 07 21:02:18.479340 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:18.479242    2558 generic.go:356] "Generic (PLEG): container finished" podID="49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5" containerID="a61c9d46c181631d72a8b7428339e77a700233007dec8414f2e5b826b12a9614" exitCode=0
Sep 07 21:02:18.479340 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:18.479290    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xgnwf" event={"ID":"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5","Type":"ContainerDied","Data":"a61c9d46c181631d72a8b7428339e77a700233007dec8414f2e5b826b12a9614"}
Sep 07 21:02:19.059365 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.059333    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeReady"
Sep 07 21:02:19.059744 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.059464    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 07 21:02:19.110471 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.110442    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rzj7z"]
Sep 07 21:02:19.125018 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.124992    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xpdlp"]
Sep 07 21:02:19.125180 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.125128    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:02:19.127628 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.127602    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 07 21:02:19.127747 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.127641    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 07 21:02:19.127747 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.127642    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7njqf\""
Sep 07 21:02:19.139015 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.138993    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rzj7z"]
Sep 07 21:02:19.139117 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.139026    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xpdlp"]
Sep 07 21:02:19.139117 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.139092    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xpdlp"
Sep 07 21:02:19.141589 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.141538    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 07 21:02:19.141700 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.141556    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 07 21:02:19.141700 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.141600    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 07 21:02:19.141902 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.141888    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jrq2d\""
Sep 07 21:02:19.198238 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.198198    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-config-volume\") pod \"dns-default-rzj7z\" (UID: \"fbff6cc7-efb5-42e9-939f-df51e82cdfb4\") " pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:02:19.198238 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.198244    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzz42\" (UniqueName: \"kubernetes.io/projected/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-kube-api-access-pzz42\") pod \"dns-default-rzj7z\" (UID: \"fbff6cc7-efb5-42e9-939f-df51e82cdfb4\") " pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:02:19.198488 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.198327    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-tmp-dir\") pod \"dns-default-rzj7z\" (UID: \"fbff6cc7-efb5-42e9-939f-df51e82cdfb4\") " pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:02:19.198488 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.198360    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls\") pod \"dns-default-rzj7z\" (UID: \"fbff6cc7-efb5-42e9-939f-df51e82cdfb4\") " pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:02:19.299023 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.298986    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-config-volume\") pod \"dns-default-rzj7z\" (UID: \"fbff6cc7-efb5-42e9-939f-df51e82cdfb4\") " pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:02:19.299023 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.299022    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzz42\" (UniqueName: \"kubernetes.io/projected/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-kube-api-access-pzz42\") pod \"dns-default-rzj7z\" (UID: \"fbff6cc7-efb5-42e9-939f-df51e82cdfb4\") " pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:02:19.299239 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.299059    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4p8q\" (UniqueName: \"kubernetes.io/projected/f76762af-86f7-4a30-8dc8-020c23a07d5c-kube-api-access-j4p8q\") pod \"ingress-canary-xpdlp\" (UID: \"f76762af-86f7-4a30-8dc8-020c23a07d5c\") " pod="openshift-ingress-canary/ingress-canary-xpdlp"
Sep 07 21:02:19.299239 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.299143    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-tmp-dir\") pod \"dns-default-rzj7z\" (UID: \"fbff6cc7-efb5-42e9-939f-df51e82cdfb4\") " pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:02:19.299239 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.299189    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls\") pod \"dns-default-rzj7z\" (UID: \"fbff6cc7-efb5-42e9-939f-df51e82cdfb4\") " pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:02:19.299406 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.299246    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f76762af-86f7-4a30-8dc8-020c23a07d5c-cert\") pod \"ingress-canary-xpdlp\" (UID: \"f76762af-86f7-4a30-8dc8-020c23a07d5c\") " pod="openshift-ingress-canary/ingress-canary-xpdlp"
Sep 07 21:02:19.299406 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:19.299363    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 21:02:19.299488 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:19.299421    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls podName:fbff6cc7-efb5-42e9-939f-df51e82cdfb4 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:19.799403529 +0000 UTC m=+36.059220770 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls") pod "dns-default-rzj7z" (UID: "fbff6cc7-efb5-42e9-939f-df51e82cdfb4") : secret "dns-default-metrics-tls" not found
Sep 07 21:02:19.299488 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.299446    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-tmp-dir\") pod \"dns-default-rzj7z\" (UID: \"fbff6cc7-efb5-42e9-939f-df51e82cdfb4\") " pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:02:19.299596 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.299580    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-config-volume\") pod \"dns-default-rzj7z\" (UID: \"fbff6cc7-efb5-42e9-939f-df51e82cdfb4\") " pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:02:19.309613 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.309594    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzz42\" (UniqueName: \"kubernetes.io/projected/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-kube-api-access-pzz42\") pod \"dns-default-rzj7z\" (UID: \"fbff6cc7-efb5-42e9-939f-df51e82cdfb4\") " pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:02:19.399740 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.399656    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f76762af-86f7-4a30-8dc8-020c23a07d5c-cert\") pod \"ingress-canary-xpdlp\" (UID: \"f76762af-86f7-4a30-8dc8-020c23a07d5c\") " pod="openshift-ingress-canary/ingress-canary-xpdlp"
Sep 07 21:02:19.399740 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.399726    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4p8q\" (UniqueName: \"kubernetes.io/projected/f76762af-86f7-4a30-8dc8-020c23a07d5c-kube-api-access-j4p8q\") pod \"ingress-canary-xpdlp\" (UID: \"f76762af-86f7-4a30-8dc8-020c23a07d5c\") " pod="openshift-ingress-canary/ingress-canary-xpdlp"
Sep 07 21:02:19.402179 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.402157    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f76762af-86f7-4a30-8dc8-020c23a07d5c-cert\") pod \"ingress-canary-xpdlp\" (UID: \"f76762af-86f7-4a30-8dc8-020c23a07d5c\") " pod="openshift-ingress-canary/ingress-canary-xpdlp"
Sep 07 21:02:19.407769 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.407740    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4p8q\" (UniqueName: \"kubernetes.io/projected/f76762af-86f7-4a30-8dc8-020c23a07d5c-kube-api-access-j4p8q\") pod \"ingress-canary-xpdlp\" (UID: \"f76762af-86f7-4a30-8dc8-020c23a07d5c\") " pod="openshift-ingress-canary/ingress-canary-xpdlp"
Sep 07 21:02:19.447364 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.447335    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xpdlp"
Sep 07 21:02:19.485587 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.485559    2558 generic.go:356] "Generic (PLEG): container finished" podID="49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5" containerID="6b78c4438de0849e4ed67e0e1e6ab51b76ad053324d057291e77acbe28c8b6f8" exitCode=0
Sep 07 21:02:19.485678 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.485605    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xgnwf" event={"ID":"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5","Type":"ContainerDied","Data":"6b78c4438de0849e4ed67e0e1e6ab51b76ad053324d057291e77acbe28c8b6f8"}
Sep 07 21:02:19.776624 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.775849    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xpdlp"]
Sep 07 21:02:19.780885 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:02:19.780854    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf76762af_86f7_4a30_8dc8_020c23a07d5c.slice/crio-144d06f7c724fdaad2952f41d2df1b3826ceeb211bda232f462af17161acc1ea WatchSource:0}: Error finding container 144d06f7c724fdaad2952f41d2df1b3826ceeb211bda232f462af17161acc1ea: Status 404 returned error can't find the container with id 144d06f7c724fdaad2952f41d2df1b3826ceeb211bda232f462af17161acc1ea
Sep 07 21:02:19.802590 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:19.802565    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls\") pod \"dns-default-rzj7z\" (UID: \"fbff6cc7-efb5-42e9-939f-df51e82cdfb4\") " pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:02:19.802736 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:19.802716    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 21:02:19.802811 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:19.802781    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls podName:fbff6cc7-efb5-42e9-939f-df51e82cdfb4 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:20.802763796 +0000 UTC m=+37.062581039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls") pod "dns-default-rzj7z" (UID: "fbff6cc7-efb5-42e9-939f-df51e82cdfb4") : secret "dns-default-metrics-tls" not found
Sep 07 21:02:20.302985 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:20.302951    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:02:20.303818 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:20.302951    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:02:20.303818 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:20.302951    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:02:20.305804 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:20.305707    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 21:02:20.306056 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:20.306040    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 21:02:20.306141 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:20.306057    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9r8wd\""
Sep 07 21:02:20.306141 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:20.306057    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xs9mt\""
Sep 07 21:02:20.306454 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:20.306437    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 21:02:20.306626 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:20.306608    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 21:02:20.489514 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:20.489475    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xpdlp" event={"ID":"f76762af-86f7-4a30-8dc8-020c23a07d5c","Type":"ContainerStarted","Data":"144d06f7c724fdaad2952f41d2df1b3826ceeb211bda232f462af17161acc1ea"}
Sep 07 21:02:20.492698 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:20.492670    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xgnwf" event={"ID":"49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5","Type":"ContainerStarted","Data":"975e5273b12750726d05180244a182437a3b11e522210ba046fc63186ce584a1"}
Sep 07 21:02:20.514035 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:20.513977    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xgnwf" podStartSLOduration=7.416765516 podStartE2EDuration="35.51395717s" totalImagesPullingTime="28.097191654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:01:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:20.5127954 +0000 UTC m=+36.772612672" watchObservedRunningTime="2026-09-07 21:02:20.51395717 +0000 UTC m=+36.773774412"
Sep 07 21:02:20.808762 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:20.808728    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls\") pod \"dns-default-rzj7z\" (UID: \"fbff6cc7-efb5-42e9-939f-df51e82cdfb4\") " pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:02:20.808911 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:20.808891    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 21:02:20.808984 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:20.808974    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls podName:fbff6cc7-efb5-42e9-939f-df51e82cdfb4 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:22.808953276 +0000 UTC m=+39.068770502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls") pod "dns-default-rzj7z" (UID: "fbff6cc7-efb5-42e9-939f-df51e82cdfb4") : secret "dns-default-metrics-tls" not found
Sep 07 21:02:22.500857 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:22.500829    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xpdlp" event={"ID":"f76762af-86f7-4a30-8dc8-020c23a07d5c","Type":"ContainerStarted","Data":"1aa77b81ac634f4c72c8a24ac48f69aeb005c0a149f7c265d932ddecf4a8ac0e"}
Sep 07 21:02:22.517094 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:22.517048    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xpdlp" podStartSLOduration=0.969735722 podStartE2EDuration="3.517033555s" totalImagesPullingTime="2.547297833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:22.516467999 +0000 UTC m=+38.776285268" watchObservedRunningTime="2026-09-07 21:02:22.517033555 +0000 UTC m=+38.776850798"
Sep 07 21:02:22.827324 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:22.827275    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls\") pod \"dns-default-rzj7z\" (UID: \"fbff6cc7-efb5-42e9-939f-df51e82cdfb4\") " pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:02:22.827474 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:22.827426    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 21:02:22.827515 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:22.827489    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls podName:fbff6cc7-efb5-42e9-939f-df51e82cdfb4 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:26.827472776 +0000 UTC m=+43.087290017 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls") pod "dns-default-rzj7z" (UID: "fbff6cc7-efb5-42e9-939f-df51e82cdfb4") : secret "dns-default-metrics-tls" not found
Sep 07 21:02:26.853061 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:26.852868    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls\") pod \"dns-default-rzj7z\" (UID: \"fbff6cc7-efb5-42e9-939f-df51e82cdfb4\") " pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:02:26.853061 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:26.853058    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 21:02:26.853506 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:26.853126    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls podName:fbff6cc7-efb5-42e9-939f-df51e82cdfb4 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:34.853110203 +0000 UTC m=+51.112927423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls") pod "dns-default-rzj7z" (UID: "fbff6cc7-efb5-42e9-939f-df51e82cdfb4") : secret "dns-default-metrics-tls" not found
Sep 07 21:02:34.905580 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:34.905545    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls\") pod \"dns-default-rzj7z\" (UID: \"fbff6cc7-efb5-42e9-939f-df51e82cdfb4\") " pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:02:34.906004 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:34.905693    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 21:02:34.906004 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:34.905759    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls podName:fbff6cc7-efb5-42e9-939f-df51e82cdfb4 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:50.905739427 +0000 UTC m=+67.165556653 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls") pod "dns-default-rzj7z" (UID: "fbff6cc7-efb5-42e9-939f-df51e82cdfb4") : secret "dns-default-metrics-tls" not found
Sep 07 21:02:40.370735 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.370701    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-kv96r"]
Sep 07 21:02:40.372447 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.372432    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-kv96r"
Sep 07 21:02:40.375252 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.375225    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 07 21:02:40.375421 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.375233    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 07 21:02:40.376077 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.376056    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 07 21:02:40.376688 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.376673    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 07 21:02:40.377473 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.377453    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-q2sxb\""
Sep 07 21:02:40.379930 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.379913    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 07 21:02:40.396675 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.396648    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-kv96r"]
Sep 07 21:02:40.407586 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.407563    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cltp8"]
Sep 07 21:02:40.409386 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.409371    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cltp8"
Sep 07 21:02:40.413951 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.413928    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8mz9z\""
Sep 07 21:02:40.414127 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.414002    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 07 21:02:40.414127 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.414006    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 07 21:02:40.424232 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.424206    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cltp8"]
Sep 07 21:02:40.471303 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.471275    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v"]
Sep 07 21:02:40.473225 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.473199    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v"
Sep 07 21:02:40.475536 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.475504    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-27hsx"]
Sep 07 21:02:40.476440 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.476415    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 07 21:02:40.476654 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.476567    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 07 21:02:40.476654 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.476604    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 07 21:02:40.476781 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.476683    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 07 21:02:40.476884 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.476871    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nbsvm\""
Sep 07 21:02:40.478488 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.478470    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cf6fc866f-dvd6b"]
Sep 07 21:02:40.478636 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.478621    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-27hsx"
Sep 07 21:02:40.481450 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.481429    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 07 21:02:40.481685 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.481668    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 07 21:02:40.481772 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.481700    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 07 21:02:40.482435 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.482420    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 07 21:02:40.482524 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.482470    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.483286 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.483270    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ts4px\""
Sep 07 21:02:40.485483 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.485466    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 07 21:02:40.485600 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.485556    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 07 21:02:40.485682 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.485624    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tqps2\""
Sep 07 21:02:40.485872 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.485859    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 07 21:02:40.489206 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.489183    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v"]
Sep 07 21:02:40.490450 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.490426    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 07 21:02:40.492470 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.492450    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-27hsx"]
Sep 07 21:02:40.500077 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.500031    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cf6fc866f-dvd6b"]
Sep 07 21:02:40.544091 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.544064    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d804af86-d937-4ea6-afb8-760911a10437-config\") pod \"console-operator-85b454874b-kv96r\" (UID: \"d804af86-d937-4ea6-afb8-760911a10437\") " pod="openshift-console-operator/console-operator-85b454874b-kv96r"
Sep 07 21:02:40.544214 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.544104    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d804af86-d937-4ea6-afb8-760911a10437-serving-cert\") pod \"console-operator-85b454874b-kv96r\" (UID: \"d804af86-d937-4ea6-afb8-760911a10437\") " pod="openshift-console-operator/console-operator-85b454874b-kv96r"
Sep 07 21:02:40.544214 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.544128    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d804af86-d937-4ea6-afb8-760911a10437-trusted-ca\") pod \"console-operator-85b454874b-kv96r\" (UID: \"d804af86-d937-4ea6-afb8-760911a10437\") " pod="openshift-console-operator/console-operator-85b454874b-kv96r"
Sep 07 21:02:40.544214 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.544180    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgsjx\" (UniqueName: \"kubernetes.io/projected/d804af86-d937-4ea6-afb8-760911a10437-kube-api-access-wgsjx\") pod \"console-operator-85b454874b-kv96r\" (UID: \"d804af86-d937-4ea6-afb8-760911a10437\") " pod="openshift-console-operator/console-operator-85b454874b-kv96r"
Sep 07 21:02:40.544333 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.544237    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7d6c\" (UniqueName: \"kubernetes.io/projected/2ef590f6-875d-4b00-84fb-4a7457ba3c78-kube-api-access-w7d6c\") pod \"volume-data-source-validator-695c895bd6-cltp8\" (UID: \"2ef590f6-875d-4b00-84fb-4a7457ba3c78\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cltp8"
Sep 07 21:02:40.644977 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.644895    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e824446c-20c4-4d8f-8dfe-5a9717499244-serving-cert\") pod \"service-ca-operator-859f94c4b-27hsx\" (UID: \"e824446c-20c4-4d8f-8dfe-5a9717499244\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-27hsx"
Sep 07 21:02:40.644977 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.644952    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bf1661df-8943-467e-9020-96dba273cc49-installation-pull-secrets\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.645170 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.644990    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-k6n9v\" (UID: \"bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v"
Sep 07 21:02:40.645170 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.645009    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e824446c-20c4-4d8f-8dfe-5a9717499244-config\") pod \"service-ca-operator-859f94c4b-27hsx\" (UID: \"e824446c-20c4-4d8f-8dfe-5a9717499244\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-27hsx"
Sep 07 21:02:40.645170 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.645030    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-bound-sa-token\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.645170 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.645127    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d804af86-d937-4ea6-afb8-760911a10437-config\") pod \"console-operator-85b454874b-kv96r\" (UID: \"d804af86-d937-4ea6-afb8-760911a10437\") " pod="openshift-console-operator/console-operator-85b454874b-kv96r"
Sep 07 21:02:40.645344 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.645170    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bf1661df-8943-467e-9020-96dba273cc49-image-registry-private-configuration\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.645344 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.645188    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-k6n9v\" (UID: \"bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v"
Sep 07 21:02:40.645344 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.645206    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-776km\" (UniqueName: \"kubernetes.io/projected/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-kube-api-access-776km\") pod \"cluster-monitoring-operator-6cdcc96965-k6n9v\" (UID: \"bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v"
Sep 07 21:02:40.645344 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.645286    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d804af86-d937-4ea6-afb8-760911a10437-serving-cert\") pod \"console-operator-85b454874b-kv96r\" (UID: \"d804af86-d937-4ea6-afb8-760911a10437\") " pod="openshift-console-operator/console-operator-85b454874b-kv96r"
Sep 07 21:02:40.645344 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.645327    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d804af86-d937-4ea6-afb8-760911a10437-trusted-ca\") pod \"console-operator-85b454874b-kv96r\" (UID: \"d804af86-d937-4ea6-afb8-760911a10437\") " pod="openshift-console-operator/console-operator-85b454874b-kv96r"
Sep 07 21:02:40.645526 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.645357    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgsjx\" (UniqueName: \"kubernetes.io/projected/d804af86-d937-4ea6-afb8-760911a10437-kube-api-access-wgsjx\") pod \"console-operator-85b454874b-kv96r\" (UID: \"d804af86-d937-4ea6-afb8-760911a10437\") " pod="openshift-console-operator/console-operator-85b454874b-kv96r"
Sep 07 21:02:40.645526 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.645385    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bf1661df-8943-467e-9020-96dba273cc49-ca-trust-extracted\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.645526 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.645418    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd7z5\" (UniqueName: \"kubernetes.io/projected/e824446c-20c4-4d8f-8dfe-5a9717499244-kube-api-access-hd7z5\") pod \"service-ca-operator-859f94c4b-27hsx\" (UID: \"e824446c-20c4-4d8f-8dfe-5a9717499244\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-27hsx"
Sep 07 21:02:40.645642 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.645548    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5ccj\" (UniqueName: \"kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-kube-api-access-w5ccj\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.645642 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.645598    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7d6c\" (UniqueName: \"kubernetes.io/projected/2ef590f6-875d-4b00-84fb-4a7457ba3c78-kube-api-access-w7d6c\") pod \"volume-data-source-validator-695c895bd6-cltp8\" (UID: \"2ef590f6-875d-4b00-84fb-4a7457ba3c78\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cltp8"
Sep 07 21:02:40.645642 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.645624    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-registry-tls\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.645779 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.645647    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bf1661df-8943-467e-9020-96dba273cc49-registry-certificates\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.645779 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.645685    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf1661df-8943-467e-9020-96dba273cc49-trusted-ca\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.645913 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.645891    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d804af86-d937-4ea6-afb8-760911a10437-config\") pod \"console-operator-85b454874b-kv96r\" (UID: \"d804af86-d937-4ea6-afb8-760911a10437\") " pod="openshift-console-operator/console-operator-85b454874b-kv96r"
Sep 07 21:02:40.646080 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.646064    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d804af86-d937-4ea6-afb8-760911a10437-trusted-ca\") pod \"console-operator-85b454874b-kv96r\" (UID: \"d804af86-d937-4ea6-afb8-760911a10437\") " pod="openshift-console-operator/console-operator-85b454874b-kv96r"
Sep 07 21:02:40.649065 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.649048    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d804af86-d937-4ea6-afb8-760911a10437-serving-cert\") pod \"console-operator-85b454874b-kv96r\" (UID: \"d804af86-d937-4ea6-afb8-760911a10437\") " pod="openshift-console-operator/console-operator-85b454874b-kv96r"
Sep 07 21:02:40.655908 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.655888    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7d6c\" (UniqueName: \"kubernetes.io/projected/2ef590f6-875d-4b00-84fb-4a7457ba3c78-kube-api-access-w7d6c\") pod \"volume-data-source-validator-695c895bd6-cltp8\" (UID: \"2ef590f6-875d-4b00-84fb-4a7457ba3c78\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cltp8"
Sep 07 21:02:40.656950 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.656930    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgsjx\" (UniqueName: \"kubernetes.io/projected/d804af86-d937-4ea6-afb8-760911a10437-kube-api-access-wgsjx\") pod \"console-operator-85b454874b-kv96r\" (UID: \"d804af86-d937-4ea6-afb8-760911a10437\") " pod="openshift-console-operator/console-operator-85b454874b-kv96r"
Sep 07 21:02:40.681899 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.681867    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-kv96r"
Sep 07 21:02:40.720979 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.720939    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cltp8"
Sep 07 21:02:40.746232 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.746138    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e824446c-20c4-4d8f-8dfe-5a9717499244-config\") pod \"service-ca-operator-859f94c4b-27hsx\" (UID: \"e824446c-20c4-4d8f-8dfe-5a9717499244\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-27hsx"
Sep 07 21:02:40.746232 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.746185    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-bound-sa-token\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.746450 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.746265    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bf1661df-8943-467e-9020-96dba273cc49-image-registry-private-configuration\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.746450 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.746291    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-k6n9v\" (UID: \"bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v"
Sep 07 21:02:40.746450 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.746338    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-776km\" (UniqueName: \"kubernetes.io/projected/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-kube-api-access-776km\") pod \"cluster-monitoring-operator-6cdcc96965-k6n9v\" (UID: \"bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v"
Sep 07 21:02:40.746450 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.746365    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bf1661df-8943-467e-9020-96dba273cc49-ca-trust-extracted\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.746450 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.746399    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd7z5\" (UniqueName: \"kubernetes.io/projected/e824446c-20c4-4d8f-8dfe-5a9717499244-kube-api-access-hd7z5\") pod \"service-ca-operator-859f94c4b-27hsx\" (UID: \"e824446c-20c4-4d8f-8dfe-5a9717499244\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-27hsx"
Sep 07 21:02:40.746450 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.746421    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5ccj\" (UniqueName: \"kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-kube-api-access-w5ccj\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.746764 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.746464    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-registry-tls\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.746764 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.746491    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bf1661df-8943-467e-9020-96dba273cc49-registry-certificates\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.746764 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.746518    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf1661df-8943-467e-9020-96dba273cc49-trusted-ca\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.746764 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.746552    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e824446c-20c4-4d8f-8dfe-5a9717499244-serving-cert\") pod \"service-ca-operator-859f94c4b-27hsx\" (UID: \"e824446c-20c4-4d8f-8dfe-5a9717499244\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-27hsx"
Sep 07 21:02:40.746764 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.746591    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bf1661df-8943-467e-9020-96dba273cc49-installation-pull-secrets\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.746764 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.746615    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-k6n9v\" (UID: \"bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v"
Sep 07 21:02:40.747917 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.746845    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e824446c-20c4-4d8f-8dfe-5a9717499244-config\") pod \"service-ca-operator-859f94c4b-27hsx\" (UID: \"e824446c-20c4-4d8f-8dfe-5a9717499244\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-27hsx"
Sep 07 21:02:40.747917 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.747329    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-k6n9v\" (UID: \"bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v"
Sep 07 21:02:40.747917 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:40.747519    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 21:02:40.747917 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:40.747535    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cf6fc866f-dvd6b: secret "image-registry-tls" not found
Sep 07 21:02:40.747917 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:40.747590    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-registry-tls podName:bf1661df-8943-467e-9020-96dba273cc49 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:41.247571873 +0000 UTC m=+57.507389109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-registry-tls") pod "image-registry-6cf6fc866f-dvd6b" (UID: "bf1661df-8943-467e-9020-96dba273cc49") : secret "image-registry-tls" not found
Sep 07 21:02:40.748269 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:40.748200    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 07 21:02:40.748269 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.748249    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bf1661df-8943-467e-9020-96dba273cc49-registry-certificates\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.748418 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:40.748257    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-cluster-monitoring-operator-tls podName:bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b nodeName:}" failed. No retries permitted until 2026-09-07 21:02:41.248240275 +0000 UTC m=+57.508057510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-k6n9v" (UID: "bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b") : secret "cluster-monitoring-operator-tls" not found
Sep 07 21:02:40.748923 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.748894    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bf1661df-8943-467e-9020-96dba273cc49-ca-trust-extracted\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.749968 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.749948    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf1661df-8943-467e-9020-96dba273cc49-trusted-ca\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.750758 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.750700    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bf1661df-8943-467e-9020-96dba273cc49-image-registry-private-configuration\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.752549 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.752506    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bf1661df-8943-467e-9020-96dba273cc49-installation-pull-secrets\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.753142 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.753100    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e824446c-20c4-4d8f-8dfe-5a9717499244-serving-cert\") pod \"service-ca-operator-859f94c4b-27hsx\" (UID: \"e824446c-20c4-4d8f-8dfe-5a9717499244\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-27hsx"
Sep 07 21:02:40.758995 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.758819    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-776km\" (UniqueName: \"kubernetes.io/projected/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-kube-api-access-776km\") pod \"cluster-monitoring-operator-6cdcc96965-k6n9v\" (UID: \"bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v"
Sep 07 21:02:40.758995 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.758963    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-bound-sa-token\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.759275 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.759252    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd7z5\" (UniqueName: \"kubernetes.io/projected/e824446c-20c4-4d8f-8dfe-5a9717499244-kube-api-access-hd7z5\") pod \"service-ca-operator-859f94c4b-27hsx\" (UID: \"e824446c-20c4-4d8f-8dfe-5a9717499244\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-27hsx"
Sep 07 21:02:40.759679 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.759500    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5ccj\" (UniqueName: \"kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-kube-api-access-w5ccj\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:40.790118 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.790090    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-27hsx"
Sep 07 21:02:40.954152 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:40.954071    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-kv96r"]
Sep 07 21:02:40.958049 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:02:40.958029    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd804af86_d937_4ea6_afb8_760911a10437.slice/crio-d4e64315b3a8c23aa7064ab1ec10ce87e4383044a9d54d78f241bc2dd53df612 WatchSource:0}: Error finding container d4e64315b3a8c23aa7064ab1ec10ce87e4383044a9d54d78f241bc2dd53df612: Status 404 returned error can't find the container with id d4e64315b3a8c23aa7064ab1ec10ce87e4383044a9d54d78f241bc2dd53df612
Sep 07 21:02:41.002153 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:41.002137    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cltp8"]
Sep 07 21:02:41.004509 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:02:41.004483    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef590f6_875d_4b00_84fb_4a7457ba3c78.slice/crio-7fbf27a2eca59626e4d4b6b70b2dc8299a17c77de677bcea43f0f90a3b0ddadc WatchSource:0}: Error finding container 7fbf27a2eca59626e4d4b6b70b2dc8299a17c77de677bcea43f0f90a3b0ddadc: Status 404 returned error can't find the container with id 7fbf27a2eca59626e4d4b6b70b2dc8299a17c77de677bcea43f0f90a3b0ddadc
Sep 07 21:02:41.064466 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:41.064292    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-27hsx"]
Sep 07 21:02:41.067093 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:02:41.067066    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode824446c_20c4_4d8f_8dfe_5a9717499244.slice/crio-cc104e4137aa389d428b031e80bcfdbf70a9faf03a4e8a17632b21f2ebea4364 WatchSource:0}: Error finding container cc104e4137aa389d428b031e80bcfdbf70a9faf03a4e8a17632b21f2ebea4364: Status 404 returned error can't find the container with id cc104e4137aa389d428b031e80bcfdbf70a9faf03a4e8a17632b21f2ebea4364
Sep 07 21:02:41.252055 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:41.251959    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-k6n9v\" (UID: \"bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v"
Sep 07 21:02:41.252055 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:41.252028    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-registry-tls\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:41.252296 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:41.252123    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 07 21:02:41.252296 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:41.252158    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 21:02:41.252296 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:41.252173    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cf6fc866f-dvd6b: secret "image-registry-tls" not found
Sep 07 21:02:41.252296 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:41.252193    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-cluster-monitoring-operator-tls podName:bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b nodeName:}" failed. No retries permitted until 2026-09-07 21:02:42.252176362 +0000 UTC m=+58.511993583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-k6n9v" (UID: "bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b") : secret "cluster-monitoring-operator-tls" not found
Sep 07 21:02:41.252296 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:41.252218    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-registry-tls podName:bf1661df-8943-467e-9020-96dba273cc49 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:42.252203565 +0000 UTC m=+58.512020807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-registry-tls") pod "image-registry-6cf6fc866f-dvd6b" (UID: "bf1661df-8943-467e-9020-96dba273cc49") : secret "image-registry-tls" not found
Sep 07 21:02:41.545355 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:41.545254    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-27hsx" event={"ID":"e824446c-20c4-4d8f-8dfe-5a9717499244","Type":"ContainerStarted","Data":"cc104e4137aa389d428b031e80bcfdbf70a9faf03a4e8a17632b21f2ebea4364"}
Sep 07 21:02:41.546479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:41.546455    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-kv96r" event={"ID":"d804af86-d937-4ea6-afb8-760911a10437","Type":"ContainerStarted","Data":"d4e64315b3a8c23aa7064ab1ec10ce87e4383044a9d54d78f241bc2dd53df612"}
Sep 07 21:02:41.547556 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:41.547535    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cltp8" event={"ID":"2ef590f6-875d-4b00-84fb-4a7457ba3c78","Type":"ContainerStarted","Data":"7fbf27a2eca59626e4d4b6b70b2dc8299a17c77de677bcea43f0f90a3b0ddadc"}
Sep 07 21:02:42.261477 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:42.261432    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-k6n9v\" (UID: \"bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v"
Sep 07 21:02:42.261724 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:42.261515    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-registry-tls\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:42.261724 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:42.261605    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 07 21:02:42.261724 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:42.261642    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 21:02:42.261724 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:42.261664    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cf6fc866f-dvd6b: secret "image-registry-tls" not found
Sep 07 21:02:42.261724 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:42.261685    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-cluster-monitoring-operator-tls podName:bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b nodeName:}" failed. No retries permitted until 2026-09-07 21:02:44.261663059 +0000 UTC m=+60.521480296 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-k6n9v" (UID: "bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b") : secret "cluster-monitoring-operator-tls" not found
Sep 07 21:02:42.261724 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:42.261706    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-registry-tls podName:bf1661df-8943-467e-9020-96dba273cc49 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:44.261695192 +0000 UTC m=+60.521512435 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-registry-tls") pod "image-registry-6cf6fc866f-dvd6b" (UID: "bf1661df-8943-467e-9020-96dba273cc49") : secret "image-registry-tls" not found
Sep 07 21:02:43.725139 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:43.725059    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h564t"]
Sep 07 21:02:43.727752 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:43.727732    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:43.731103 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:43.730918    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 07 21:02:43.731103 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:43.730962    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 07 21:02:43.731103 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:43.730971    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 07 21:02:43.731103 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:43.731016    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vvs4x\""
Sep 07 21:02:43.731518 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:43.731493    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 07 21:02:43.742784 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:43.742764    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h564t"]
Sep 07 21:02:43.874357 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:43.874331    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df6a2659-d7a1-4e72-93ec-5445745ac38a-data-volume\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:43.874478 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:43.874401    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df6a2659-d7a1-4e72-93ec-5445745ac38a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:43.874478 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:43.874461    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr928\" (UniqueName: \"kubernetes.io/projected/df6a2659-d7a1-4e72-93ec-5445745ac38a-kube-api-access-kr928\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:43.874577 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:43.874551    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df6a2659-d7a1-4e72-93ec-5445745ac38a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:43.874615 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:43.874599    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df6a2659-d7a1-4e72-93ec-5445745ac38a-crio-socket\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:43.975228 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:43.975138    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df6a2659-d7a1-4e72-93ec-5445745ac38a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:43.975395 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:43.975233    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr928\" (UniqueName: \"kubernetes.io/projected/df6a2659-d7a1-4e72-93ec-5445745ac38a-kube-api-access-kr928\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:43.975395 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:43.975261    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 21:02:43.975395 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:43.975263    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df6a2659-d7a1-4e72-93ec-5445745ac38a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:43.975395 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:43.975358    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df6a2659-d7a1-4e72-93ec-5445745ac38a-kube-rbac-proxy-cm podName:df6a2659-d7a1-4e72-93ec-5445745ac38a nodeName:}" failed. No retries permitted until 2026-09-07 21:02:44.475336486 +0000 UTC m=+60.735153731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df6a2659-d7a1-4e72-93ec-5445745ac38a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h564t" (UID: "df6a2659-d7a1-4e72-93ec-5445745ac38a") : configmap "kube-rbac-proxy" not found
Sep 07 21:02:43.975395 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:43.975374    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:43.975395 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:43.975390    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df6a2659-d7a1-4e72-93ec-5445745ac38a-crio-socket\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:43.975621 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:43.975423    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df6a2659-d7a1-4e72-93ec-5445745ac38a-insights-runtime-extractor-tls podName:df6a2659-d7a1-4e72-93ec-5445745ac38a nodeName:}" failed. No retries permitted until 2026-09-07 21:02:44.475408119 +0000 UTC m=+60.735225342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df6a2659-d7a1-4e72-93ec-5445745ac38a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h564t" (UID: "df6a2659-d7a1-4e72-93ec-5445745ac38a") : secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:43.975621 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:43.975442    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df6a2659-d7a1-4e72-93ec-5445745ac38a-data-volume\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:43.975621 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:43.975463    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df6a2659-d7a1-4e72-93ec-5445745ac38a-crio-socket\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:43.975725 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:43.975704    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df6a2659-d7a1-4e72-93ec-5445745ac38a-data-volume\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:43.992293 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:43.992260    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr928\" (UniqueName: \"kubernetes.io/projected/df6a2659-d7a1-4e72-93ec-5445745ac38a-kube-api-access-kr928\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:44.278415 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:44.278293    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-k6n9v\" (UID: \"bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v"
Sep 07 21:02:44.278415 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:44.278389    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-registry-tls\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:44.278646 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:44.278465    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 07 21:02:44.278646 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:44.278500    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 21:02:44.278646 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:44.278513    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cf6fc866f-dvd6b: secret "image-registry-tls" not found
Sep 07 21:02:44.278646 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:44.278551    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-cluster-monitoring-operator-tls podName:bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b nodeName:}" failed. No retries permitted until 2026-09-07 21:02:48.27852941 +0000 UTC m=+64.538346649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-k6n9v" (UID: "bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b") : secret "cluster-monitoring-operator-tls" not found
Sep 07 21:02:44.278646 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:44.278571    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-registry-tls podName:bf1661df-8943-467e-9020-96dba273cc49 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:48.278561958 +0000 UTC m=+64.538379179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-registry-tls") pod "image-registry-6cf6fc866f-dvd6b" (UID: "bf1661df-8943-467e-9020-96dba273cc49") : secret "image-registry-tls" not found
Sep 07 21:02:44.477875 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:44.477849    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s6r7l"
Sep 07 21:02:44.480833 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:44.480811    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df6a2659-d7a1-4e72-93ec-5445745ac38a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:44.480930 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:44.480912    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 21:02:44.480976 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:44.480924    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df6a2659-d7a1-4e72-93ec-5445745ac38a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:44.480976 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:44.480970    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df6a2659-d7a1-4e72-93ec-5445745ac38a-kube-rbac-proxy-cm podName:df6a2659-d7a1-4e72-93ec-5445745ac38a nodeName:}" failed. No retries permitted until 2026-09-07 21:02:45.480955531 +0000 UTC m=+61.740772756 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df6a2659-d7a1-4e72-93ec-5445745ac38a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h564t" (UID: "df6a2659-d7a1-4e72-93ec-5445745ac38a") : configmap "kube-rbac-proxy" not found
Sep 07 21:02:44.481066 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:44.481051    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:44.481118 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:44.481108    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df6a2659-d7a1-4e72-93ec-5445745ac38a-insights-runtime-extractor-tls podName:df6a2659-d7a1-4e72-93ec-5445745ac38a nodeName:}" failed. No retries permitted until 2026-09-07 21:02:45.481090553 +0000 UTC m=+61.740907788 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df6a2659-d7a1-4e72-93ec-5445745ac38a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h564t" (UID: "df6a2659-d7a1-4e72-93ec-5445745ac38a") : secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:44.556704 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:44.556669    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cltp8" event={"ID":"2ef590f6-875d-4b00-84fb-4a7457ba3c78","Type":"ContainerStarted","Data":"db01598fe680de97c39442d29b3c96a2232adf9ed06a7b48abf3124bb819f1c2"}
Sep 07 21:02:44.558181 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:44.558153    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-27hsx" event={"ID":"e824446c-20c4-4d8f-8dfe-5a9717499244","Type":"ContainerStarted","Data":"ece7bbb9e0fd5253daf29d995cc3051912c52863dd3cd4fbda26ae7d37a09004"}
Sep 07 21:02:44.559643 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:44.559624    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-kv96r_d804af86-d937-4ea6-afb8-760911a10437/console-operator/0.log"
Sep 07 21:02:44.559741 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:44.559657    2558 generic.go:356] "Generic (PLEG): container finished" podID="d804af86-d937-4ea6-afb8-760911a10437" containerID="afb73223e6d8246941d3b88868c7f0ab9204c0902e91fa4a8450f0939d21c16b" exitCode=255
Sep 07 21:02:44.559741 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:44.559685    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-kv96r" event={"ID":"d804af86-d937-4ea6-afb8-760911a10437","Type":"ContainerDied","Data":"afb73223e6d8246941d3b88868c7f0ab9204c0902e91fa4a8450f0939d21c16b"}
Sep 07 21:02:44.559900 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:44.559884    2558 scope.go:117] "RemoveContainer" containerID="afb73223e6d8246941d3b88868c7f0ab9204c0902e91fa4a8450f0939d21c16b"
Sep 07 21:02:44.572987 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:44.572950    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-cltp8" podStartSLOduration=1.859483699 podStartE2EDuration="4.57293798s" totalImagesPullingTime="2.713454281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:44.572028139 +0000 UTC m=+60.831845406" watchObservedRunningTime="2026-09-07 21:02:44.57293798 +0000 UTC m=+60.832755222"
Sep 07 21:02:44.603769 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:44.603726    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-27hsx" podStartSLOduration=1.944101101 podStartE2EDuration="4.603706777s" totalImagesPullingTime="2.659605676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:44.603228048 +0000 UTC m=+60.863045293" watchObservedRunningTime="2026-09-07 21:02:44.603706777 +0000 UTC m=+60.863524022"
Sep 07 21:02:45.490146 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:45.490111    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df6a2659-d7a1-4e72-93ec-5445745ac38a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:45.490675 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:45.490190    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df6a2659-d7a1-4e72-93ec-5445745ac38a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:45.490675 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:45.490253    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 21:02:45.490675 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:45.490288    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:45.490675 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:45.490359    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df6a2659-d7a1-4e72-93ec-5445745ac38a-kube-rbac-proxy-cm podName:df6a2659-d7a1-4e72-93ec-5445745ac38a nodeName:}" failed. No retries permitted until 2026-09-07 21:02:47.490336504 +0000 UTC m=+63.750153936 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df6a2659-d7a1-4e72-93ec-5445745ac38a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h564t" (UID: "df6a2659-d7a1-4e72-93ec-5445745ac38a") : configmap "kube-rbac-proxy" not found
Sep 07 21:02:45.490675 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:45.490383    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df6a2659-d7a1-4e72-93ec-5445745ac38a-insights-runtime-extractor-tls podName:df6a2659-d7a1-4e72-93ec-5445745ac38a nodeName:}" failed. No retries permitted until 2026-09-07 21:02:47.490373146 +0000 UTC m=+63.750190366 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df6a2659-d7a1-4e72-93ec-5445745ac38a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h564t" (UID: "df6a2659-d7a1-4e72-93ec-5445745ac38a") : secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:45.563528 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:45.563499    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-kv96r_d804af86-d937-4ea6-afb8-760911a10437/console-operator/1.log"
Sep 07 21:02:45.563900 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:45.563883    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-kv96r_d804af86-d937-4ea6-afb8-760911a10437/console-operator/0.log"
Sep 07 21:02:45.563949 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:45.563921    2558 generic.go:356] "Generic (PLEG): container finished" podID="d804af86-d937-4ea6-afb8-760911a10437" containerID="39e7ea7401a2afefd5c5f702c0a3f81e507a3ab25234a83474378e27100091fd" exitCode=255
Sep 07 21:02:45.563983 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:45.563954    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-kv96r" event={"ID":"d804af86-d937-4ea6-afb8-760911a10437","Type":"ContainerDied","Data":"39e7ea7401a2afefd5c5f702c0a3f81e507a3ab25234a83474378e27100091fd"}
Sep 07 21:02:45.564063 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:45.564016    2558 scope.go:117] "RemoveContainer" containerID="afb73223e6d8246941d3b88868c7f0ab9204c0902e91fa4a8450f0939d21c16b"
Sep 07 21:02:45.564214 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:45.564192    2558 scope.go:117] "RemoveContainer" containerID="39e7ea7401a2afefd5c5f702c0a3f81e507a3ab25234a83474378e27100091fd"
Sep 07 21:02:45.564415 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:45.564386    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-kv96r_openshift-console-operator(d804af86-d937-4ea6-afb8-760911a10437)\"" pod="openshift-console-operator/console-operator-85b454874b-kv96r" podUID="d804af86-d937-4ea6-afb8-760911a10437"
Sep 07 21:02:45.646293 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:45.646264    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v85rk_6950b669-151a-4c2e-a928-be0eca0f92ee/dns-node-resolver/0.log"
Sep 07 21:02:46.567993 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:46.567963    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-kv96r_d804af86-d937-4ea6-afb8-760911a10437/console-operator/1.log"
Sep 07 21:02:46.568375 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:46.568353    2558 scope.go:117] "RemoveContainer" containerID="39e7ea7401a2afefd5c5f702c0a3f81e507a3ab25234a83474378e27100091fd"
Sep 07 21:02:46.568559 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:46.568539    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-kv96r_openshift-console-operator(d804af86-d937-4ea6-afb8-760911a10437)\"" pod="openshift-console-operator/console-operator-85b454874b-kv96r" podUID="d804af86-d937-4ea6-afb8-760911a10437"
Sep 07 21:02:46.847305 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:46.847234    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n9n5j_c90a86fc-5b8f-44e5-a429-1cd91bed305f/node-ca/0.log"
Sep 07 21:02:47.512730 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:47.512690    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df6a2659-d7a1-4e72-93ec-5445745ac38a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:47.512928 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:47.512766    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df6a2659-d7a1-4e72-93ec-5445745ac38a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:47.512928 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:47.512858    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 21:02:47.512928 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:47.512862    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:47.512928 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:47.512913    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df6a2659-d7a1-4e72-93ec-5445745ac38a-kube-rbac-proxy-cm podName:df6a2659-d7a1-4e72-93ec-5445745ac38a nodeName:}" failed. No retries permitted until 2026-09-07 21:02:51.512898241 +0000 UTC m=+67.772715463 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df6a2659-d7a1-4e72-93ec-5445745ac38a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h564t" (UID: "df6a2659-d7a1-4e72-93ec-5445745ac38a") : configmap "kube-rbac-proxy" not found
Sep 07 21:02:47.512928 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:47.512926    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df6a2659-d7a1-4e72-93ec-5445745ac38a-insights-runtime-extractor-tls podName:df6a2659-d7a1-4e72-93ec-5445745ac38a nodeName:}" failed. No retries permitted until 2026-09-07 21:02:51.512919521 +0000 UTC m=+67.772736741 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df6a2659-d7a1-4e72-93ec-5445745ac38a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h564t" (UID: "df6a2659-d7a1-4e72-93ec-5445745ac38a") : secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:47.536991 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:47.536959    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-g9j4w"]
Sep 07 21:02:47.539679 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:47.539659    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-g9j4w"
Sep 07 21:02:47.541914 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:47.541895    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 07 21:02:47.541914 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:47.541908    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 07 21:02:47.542462 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:47.542448    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 07 21:02:47.542548 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:47.542534    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 07 21:02:47.542612 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:47.542594    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gknvw\""
Sep 07 21:02:47.548233 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:47.548211    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-g9j4w"]
Sep 07 21:02:47.613885 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:47.613848    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b7ff9c2f-c390-4238-91af-86dd4ec68ede-signing-cabundle\") pod \"service-ca-75d99c484-g9j4w\" (UID: \"b7ff9c2f-c390-4238-91af-86dd4ec68ede\") " pod="openshift-service-ca/service-ca-75d99c484-g9j4w"
Sep 07 21:02:47.614271 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:47.613980    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b7ff9c2f-c390-4238-91af-86dd4ec68ede-signing-key\") pod \"service-ca-75d99c484-g9j4w\" (UID: \"b7ff9c2f-c390-4238-91af-86dd4ec68ede\") " pod="openshift-service-ca/service-ca-75d99c484-g9j4w"
Sep 07 21:02:47.614271 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:47.614022    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc42g\" (UniqueName: \"kubernetes.io/projected/b7ff9c2f-c390-4238-91af-86dd4ec68ede-kube-api-access-nc42g\") pod \"service-ca-75d99c484-g9j4w\" (UID: \"b7ff9c2f-c390-4238-91af-86dd4ec68ede\") " pod="openshift-service-ca/service-ca-75d99c484-g9j4w"
Sep 07 21:02:47.648391 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:47.648365    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xpdlp_f76762af-86f7-4a30-8dc8-020c23a07d5c/serve-healthcheck-canary/0.log"
Sep 07 21:02:47.715037 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:47.714999    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b7ff9c2f-c390-4238-91af-86dd4ec68ede-signing-cabundle\") pod \"service-ca-75d99c484-g9j4w\" (UID: \"b7ff9c2f-c390-4238-91af-86dd4ec68ede\") " pod="openshift-service-ca/service-ca-75d99c484-g9j4w"
Sep 07 21:02:47.715215 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:47.715167    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b7ff9c2f-c390-4238-91af-86dd4ec68ede-signing-key\") pod \"service-ca-75d99c484-g9j4w\" (UID: \"b7ff9c2f-c390-4238-91af-86dd4ec68ede\") " pod="openshift-service-ca/service-ca-75d99c484-g9j4w"
Sep 07 21:02:47.715215 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:47.715215    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc42g\" (UniqueName: \"kubernetes.io/projected/b7ff9c2f-c390-4238-91af-86dd4ec68ede-kube-api-access-nc42g\") pod \"service-ca-75d99c484-g9j4w\" (UID: \"b7ff9c2f-c390-4238-91af-86dd4ec68ede\") " pod="openshift-service-ca/service-ca-75d99c484-g9j4w"
Sep 07 21:02:47.715806 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:47.715783    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b7ff9c2f-c390-4238-91af-86dd4ec68ede-signing-cabundle\") pod \"service-ca-75d99c484-g9j4w\" (UID: \"b7ff9c2f-c390-4238-91af-86dd4ec68ede\") " pod="openshift-service-ca/service-ca-75d99c484-g9j4w"
Sep 07 21:02:47.717511 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:47.717486    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b7ff9c2f-c390-4238-91af-86dd4ec68ede-signing-key\") pod \"service-ca-75d99c484-g9j4w\" (UID: \"b7ff9c2f-c390-4238-91af-86dd4ec68ede\") " pod="openshift-service-ca/service-ca-75d99c484-g9j4w"
Sep 07 21:02:47.724950 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:47.724922    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc42g\" (UniqueName: \"kubernetes.io/projected/b7ff9c2f-c390-4238-91af-86dd4ec68ede-kube-api-access-nc42g\") pod \"service-ca-75d99c484-g9j4w\" (UID: \"b7ff9c2f-c390-4238-91af-86dd4ec68ede\") " pod="openshift-service-ca/service-ca-75d99c484-g9j4w"
Sep 07 21:02:47.848715 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:47.848682    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-g9j4w"
Sep 07 21:02:48.119290 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:48.119217    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-g9j4w"]
Sep 07 21:02:48.122265 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:02:48.122232    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7ff9c2f_c390_4238_91af_86dd4ec68ede.slice/crio-f1a9cc6eb3b66bde55798485452bfbd12b7d37ad8c3cd3314692b52f4690aa91 WatchSource:0}: Error finding container f1a9cc6eb3b66bde55798485452bfbd12b7d37ad8c3cd3314692b52f4690aa91: Status 404 returned error can't find the container with id f1a9cc6eb3b66bde55798485452bfbd12b7d37ad8c3cd3314692b52f4690aa91
Sep 07 21:02:48.320615 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:48.320579    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-k6n9v\" (UID: \"bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v"
Sep 07 21:02:48.320775 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:48.320627    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-registry-tls\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:48.320775 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:48.320722    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 07 21:02:48.320775 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:48.320756    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 21:02:48.320775 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:48.320767    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cf6fc866f-dvd6b: secret "image-registry-tls" not found
Sep 07 21:02:48.320915 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:48.320786    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-cluster-monitoring-operator-tls podName:bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b nodeName:}" failed. No retries permitted until 2026-09-07 21:02:56.320769557 +0000 UTC m=+72.580586797 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-k6n9v" (UID: "bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b") : secret "cluster-monitoring-operator-tls" not found
Sep 07 21:02:48.320915 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:48.320803    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-registry-tls podName:bf1661df-8943-467e-9020-96dba273cc49 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:56.320792122 +0000 UTC m=+72.580609342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-registry-tls") pod "image-registry-6cf6fc866f-dvd6b" (UID: "bf1661df-8943-467e-9020-96dba273cc49") : secret "image-registry-tls" not found
Sep 07 21:02:48.575155 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:48.575115    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-g9j4w" event={"ID":"b7ff9c2f-c390-4238-91af-86dd4ec68ede","Type":"ContainerStarted","Data":"5eab81cd0f9fc26b0f626f964175598fddd2851f5b0a1ea61ddbde2d08cb4cb5"}
Sep 07 21:02:48.575346 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:48.575183    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-g9j4w" event={"ID":"b7ff9c2f-c390-4238-91af-86dd4ec68ede","Type":"ContainerStarted","Data":"f1a9cc6eb3b66bde55798485452bfbd12b7d37ad8c3cd3314692b52f4690aa91"}
Sep 07 21:02:48.603434 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:48.603378    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-g9j4w" podStartSLOduration=1.60336128 podStartE2EDuration="1.60336128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:02:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:48.602359183 +0000 UTC m=+64.862176450" watchObservedRunningTime="2026-09-07 21:02:48.60336128 +0000 UTC m=+64.863178524"
Sep 07 21:02:50.036404 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:50.036362    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret\") pod \"global-pull-secret-syncer-59tw4\" (UID: \"fe0c1618-8f48-4a50-8791-83c8e388f13d\") " pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:02:50.036897 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:50.036420    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs\") pod \"network-metrics-daemon-67mj7\" (UID: \"0439cb5a-ba34-4a77-9469-f790e6d37dbc\") " pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:02:50.039995 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:50.039974    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 21:02:50.040178 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:50.039976    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 21:02:50.046760 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:50.046727    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 07 21:02:50.046870 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:50.046811    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs podName:0439cb5a-ba34-4a77-9469-f790e6d37dbc nodeName:}" failed. No retries permitted until 2026-09-07 21:03:54.046789866 +0000 UTC m=+130.306607104 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs") pod "network-metrics-daemon-67mj7" (UID: "0439cb5a-ba34-4a77-9469-f790e6d37dbc") : secret "metrics-daemon-secret" not found
Sep 07 21:02:50.049457 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:50.049433    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe0c1618-8f48-4a50-8791-83c8e388f13d-original-pull-secret\") pod \"global-pull-secret-syncer-59tw4\" (UID: \"fe0c1618-8f48-4a50-8791-83c8e388f13d\") " pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:02:50.136848 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:50.136811    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lq4q\" (UniqueName: \"kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q\") pod \"network-check-target-rwdbk\" (UID: \"48ada37c-2a5c-47cd-8fa4-986e554a7288\") " pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:02:50.139716 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:50.139696    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 21:02:50.149769 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:50.149745    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 21:02:50.160359 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:50.160331    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lq4q\" (UniqueName: \"kubernetes.io/projected/48ada37c-2a5c-47cd-8fa4-986e554a7288-kube-api-access-6lq4q\") pod \"network-check-target-rwdbk\" (UID: \"48ada37c-2a5c-47cd-8fa4-986e554a7288\") " pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:02:50.325198 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:50.325158    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-59tw4"
Sep 07 21:02:50.331978 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:50.331944    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xs9mt\""
Sep 07 21:02:50.339474 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:50.339450    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:02:50.612993 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:50.612918    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-59tw4"]
Sep 07 21:02:50.617117 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:02:50.617096    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe0c1618_8f48_4a50_8791_83c8e388f13d.slice/crio-980627b9fed040c4638c3b445ae4a15c7669f81c1eb1af88c390400ba22845dd WatchSource:0}: Error finding container 980627b9fed040c4638c3b445ae4a15c7669f81c1eb1af88c390400ba22845dd: Status 404 returned error can't find the container with id 980627b9fed040c4638c3b445ae4a15c7669f81c1eb1af88c390400ba22845dd
Sep 07 21:02:50.624668 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:50.624642    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rwdbk"]
Sep 07 21:02:50.627962 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:02:50.627936    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48ada37c_2a5c_47cd_8fa4_986e554a7288.slice/crio-395a625a984caf36b42d167848f20b9a27af3f84e129a61dbc03b9e3b582cdc3 WatchSource:0}: Error finding container 395a625a984caf36b42d167848f20b9a27af3f84e129a61dbc03b9e3b582cdc3: Status 404 returned error can't find the container with id 395a625a984caf36b42d167848f20b9a27af3f84e129a61dbc03b9e3b582cdc3
Sep 07 21:02:50.682369 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:50.682327    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-kv96r"
Sep 07 21:02:50.682510 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:50.682396    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-kv96r"
Sep 07 21:02:50.682784 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:50.682771    2558 scope.go:117] "RemoveContainer" containerID="39e7ea7401a2afefd5c5f702c0a3f81e507a3ab25234a83474378e27100091fd"
Sep 07 21:02:50.682955 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:50.682934    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-kv96r_openshift-console-operator(d804af86-d937-4ea6-afb8-760911a10437)\"" pod="openshift-console-operator/console-operator-85b454874b-kv96r" podUID="d804af86-d937-4ea6-afb8-760911a10437"
Sep 07 21:02:50.943051 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:50.942950    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls\") pod \"dns-default-rzj7z\" (UID: \"fbff6cc7-efb5-42e9-939f-df51e82cdfb4\") " pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:02:50.943228 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:50.943094    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 21:02:50.943228 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:50.943160    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls podName:fbff6cc7-efb5-42e9-939f-df51e82cdfb4 nodeName:}" failed. No retries permitted until 2026-09-07 21:03:22.943143827 +0000 UTC m=+99.202961069 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls") pod "dns-default-rzj7z" (UID: "fbff6cc7-efb5-42e9-939f-df51e82cdfb4") : secret "dns-default-metrics-tls" not found
Sep 07 21:02:51.548777 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:51.547984    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df6a2659-d7a1-4e72-93ec-5445745ac38a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:51.548777 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:51.548075    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df6a2659-d7a1-4e72-93ec-5445745ac38a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:51.548777 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:51.548207    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 21:02:51.548777 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:51.548273    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df6a2659-d7a1-4e72-93ec-5445745ac38a-kube-rbac-proxy-cm podName:df6a2659-d7a1-4e72-93ec-5445745ac38a nodeName:}" failed. No retries permitted until 2026-09-07 21:02:59.548252066 +0000 UTC m=+75.808069300 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df6a2659-d7a1-4e72-93ec-5445745ac38a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h564t" (UID: "df6a2659-d7a1-4e72-93ec-5445745ac38a") : configmap "kube-rbac-proxy" not found
Sep 07 21:02:51.548777 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:51.548690    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:51.548777 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:51.548742    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df6a2659-d7a1-4e72-93ec-5445745ac38a-insights-runtime-extractor-tls podName:df6a2659-d7a1-4e72-93ec-5445745ac38a nodeName:}" failed. No retries permitted until 2026-09-07 21:02:59.548726727 +0000 UTC m=+75.808543949 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df6a2659-d7a1-4e72-93ec-5445745ac38a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h564t" (UID: "df6a2659-d7a1-4e72-93ec-5445745ac38a") : secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:51.587236 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:51.587201    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-59tw4" event={"ID":"fe0c1618-8f48-4a50-8791-83c8e388f13d","Type":"ContainerStarted","Data":"980627b9fed040c4638c3b445ae4a15c7669f81c1eb1af88c390400ba22845dd"}
Sep 07 21:02:51.588592 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:51.588564    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rwdbk" event={"ID":"48ada37c-2a5c-47cd-8fa4-986e554a7288","Type":"ContainerStarted","Data":"395a625a984caf36b42d167848f20b9a27af3f84e129a61dbc03b9e3b582cdc3"}
Sep 07 21:02:54.599804 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:54.599764    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rwdbk" event={"ID":"48ada37c-2a5c-47cd-8fa4-986e554a7288","Type":"ContainerStarted","Data":"94eb0305dd61f1a1cad66c0c808c34d5bc7b274a5a1ce00be7ab763d43d40946"}
Sep 07 21:02:54.600365 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:54.599917    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:02:54.616595 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:54.616540    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rwdbk" podStartSLOduration=66.470541805 podStartE2EDuration="1m9.61651938s" totalImagesPullingTime="3.145977575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:54.615787543 +0000 UTC m=+70.875604810" watchObservedRunningTime="2026-09-07 21:02:54.61651938 +0000 UTC m=+70.876336634"
Sep 07 21:02:55.605205 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:55.605164    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-59tw4" event={"ID":"fe0c1618-8f48-4a50-8791-83c8e388f13d","Type":"ContainerStarted","Data":"45b30e1a044b370cdcf37e4757119f9a50f7c82ba289f22372122b16a2e1f6d5"}
Sep 07 21:02:55.621010 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:55.620955    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-59tw4" podStartSLOduration=65.814171294 podStartE2EDuration="1m10.620933025s" totalImagesPullingTime="4.806761731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:55.620847225 +0000 UTC m=+71.880664496" watchObservedRunningTime="2026-09-07 21:02:55.620933025 +0000 UTC m=+71.880750269"
Sep 07 21:02:56.389302 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:56.389259    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-registry-tls\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:56.389488 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:56.389421    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-k6n9v\" (UID: \"bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v"
Sep 07 21:02:56.389562 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:56.389547    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 07 21:02:56.389626 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:56.389616    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-cluster-monitoring-operator-tls podName:bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b nodeName:}" failed. No retries permitted until 2026-09-07 21:03:12.389598665 +0000 UTC m=+88.649415890 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-k6n9v" (UID: "bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b") : secret "cluster-monitoring-operator-tls" not found
Sep 07 21:02:56.391659 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:56.391634    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-registry-tls\") pod \"image-registry-6cf6fc866f-dvd6b\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") " pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:56.398043 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:56.398023    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tqps2\""
Sep 07 21:02:56.406631 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:56.406615    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:56.679845 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:56.679771    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cf6fc866f-dvd6b"]
Sep 07 21:02:56.682525 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:02:56.682492    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf1661df_8943_467e_9020_96dba273cc49.slice/crio-2c5ad2a1d994bdbf94334e8fc3ae3ebe84d8e1118c899040c11fe9aee73a6ac3 WatchSource:0}: Error finding container 2c5ad2a1d994bdbf94334e8fc3ae3ebe84d8e1118c899040c11fe9aee73a6ac3: Status 404 returned error can't find the container with id 2c5ad2a1d994bdbf94334e8fc3ae3ebe84d8e1118c899040c11fe9aee73a6ac3
Sep 07 21:02:57.611837 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:57.611799    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b" event={"ID":"bf1661df-8943-467e-9020-96dba273cc49","Type":"ContainerStarted","Data":"ed8735f46d5e0f6db98de9dc400bc531b915ec3846d2e8a4d9bf25cf8ca87e52"}
Sep 07 21:02:57.612003 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:57.611859    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b" event={"ID":"bf1661df-8943-467e-9020-96dba273cc49","Type":"ContainerStarted","Data":"2c5ad2a1d994bdbf94334e8fc3ae3ebe84d8e1118c899040c11fe9aee73a6ac3"}
Sep 07 21:02:57.612003 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:57.611923    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:02:57.630387 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:57.630336    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b" podStartSLOduration=17.6303027 podStartE2EDuration="17.6303027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:02:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:57.62949421 +0000 UTC m=+73.889311473" watchObservedRunningTime="2026-09-07 21:02:57.6303027 +0000 UTC m=+73.890119942"
Sep 07 21:02:59.616235 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:59.616195    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df6a2659-d7a1-4e72-93ec-5445745ac38a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:59.616677 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:59.616275    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df6a2659-d7a1-4e72-93ec-5445745ac38a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:02:59.616677 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:59.616390    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:59.616677 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:02:59.616453    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df6a2659-d7a1-4e72-93ec-5445745ac38a-insights-runtime-extractor-tls podName:df6a2659-d7a1-4e72-93ec-5445745ac38a nodeName:}" failed. No retries permitted until 2026-09-07 21:03:15.616440582 +0000 UTC m=+91.876257803 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df6a2659-d7a1-4e72-93ec-5445745ac38a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h564t" (UID: "df6a2659-d7a1-4e72-93ec-5445745ac38a") : secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:59.616828 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:02:59.616701    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df6a2659-d7a1-4e72-93ec-5445745ac38a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:03:03.302710 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:03.302678    2558 scope.go:117] "RemoveContainer" containerID="39e7ea7401a2afefd5c5f702c0a3f81e507a3ab25234a83474378e27100091fd"
Sep 07 21:03:03.635249 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:03.635173    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-kv96r_d804af86-d937-4ea6-afb8-760911a10437/console-operator/1.log"
Sep 07 21:03:03.635249 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:03.635224    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-kv96r" event={"ID":"d804af86-d937-4ea6-afb8-760911a10437","Type":"ContainerStarted","Data":"3590bbe5fab6bdc0ebf2038165f651754aacf9f8a82fe3feb6d786c62d5d4b00"}
Sep 07 21:03:03.635522 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:03.635500    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-kv96r"
Sep 07 21:03:03.660872 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:03.660810    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-kv96r" podStartSLOduration=20.894624422 podStartE2EDuration="23.660788646s" totalImagesPullingTime="2.766164224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:03.659675801 +0000 UTC m=+79.919493066" watchObservedRunningTime="2026-09-07 21:03:03.660788646 +0000 UTC m=+79.920605891"
Sep 07 21:03:04.588470 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:04.588437    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-kv96r"
Sep 07 21:03:08.087907 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.087770    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc9bc9556-5hcf4"]
Sep 07 21:03:08.093955 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.093931    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc9bc9556-5hcf4"
Sep 07 21:03:08.096651 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.096624    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 07 21:03:08.097338 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.097292    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 07 21:03:08.097461 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.097355    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 07 21:03:08.097461 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.097358    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 07 21:03:08.109937 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.109917    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc9bc9556-5hcf4"]
Sep 07 21:03:08.171669 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.171631    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cf6fc866f-dvd6b"]
Sep 07 21:03:08.180249 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.180215    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s622q\" (UniqueName: \"kubernetes.io/projected/e7f19d63-a983-402d-829c-8178dd80543d-kube-api-access-s622q\") pod \"klusterlet-addon-workmgr-5bc9bc9556-5hcf4\" (UID: \"e7f19d63-a983-402d-829c-8178dd80543d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc9bc9556-5hcf4"
Sep 07 21:03:08.180454 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.180289    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7f19d63-a983-402d-829c-8178dd80543d-tmp\") pod \"klusterlet-addon-workmgr-5bc9bc9556-5hcf4\" (UID: \"e7f19d63-a983-402d-829c-8178dd80543d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc9bc9556-5hcf4"
Sep 07 21:03:08.180454 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.180408    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e7f19d63-a983-402d-829c-8178dd80543d-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bc9bc9556-5hcf4\" (UID: \"e7f19d63-a983-402d-829c-8178dd80543d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc9bc9556-5hcf4"
Sep 07 21:03:08.210140 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.210112    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-785c8f8569-79wxv"]
Sep 07 21:03:08.212146 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.212129    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.235196 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.235166    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-785c8f8569-79wxv"]
Sep 07 21:03:08.280782 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.280747    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d5a0dcd-8707-41fc-8537-7584c84a02c0-trusted-ca\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.280922 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.280789    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d5a0dcd-8707-41fc-8537-7584c84a02c0-ca-trust-extracted\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.280922 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.280858    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d5a0dcd-8707-41fc-8537-7584c84a02c0-image-registry-private-configuration\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.280922 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.280891    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d5a0dcd-8707-41fc-8537-7584c84a02c0-registry-tls\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.281041 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.280940    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkqrh\" (UniqueName: \"kubernetes.io/projected/3d5a0dcd-8707-41fc-8537-7584c84a02c0-kube-api-access-pkqrh\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.281041 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.280960    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e7f19d63-a983-402d-829c-8178dd80543d-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bc9bc9556-5hcf4\" (UID: \"e7f19d63-a983-402d-829c-8178dd80543d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc9bc9556-5hcf4"
Sep 07 21:03:08.281041 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.280988    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s622q\" (UniqueName: \"kubernetes.io/projected/e7f19d63-a983-402d-829c-8178dd80543d-kube-api-access-s622q\") pod \"klusterlet-addon-workmgr-5bc9bc9556-5hcf4\" (UID: \"e7f19d63-a983-402d-829c-8178dd80543d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc9bc9556-5hcf4"
Sep 07 21:03:08.281041 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.281013    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d5a0dcd-8707-41fc-8537-7584c84a02c0-bound-sa-token\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.281041 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.281039    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d5a0dcd-8707-41fc-8537-7584c84a02c0-registry-certificates\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.281206 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.281076    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7f19d63-a983-402d-829c-8178dd80543d-tmp\") pod \"klusterlet-addon-workmgr-5bc9bc9556-5hcf4\" (UID: \"e7f19d63-a983-402d-829c-8178dd80543d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc9bc9556-5hcf4"
Sep 07 21:03:08.281206 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.281094    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d5a0dcd-8707-41fc-8537-7584c84a02c0-installation-pull-secrets\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.281499 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.281478    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7f19d63-a983-402d-829c-8178dd80543d-tmp\") pod \"klusterlet-addon-workmgr-5bc9bc9556-5hcf4\" (UID: \"e7f19d63-a983-402d-829c-8178dd80543d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc9bc9556-5hcf4"
Sep 07 21:03:08.283476 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.283459    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e7f19d63-a983-402d-829c-8178dd80543d-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bc9bc9556-5hcf4\" (UID: \"e7f19d63-a983-402d-829c-8178dd80543d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc9bc9556-5hcf4"
Sep 07 21:03:08.291098 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.291072    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s622q\" (UniqueName: \"kubernetes.io/projected/e7f19d63-a983-402d-829c-8178dd80543d-kube-api-access-s622q\") pod \"klusterlet-addon-workmgr-5bc9bc9556-5hcf4\" (UID: \"e7f19d63-a983-402d-829c-8178dd80543d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc9bc9556-5hcf4"
Sep 07 21:03:08.382269 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.382179    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d5a0dcd-8707-41fc-8537-7584c84a02c0-bound-sa-token\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.382269 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.382219    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d5a0dcd-8707-41fc-8537-7584c84a02c0-registry-certificates\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.382269 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.382251    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d5a0dcd-8707-41fc-8537-7584c84a02c0-installation-pull-secrets\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.382635 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.382287    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d5a0dcd-8707-41fc-8537-7584c84a02c0-trusted-ca\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.382635 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.382328    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d5a0dcd-8707-41fc-8537-7584c84a02c0-ca-trust-extracted\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.382635 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.382360    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d5a0dcd-8707-41fc-8537-7584c84a02c0-image-registry-private-configuration\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.382635 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.382383    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d5a0dcd-8707-41fc-8537-7584c84a02c0-registry-tls\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.382635 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.382428    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkqrh\" (UniqueName: \"kubernetes.io/projected/3d5a0dcd-8707-41fc-8537-7584c84a02c0-kube-api-access-pkqrh\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.382872 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.382853    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d5a0dcd-8707-41fc-8537-7584c84a02c0-ca-trust-extracted\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.383201 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.383166    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d5a0dcd-8707-41fc-8537-7584c84a02c0-registry-certificates\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.383334 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.383294    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d5a0dcd-8707-41fc-8537-7584c84a02c0-trusted-ca\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.384850 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.384820    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d5a0dcd-8707-41fc-8537-7584c84a02c0-image-registry-private-configuration\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.384946 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.384852    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d5a0dcd-8707-41fc-8537-7584c84a02c0-installation-pull-secrets\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.384985 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.384968    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d5a0dcd-8707-41fc-8537-7584c84a02c0-registry-tls\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.397621 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.397591    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d5a0dcd-8707-41fc-8537-7584c84a02c0-bound-sa-token\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.397893 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.397869    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkqrh\" (UniqueName: \"kubernetes.io/projected/3d5a0dcd-8707-41fc-8537-7584c84a02c0-kube-api-access-pkqrh\") pod \"image-registry-785c8f8569-79wxv\" (UID: \"3d5a0dcd-8707-41fc-8537-7584c84a02c0\") " pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.405549 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.405495    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc9bc9556-5hcf4"
Sep 07 21:03:08.520714 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.520686    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:08.671194 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.671109    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc9bc9556-5hcf4"]
Sep 07 21:03:08.673654 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:03:08.673626    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7f19d63_a983_402d_829c_8178dd80543d.slice/crio-c292396181ed662dec4c3d9150e20fcabcffd1175d979fb0d503aca57c282b85 WatchSource:0}: Error finding container c292396181ed662dec4c3d9150e20fcabcffd1175d979fb0d503aca57c282b85: Status 404 returned error can't find the container with id c292396181ed662dec4c3d9150e20fcabcffd1175d979fb0d503aca57c282b85
Sep 07 21:03:08.810416 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:08.810384    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-785c8f8569-79wxv"]
Sep 07 21:03:08.813702 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:03:08.813675    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d5a0dcd_8707_41fc_8537_7584c84a02c0.slice/crio-bfea2dd1cc8204e71df6fe4363de0be75ccc8d93a53ad0f32fb4b35b800f4f43 WatchSource:0}: Error finding container bfea2dd1cc8204e71df6fe4363de0be75ccc8d93a53ad0f32fb4b35b800f4f43: Status 404 returned error can't find the container with id bfea2dd1cc8204e71df6fe4363de0be75ccc8d93a53ad0f32fb4b35b800f4f43
Sep 07 21:03:09.655824 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:09.655783    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-785c8f8569-79wxv" event={"ID":"3d5a0dcd-8707-41fc-8537-7584c84a02c0","Type":"ContainerStarted","Data":"9a2d5d4ae4897c146c74b2ff584aa048c9982020a6fb010ae14171d9acd8e993"}
Sep 07 21:03:09.656273 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:09.655843    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-785c8f8569-79wxv" event={"ID":"3d5a0dcd-8707-41fc-8537-7584c84a02c0","Type":"ContainerStarted","Data":"bfea2dd1cc8204e71df6fe4363de0be75ccc8d93a53ad0f32fb4b35b800f4f43"}
Sep 07 21:03:09.656273 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:09.655872    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:09.657251 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:09.657227    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc9bc9556-5hcf4" event={"ID":"e7f19d63-a983-402d-829c-8178dd80543d","Type":"ContainerStarted","Data":"c292396181ed662dec4c3d9150e20fcabcffd1175d979fb0d503aca57c282b85"}
Sep 07 21:03:09.681740 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:09.681689    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-785c8f8569-79wxv" podStartSLOduration=1.681672549 podStartE2EDuration="1.681672549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:09.681388767 +0000 UTC m=+85.941206036" watchObservedRunningTime="2026-09-07 21:03:09.681672549 +0000 UTC m=+85.941489817"
Sep 07 21:03:12.427380 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:12.427340    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-k6n9v\" (UID: \"bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v"
Sep 07 21:03:12.429891 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:12.429860    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-k6n9v\" (UID: \"bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v"
Sep 07 21:03:12.585054 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:12.585028    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nbsvm\""
Sep 07 21:03:12.593523 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:12.593503    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v"
Sep 07 21:03:12.671622 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:12.671581    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc9bc9556-5hcf4" event={"ID":"e7f19d63-a983-402d-829c-8178dd80543d","Type":"ContainerStarted","Data":"4b1fa47e329eb2685b9364b355d64f272ac82b82511acf07bda006fa18a84f16"}
Sep 07 21:03:12.671838 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:12.671820    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc9bc9556-5hcf4"
Sep 07 21:03:12.673240 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:12.673224    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc9bc9556-5hcf4"
Sep 07 21:03:12.701134 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:12.701043    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bc9bc9556-5hcf4" podStartSLOduration=0.817293835 podStartE2EDuration="4.701027989s" totalImagesPullingTime="3.883734154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:12.687404806 +0000 UTC m=+88.947222050" watchObservedRunningTime="2026-09-07 21:03:12.701027989 +0000 UTC m=+88.960845231"
Sep 07 21:03:12.862966 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:12.862933    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v"]
Sep 07 21:03:12.865849 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:03:12.865826    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb3aeff8_79f8_4dfd_8b1c_bdac3ff92b3b.slice/crio-7acb5a8d318aa61c314e4edca6bdef50a428f6f66a2e405b9dc365b227597c9d WatchSource:0}: Error finding container 7acb5a8d318aa61c314e4edca6bdef50a428f6f66a2e405b9dc365b227597c9d: Status 404 returned error can't find the container with id 7acb5a8d318aa61c314e4edca6bdef50a428f6f66a2e405b9dc365b227597c9d
Sep 07 21:03:13.676659 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:13.676622    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v" event={"ID":"bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b","Type":"ContainerStarted","Data":"7acb5a8d318aa61c314e4edca6bdef50a428f6f66a2e405b9dc365b227597c9d"}
Sep 07 21:03:14.683824 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:14.683787    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v" event={"ID":"bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b","Type":"ContainerStarted","Data":"d1df2bdecc9af7fb8cca4f7cd3b746dbdecfbde8dbb606b99e8ae73e1b856a9b"}
Sep 07 21:03:14.700108 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:14.700055    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-k6n9v" podStartSLOduration=33.01581551 podStartE2EDuration="34.700034554s" totalImagesPullingTime="1.684219044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:14.69964426 +0000 UTC m=+90.959461523" watchObservedRunningTime="2026-09-07 21:03:14.700034554 +0000 UTC m=+90.959851798"
Sep 07 21:03:15.657103 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:15.657067    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df6a2659-d7a1-4e72-93ec-5445745ac38a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:03:15.659352 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:15.659305    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df6a2659-d7a1-4e72-93ec-5445745ac38a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h564t\" (UID: \"df6a2659-d7a1-4e72-93ec-5445745ac38a\") " pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:03:15.844563 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:15.844528    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vvs4x\""
Sep 07 21:03:15.853159 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:15.853136    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h564t"
Sep 07 21:03:16.122453 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:16.122419    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h564t"]
Sep 07 21:03:16.126034 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:03:16.126004    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf6a2659_d7a1_4e72_93ec_5445745ac38a.slice/crio-ad727465b7874f947a2edb08752b49b4956a8cccbaddf08195b9f24f321e1841 WatchSource:0}: Error finding container ad727465b7874f947a2edb08752b49b4956a8cccbaddf08195b9f24f321e1841: Status 404 returned error can't find the container with id ad727465b7874f947a2edb08752b49b4956a8cccbaddf08195b9f24f321e1841
Sep 07 21:03:16.692806 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:16.692771    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h564t" event={"ID":"df6a2659-d7a1-4e72-93ec-5445745ac38a","Type":"ContainerStarted","Data":"dd130dc3d9e75739a733dbe3462fbb3c99f27be393c1f9d7478d608e60185060"}
Sep 07 21:03:16.692978 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:16.692827    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h564t" event={"ID":"df6a2659-d7a1-4e72-93ec-5445745ac38a","Type":"ContainerStarted","Data":"ad727465b7874f947a2edb08752b49b4956a8cccbaddf08195b9f24f321e1841"}
Sep 07 21:03:17.699097 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:17.699064    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h564t" event={"ID":"df6a2659-d7a1-4e72-93ec-5445745ac38a","Type":"ContainerStarted","Data":"1eed88df2e2084eb35ca285265462592d9d7393f94cda8755c1da9ebe9bc5faf"}
Sep 07 21:03:18.179019 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:18.178988    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:03:18.704388 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:18.704349    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h564t" event={"ID":"df6a2659-d7a1-4e72-93ec-5445745ac38a","Type":"ContainerStarted","Data":"ebd00c3e9022bd7d24ee69ac0f3e251b115452e2f4c93f4611b80faf497cab4a"}
Sep 07 21:03:18.723800 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:18.723698    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h564t" podStartSLOduration=33.525380363 podStartE2EDuration="35.723683155s" totalImagesPullingTime="2.198302792s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:02:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:18.722982826 +0000 UTC m=+94.982800085" watchObservedRunningTime="2026-09-07 21:03:18.723683155 +0000 UTC m=+94.983500398"
Sep 07 21:03:19.146868 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:19.146831    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-drfcd"]
Sep 07 21:03:19.149293 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:19.149272    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-drfcd"
Sep 07 21:03:19.154676 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:19.154651    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 07 21:03:19.154839 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:19.154820    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xk8s2\""
Sep 07 21:03:19.156293 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:19.156268    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 07 21:03:19.156474 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:19.156296    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 07 21:03:19.163938 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:19.163911    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-drfcd"]
Sep 07 21:03:19.287558 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:19.287517    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e821c5fa-6b29-46b5-afe5-33be835f9f52-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-drfcd\" (UID: \"e821c5fa-6b29-46b5-afe5-33be835f9f52\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-drfcd"
Sep 07 21:03:19.287704 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:19.287584    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e821c5fa-6b29-46b5-afe5-33be835f9f52-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-drfcd\" (UID: \"e821c5fa-6b29-46b5-afe5-33be835f9f52\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-drfcd"
Sep 07 21:03:19.287704 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:19.287673    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm8rh\" (UniqueName: \"kubernetes.io/projected/e821c5fa-6b29-46b5-afe5-33be835f9f52-kube-api-access-cm8rh\") pod \"prometheus-operator-6f4946db56-drfcd\" (UID: \"e821c5fa-6b29-46b5-afe5-33be835f9f52\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-drfcd"
Sep 07 21:03:19.287824 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:19.287721    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e821c5fa-6b29-46b5-afe5-33be835f9f52-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-drfcd\" (UID: \"e821c5fa-6b29-46b5-afe5-33be835f9f52\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-drfcd"
Sep 07 21:03:19.389030 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:19.388990    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm8rh\" (UniqueName: \"kubernetes.io/projected/e821c5fa-6b29-46b5-afe5-33be835f9f52-kube-api-access-cm8rh\") pod \"prometheus-operator-6f4946db56-drfcd\" (UID: \"e821c5fa-6b29-46b5-afe5-33be835f9f52\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-drfcd"
Sep 07 21:03:19.389189 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:19.389036    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e821c5fa-6b29-46b5-afe5-33be835f9f52-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-drfcd\" (UID: \"e821c5fa-6b29-46b5-afe5-33be835f9f52\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-drfcd"
Sep 07 21:03:19.389189 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:19.389106    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e821c5fa-6b29-46b5-afe5-33be835f9f52-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-drfcd\" (UID: \"e821c5fa-6b29-46b5-afe5-33be835f9f52\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-drfcd"
Sep 07 21:03:19.389189 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:19.389159    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e821c5fa-6b29-46b5-afe5-33be835f9f52-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-drfcd\" (UID: \"e821c5fa-6b29-46b5-afe5-33be835f9f52\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-drfcd"
Sep 07 21:03:19.389400 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:03:19.389260    2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 07 21:03:19.389400 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:03:19.389370    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e821c5fa-6b29-46b5-afe5-33be835f9f52-prometheus-operator-tls podName:e821c5fa-6b29-46b5-afe5-33be835f9f52 nodeName:}" failed. No retries permitted until 2026-09-07 21:03:19.889336713 +0000 UTC m=+96.149153948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e821c5fa-6b29-46b5-afe5-33be835f9f52-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-drfcd" (UID: "e821c5fa-6b29-46b5-afe5-33be835f9f52") : secret "prometheus-operator-tls" not found
Sep 07 21:03:19.389870 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:19.389848    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e821c5fa-6b29-46b5-afe5-33be835f9f52-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-drfcd\" (UID: \"e821c5fa-6b29-46b5-afe5-33be835f9f52\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-drfcd"
Sep 07 21:03:19.391466 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:19.391442    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e821c5fa-6b29-46b5-afe5-33be835f9f52-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-drfcd\" (UID: \"e821c5fa-6b29-46b5-afe5-33be835f9f52\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-drfcd"
Sep 07 21:03:19.399140 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:19.399084    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm8rh\" (UniqueName: \"kubernetes.io/projected/e821c5fa-6b29-46b5-afe5-33be835f9f52-kube-api-access-cm8rh\") pod \"prometheus-operator-6f4946db56-drfcd\" (UID: \"e821c5fa-6b29-46b5-afe5-33be835f9f52\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-drfcd"
Sep 07 21:03:19.893139 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:19.893101    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e821c5fa-6b29-46b5-afe5-33be835f9f52-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-drfcd\" (UID: \"e821c5fa-6b29-46b5-afe5-33be835f9f52\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-drfcd"
Sep 07 21:03:19.893598 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:03:19.893244    2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 07 21:03:19.893598 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:03:19.893347    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e821c5fa-6b29-46b5-afe5-33be835f9f52-prometheus-operator-tls podName:e821c5fa-6b29-46b5-afe5-33be835f9f52 nodeName:}" failed. No retries permitted until 2026-09-07 21:03:20.893327102 +0000 UTC m=+97.153144340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e821c5fa-6b29-46b5-afe5-33be835f9f52-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-drfcd" (UID: "e821c5fa-6b29-46b5-afe5-33be835f9f52") : secret "prometheus-operator-tls" not found
Sep 07 21:03:20.899639 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:20.899603    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e821c5fa-6b29-46b5-afe5-33be835f9f52-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-drfcd\" (UID: \"e821c5fa-6b29-46b5-afe5-33be835f9f52\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-drfcd"
Sep 07 21:03:20.901935 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:20.901914    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e821c5fa-6b29-46b5-afe5-33be835f9f52-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-drfcd\" (UID: \"e821c5fa-6b29-46b5-afe5-33be835f9f52\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-drfcd"
Sep 07 21:03:20.958216 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:20.958187    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-drfcd"
Sep 07 21:03:21.228768 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:21.228746    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-drfcd"]
Sep 07 21:03:21.231033 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:03:21.231007    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode821c5fa_6b29_46b5_afe5_33be835f9f52.slice/crio-3878954d7cafa909fc9ee2661642a418dad224225545e71c11523f8821550040 WatchSource:0}: Error finding container 3878954d7cafa909fc9ee2661642a418dad224225545e71c11523f8821550040: Status 404 returned error can't find the container with id 3878954d7cafa909fc9ee2661642a418dad224225545e71c11523f8821550040
Sep 07 21:03:21.716666 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:21.716633    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-drfcd" event={"ID":"e821c5fa-6b29-46b5-afe5-33be835f9f52","Type":"ContainerStarted","Data":"3878954d7cafa909fc9ee2661642a418dad224225545e71c11523f8821550040"}
Sep 07 21:03:22.722376 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:22.722340    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-drfcd" event={"ID":"e821c5fa-6b29-46b5-afe5-33be835f9f52","Type":"ContainerStarted","Data":"99418e58f8f4aa6762e21566e1a66c235ebb5700911cd03ed22ffdd9d5b13726"}
Sep 07 21:03:22.722746 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:22.722394    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-drfcd" event={"ID":"e821c5fa-6b29-46b5-afe5-33be835f9f52","Type":"ContainerStarted","Data":"a38e9a9e04f1a6d930673311b1d76c66b5e64a6838fdfc697f97569d8478a016"}
Sep 07 21:03:22.764863 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:22.764760    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-drfcd" podStartSLOduration=2.51684684 podStartE2EDuration="3.764741228s" totalImagesPullingTime="1.247894388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:22.763700393 +0000 UTC m=+99.023517653" watchObservedRunningTime="2026-09-07 21:03:22.764741228 +0000 UTC m=+99.024558471"
Sep 07 21:03:23.016834 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:23.016756    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls\") pod \"dns-default-rzj7z\" (UID: \"fbff6cc7-efb5-42e9-939f-df51e82cdfb4\") " pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:03:23.019104 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:23.019073    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbff6cc7-efb5-42e9-939f-df51e82cdfb4-metrics-tls\") pod \"dns-default-rzj7z\" (UID: \"fbff6cc7-efb5-42e9-939f-df51e82cdfb4\") " pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:03:23.039084 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:23.039054    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7njqf\""
Sep 07 21:03:23.046719 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:23.046698    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:03:23.314958 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:23.314925    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rzj7z"]
Sep 07 21:03:23.318697 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:03:23.318673    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbff6cc7_efb5_42e9_939f_df51e82cdfb4.slice/crio-c84f5a4290932fa0bb8db668a4c9cefb9b91700ca570a8041370986af717108a WatchSource:0}: Error finding container c84f5a4290932fa0bb8db668a4c9cefb9b91700ca570a8041370986af717108a: Status 404 returned error can't find the container with id c84f5a4290932fa0bb8db668a4c9cefb9b91700ca570a8041370986af717108a
Sep 07 21:03:23.727205 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:23.727121    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rzj7z" event={"ID":"fbff6cc7-efb5-42e9-939f-df51e82cdfb4","Type":"ContainerStarted","Data":"c84f5a4290932fa0bb8db668a4c9cefb9b91700ca570a8041370986af717108a"}
Sep 07 21:03:24.521193 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.521156    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k2wzp"]
Sep 07 21:03:24.525201 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.525172    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.528144 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.527950    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 07 21:03:24.528144 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.527977    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4kr28\""
Sep 07 21:03:24.528144 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.527976    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 07 21:03:24.528144 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.528067    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 07 21:03:24.630448 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.630408    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-node-exporter-tls\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.630635 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.630477    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.630635 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.630507    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8ghg\" (UniqueName: \"kubernetes.io/projected/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-kube-api-access-n8ghg\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.630635 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.630535    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-node-exporter-textfile\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.630635 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.630606    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-root\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.630635 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.630630    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.630897 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.630673    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-sys\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.630897 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.630705    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-metrics-client-ca\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.630897 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.630721    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-node-exporter-wtmp\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.731838 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.731645    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-sys\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.731838 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.731701    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-metrics-client-ca\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.731838 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.731727    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-node-exporter-wtmp\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.731838 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.731758    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-node-exporter-tls\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.731838 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.731807    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.731838 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.731830    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8ghg\" (UniqueName: \"kubernetes.io/projected/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-kube-api-access-n8ghg\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.732544 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.731856    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-node-exporter-textfile\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.732544 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.731920    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-root\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.732544 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.731942    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.732544 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.732003    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-node-exporter-wtmp\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.732544 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.732066    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-sys\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.732933 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.732892    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-root\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.733510 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.733489    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-metrics-client-ca\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.733723 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.733698    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-node-exporter-textfile\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.734005 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.733984    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.738294 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.738249    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.738650 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.738628    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-node-exporter-tls\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.741507 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.741485    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8ghg\" (UniqueName: \"kubernetes.io/projected/d9dfd0ad-45b4-40b8-abd6-98f6130574a1-kube-api-access-n8ghg\") pod \"node-exporter-k2wzp\" (UID: \"d9dfd0ad-45b4-40b8-abd6-98f6130574a1\") " pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.840016 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:24.839981    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k2wzp"
Sep 07 21:03:24.911393 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:03:24.911356    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9dfd0ad_45b4_40b8_abd6_98f6130574a1.slice/crio-7bce6aa19393b1d38599593eec0b2726500a7322a4c444869e5690bdfe9983e7 WatchSource:0}: Error finding container 7bce6aa19393b1d38599593eec0b2726500a7322a4c444869e5690bdfe9983e7: Status 404 returned error can't find the container with id 7bce6aa19393b1d38599593eec0b2726500a7322a4c444869e5690bdfe9983e7
Sep 07 21:03:25.608387 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:25.608356    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rwdbk"
Sep 07 21:03:25.739969 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:25.739838    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rzj7z" event={"ID":"fbff6cc7-efb5-42e9-939f-df51e82cdfb4","Type":"ContainerStarted","Data":"9364762d15130551474ebb474523a6603ee8eebfc252a567ddc01f64fcb02137"}
Sep 07 21:03:25.739969 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:25.739904    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rzj7z" event={"ID":"fbff6cc7-efb5-42e9-939f-df51e82cdfb4","Type":"ContainerStarted","Data":"503b8665fc7026a0743012532359468922da6bbae1c21bbf8fef3f93350a2c4e"}
Sep 07 21:03:25.740538 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:25.740036    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:03:25.741924 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:25.741900    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k2wzp" event={"ID":"d9dfd0ad-45b4-40b8-abd6-98f6130574a1","Type":"ContainerStarted","Data":"7bce6aa19393b1d38599593eec0b2726500a7322a4c444869e5690bdfe9983e7"}
Sep 07 21:03:25.763476 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:25.763422    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rzj7z" podStartSLOduration=65.12838548 podStartE2EDuration="1m6.763405956s" totalImagesPullingTime="1.635020476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:25.762801646 +0000 UTC m=+102.022618946" watchObservedRunningTime="2026-09-07 21:03:25.763405956 +0000 UTC m=+102.023223200"
Sep 07 21:03:26.746666 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:26.746629    2558 generic.go:356] "Generic (PLEG): container finished" podID="d9dfd0ad-45b4-40b8-abd6-98f6130574a1" containerID="e199cade901d40ea1873f4d21e4d1d114f116a692e38f89037fcab7cf18c3c9c" exitCode=0
Sep 07 21:03:26.747038 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:26.746714    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k2wzp" event={"ID":"d9dfd0ad-45b4-40b8-abd6-98f6130574a1","Type":"ContainerDied","Data":"e199cade901d40ea1873f4d21e4d1d114f116a692e38f89037fcab7cf18c3c9c"}
Sep 07 21:03:27.759671 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:27.759618    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k2wzp" event={"ID":"d9dfd0ad-45b4-40b8-abd6-98f6130574a1","Type":"ContainerStarted","Data":"598b4d119866b83a9e982689c02a50367658a2c10463251ec4a1aba168b9310c"}
Sep 07 21:03:27.760061 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:27.759729    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k2wzp" event={"ID":"d9dfd0ad-45b4-40b8-abd6-98f6130574a1","Type":"ContainerStarted","Data":"5c65e30392378557d5afc683e108ab9948e026672068d1c55eb7385e756914cb"}
Sep 07 21:03:27.785397 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:27.785336    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k2wzp" podStartSLOduration=2.697500659 podStartE2EDuration="3.785296424s" totalImagesPullingTime="1.026995383s" totalInitContainerRuntime="60.800382ms" isStatefulPod=true podCreationTimestamp="2026-09-07 21:03:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:27.785266076 +0000 UTC m=+104.045083344" watchObservedRunningTime="2026-09-07 21:03:27.785296424 +0000 UTC m=+104.045113668"
Sep 07 21:03:30.667201 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:30.667164    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-785c8f8569-79wxv"
Sep 07 21:03:33.194944 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.191450    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b" podUID="bf1661df-8943-467e-9020-96dba273cc49" containerName="registry" containerID="cri-o://ed8735f46d5e0f6db98de9dc400bc531b915ec3846d2e8a4d9bf25cf8ca87e52" gracePeriod=30
Sep 07 21:03:33.431978 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.431955    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:03:33.608778 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.608740    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bf1661df-8943-467e-9020-96dba273cc49-installation-pull-secrets\") pod \"bf1661df-8943-467e-9020-96dba273cc49\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") "
Sep 07 21:03:33.608975 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.608809    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bf1661df-8943-467e-9020-96dba273cc49-registry-certificates\") pod \"bf1661df-8943-467e-9020-96dba273cc49\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") "
Sep 07 21:03:33.608975 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.608833    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-bound-sa-token\") pod \"bf1661df-8943-467e-9020-96dba273cc49\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") "
Sep 07 21:03:33.608975 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.608852    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bf1661df-8943-467e-9020-96dba273cc49-ca-trust-extracted\") pod \"bf1661df-8943-467e-9020-96dba273cc49\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") "
Sep 07 21:03:33.608975 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.608886    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-registry-tls\") pod \"bf1661df-8943-467e-9020-96dba273cc49\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") "
Sep 07 21:03:33.608975 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.608910    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5ccj\" (UniqueName: \"kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-kube-api-access-w5ccj\") pod \"bf1661df-8943-467e-9020-96dba273cc49\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") "
Sep 07 21:03:33.608975 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.608951    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf1661df-8943-467e-9020-96dba273cc49-trusted-ca\") pod \"bf1661df-8943-467e-9020-96dba273cc49\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") "
Sep 07 21:03:33.609290 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.609145    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bf1661df-8943-467e-9020-96dba273cc49-image-registry-private-configuration\") pod \"bf1661df-8943-467e-9020-96dba273cc49\" (UID: \"bf1661df-8943-467e-9020-96dba273cc49\") "
Sep 07 21:03:33.609388 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.609297    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf1661df-8943-467e-9020-96dba273cc49-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "bf1661df-8943-467e-9020-96dba273cc49" (UID: "bf1661df-8943-467e-9020-96dba273cc49"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:03:33.609556 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.609533    2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bf1661df-8943-467e-9020-96dba273cc49-registry-certificates\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:03:33.609928 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.609904    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf1661df-8943-467e-9020-96dba273cc49-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "bf1661df-8943-467e-9020-96dba273cc49" (UID: "bf1661df-8943-467e-9020-96dba273cc49"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:03:33.611636 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.611608    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf1661df-8943-467e-9020-96dba273cc49-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "bf1661df-8943-467e-9020-96dba273cc49" (UID: "bf1661df-8943-467e-9020-96dba273cc49"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:03:33.611749 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.611723    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-kube-api-access-w5ccj" (OuterVolumeSpecName: "kube-api-access-w5ccj") pod "bf1661df-8943-467e-9020-96dba273cc49" (UID: "bf1661df-8943-467e-9020-96dba273cc49"). InnerVolumeSpecName "kube-api-access-w5ccj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:03:33.611809 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.611774    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf1661df-8943-467e-9020-96dba273cc49-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "bf1661df-8943-467e-9020-96dba273cc49" (UID: "bf1661df-8943-467e-9020-96dba273cc49"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:03:33.611869 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.611817    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bf1661df-8943-467e-9020-96dba273cc49" (UID: "bf1661df-8943-467e-9020-96dba273cc49"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:03:33.611869 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.611838    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "bf1661df-8943-467e-9020-96dba273cc49" (UID: "bf1661df-8943-467e-9020-96dba273cc49"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:03:33.617671 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.617645    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf1661df-8943-467e-9020-96dba273cc49-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "bf1661df-8943-467e-9020-96dba273cc49" (UID: "bf1661df-8943-467e-9020-96dba273cc49"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:03:33.710359 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.710293    2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bf1661df-8943-467e-9020-96dba273cc49-image-registry-private-configuration\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:03:33.710359 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.710353    2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bf1661df-8943-467e-9020-96dba273cc49-installation-pull-secrets\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:03:33.710359 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.710367    2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-bound-sa-token\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:03:33.710599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.710379    2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bf1661df-8943-467e-9020-96dba273cc49-ca-trust-extracted\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:03:33.710599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.710391    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-registry-tls\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:03:33.710599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.710405    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5ccj\" (UniqueName: \"kubernetes.io/projected/bf1661df-8943-467e-9020-96dba273cc49-kube-api-access-w5ccj\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:03:33.710599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.710416    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf1661df-8943-467e-9020-96dba273cc49-trusted-ca\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:03:33.783471 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.783435    2558 generic.go:356] "Generic (PLEG): container finished" podID="bf1661df-8943-467e-9020-96dba273cc49" containerID="ed8735f46d5e0f6db98de9dc400bc531b915ec3846d2e8a4d9bf25cf8ca87e52" exitCode=0
Sep 07 21:03:33.783659 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.783489    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b"
Sep 07 21:03:33.783659 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.783499    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b" event={"ID":"bf1661df-8943-467e-9020-96dba273cc49","Type":"ContainerDied","Data":"ed8735f46d5e0f6db98de9dc400bc531b915ec3846d2e8a4d9bf25cf8ca87e52"}
Sep 07 21:03:33.783659 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.783564    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf6fc866f-dvd6b" event={"ID":"bf1661df-8943-467e-9020-96dba273cc49","Type":"ContainerDied","Data":"2c5ad2a1d994bdbf94334e8fc3ae3ebe84d8e1118c899040c11fe9aee73a6ac3"}
Sep 07 21:03:33.783659 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.783584    2558 scope.go:117] "RemoveContainer" containerID="ed8735f46d5e0f6db98de9dc400bc531b915ec3846d2e8a4d9bf25cf8ca87e52"
Sep 07 21:03:33.792209 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.792187    2558 scope.go:117] "RemoveContainer" containerID="ed8735f46d5e0f6db98de9dc400bc531b915ec3846d2e8a4d9bf25cf8ca87e52"
Sep 07 21:03:33.792566 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:03:33.792543    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed8735f46d5e0f6db98de9dc400bc531b915ec3846d2e8a4d9bf25cf8ca87e52\": container with ID starting with ed8735f46d5e0f6db98de9dc400bc531b915ec3846d2e8a4d9bf25cf8ca87e52 not found: ID does not exist" containerID="ed8735f46d5e0f6db98de9dc400bc531b915ec3846d2e8a4d9bf25cf8ca87e52"
Sep 07 21:03:33.792643 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.792576    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed8735f46d5e0f6db98de9dc400bc531b915ec3846d2e8a4d9bf25cf8ca87e52"} err="failed to get container status \"ed8735f46d5e0f6db98de9dc400bc531b915ec3846d2e8a4d9bf25cf8ca87e52\": rpc error: code = NotFound desc = could not find container \"ed8735f46d5e0f6db98de9dc400bc531b915ec3846d2e8a4d9bf25cf8ca87e52\": container with ID starting with ed8735f46d5e0f6db98de9dc400bc531b915ec3846d2e8a4d9bf25cf8ca87e52 not found: ID does not exist"
Sep 07 21:03:33.803825 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.803802    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cf6fc866f-dvd6b"]
Sep 07 21:03:33.809778 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:33.809757    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6cf6fc866f-dvd6b"]
Sep 07 21:03:34.306452 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:34.306421    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf1661df-8943-467e-9020-96dba273cc49" path="/var/lib/kubelet/pods/bf1661df-8943-467e-9020-96dba273cc49/volumes"
Sep 07 21:03:35.749477 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:35.749446    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rzj7z"
Sep 07 21:03:54.068077 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:54.068042    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs\") pod \"network-metrics-daemon-67mj7\" (UID: \"0439cb5a-ba34-4a77-9469-f790e6d37dbc\") " pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:03:54.070368 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:54.070343    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0439cb5a-ba34-4a77-9469-f790e6d37dbc-metrics-certs\") pod \"network-metrics-daemon-67mj7\" (UID: \"0439cb5a-ba34-4a77-9469-f790e6d37dbc\") " pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:03:54.221877 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:54.221843    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9r8wd\""
Sep 07 21:03:54.230217 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:54.230198    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-67mj7"
Sep 07 21:03:54.503127 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:54.503054    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-67mj7"]
Sep 07 21:03:54.506092 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:03:54.506060    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0439cb5a_ba34_4a77_9469_f790e6d37dbc.slice/crio-b451518732d8b6db4a5e5b5cb2679282b535d630f0de81c22b226f9ef3c66098 WatchSource:0}: Error finding container b451518732d8b6db4a5e5b5cb2679282b535d630f0de81c22b226f9ef3c66098: Status 404 returned error can't find the container with id b451518732d8b6db4a5e5b5cb2679282b535d630f0de81c22b226f9ef3c66098
Sep 07 21:03:54.856345 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:54.856291    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-67mj7" event={"ID":"0439cb5a-ba34-4a77-9469-f790e6d37dbc","Type":"ContainerStarted","Data":"b451518732d8b6db4a5e5b5cb2679282b535d630f0de81c22b226f9ef3c66098"}
Sep 07 21:03:55.861388 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:55.861341    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-67mj7" event={"ID":"0439cb5a-ba34-4a77-9469-f790e6d37dbc","Type":"ContainerStarted","Data":"27530da2029e5dbf401ebcf8b0f5df165208e864901b4936c6c14e89f5475a43"}
Sep 07 21:03:55.861729 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:55.861415    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-67mj7" event={"ID":"0439cb5a-ba34-4a77-9469-f790e6d37dbc","Type":"ContainerStarted","Data":"d9c155ccb2e38beb19b06215d451d60b4acaa5878986d361ccd783eaf9c58d93"}
Sep 07 21:03:55.877565 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:03:55.877513    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-67mj7" podStartSLOduration=129.955781632 podStartE2EDuration="2m10.87749586s" totalImagesPullingTime="921.714228ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:55.876154734 +0000 UTC m=+132.135971987" watchObservedRunningTime="2026-09-07 21:03:55.87749586 +0000 UTC m=+132.137313102"
Sep 07 21:04:14.927566 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:04:14.927528    2558 generic.go:356] "Generic (PLEG): container finished" podID="e824446c-20c4-4d8f-8dfe-5a9717499244" containerID="ece7bbb9e0fd5253daf29d995cc3051912c52863dd3cd4fbda26ae7d37a09004" exitCode=0
Sep 07 21:04:14.928206 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:04:14.927603    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-27hsx" event={"ID":"e824446c-20c4-4d8f-8dfe-5a9717499244","Type":"ContainerDied","Data":"ece7bbb9e0fd5253daf29d995cc3051912c52863dd3cd4fbda26ae7d37a09004"}
Sep 07 21:04:14.928206 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:04:14.928041    2558 scope.go:117] "RemoveContainer" containerID="ece7bbb9e0fd5253daf29d995cc3051912c52863dd3cd4fbda26ae7d37a09004"
Sep 07 21:04:15.935616 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:04:15.935579    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-27hsx" event={"ID":"e824446c-20c4-4d8f-8dfe-5a9717499244","Type":"ContainerStarted","Data":"69b337753e9af5a656965c388981735818dcb124ae63fec8274b1bac4c077b1e"}
Sep 07 21:06:37.660611 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:37.660573    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr"]
Sep 07 21:06:37.661017 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:37.660903    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf1661df-8943-467e-9020-96dba273cc49" containerName="registry"
Sep 07 21:06:37.661017 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:37.660916    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf1661df-8943-467e-9020-96dba273cc49" containerName="registry"
Sep 07 21:06:37.661017 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:37.660959    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf1661df-8943-467e-9020-96dba273cc49" containerName="registry"
Sep 07 21:06:37.663908 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:37.663892    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr"
Sep 07 21:06:37.666053 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:37.666034    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 21:06:37.666053 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:37.666048    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gq45v\""
Sep 07 21:06:37.666986 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:37.666973    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 21:06:37.671455 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:37.671433    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr"]
Sep 07 21:06:37.761552 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:37.761513    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkq9v\" (UniqueName: \"kubernetes.io/projected/b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e-kube-api-access-gkq9v\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr\" (UID: \"b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr"
Sep 07 21:06:37.761552 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:37.761554    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr\" (UID: \"b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr"
Sep 07 21:06:37.761769 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:37.761620    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr\" (UID: \"b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr"
Sep 07 21:06:37.862887 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:37.862852    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkq9v\" (UniqueName: \"kubernetes.io/projected/b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e-kube-api-access-gkq9v\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr\" (UID: \"b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr"
Sep 07 21:06:37.863033 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:37.862898    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr\" (UID: \"b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr"
Sep 07 21:06:37.863033 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:37.863015    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr\" (UID: \"b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr"
Sep 07 21:06:37.863260 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:37.863239    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr\" (UID: \"b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr"
Sep 07 21:06:37.863349 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:37.863336    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr\" (UID: \"b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr"
Sep 07 21:06:37.871011 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:37.870988    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkq9v\" (UniqueName: \"kubernetes.io/projected/b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e-kube-api-access-gkq9v\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr\" (UID: \"b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr"
Sep 07 21:06:37.972616 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:37.972549    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr"
Sep 07 21:06:38.238331 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:38.238222    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr"]
Sep 07 21:06:38.241037 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:06:38.241013    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb91d5ba3_dbcd_42cf_8bfe_f3b9148b818e.slice/crio-b968aa243e910e5a53418df1c23401963294c6e21ffd1d48798c6d14f40e5058 WatchSource:0}: Error finding container b968aa243e910e5a53418df1c23401963294c6e21ffd1d48798c6d14f40e5058: Status 404 returned error can't find the container with id b968aa243e910e5a53418df1c23401963294c6e21ffd1d48798c6d14f40e5058
Sep 07 21:06:38.420855 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:38.420804    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr" event={"ID":"b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e","Type":"ContainerStarted","Data":"b968aa243e910e5a53418df1c23401963294c6e21ffd1d48798c6d14f40e5058"}
Sep 07 21:06:44.141566 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:44.141535    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-kv96r_d804af86-d937-4ea6-afb8-760911a10437/console-operator/1.log"
Sep 07 21:06:44.142588 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:44.142567    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-kv96r_d804af86-d937-4ea6-afb8-760911a10437/console-operator/1.log"
Sep 07 21:06:44.156615 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:44.156590    2558 kubelet.go:1648] "Image garbage collection succeeded"
Sep 07 21:06:44.445993 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:44.445903    2558 generic.go:356] "Generic (PLEG): container finished" podID="b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e" containerID="b9f6c8ea576a23063402692ea11de0a4171e461e837f302ad793cfd138d1c751" exitCode=0
Sep 07 21:06:44.445993 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:44.445974    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr" event={"ID":"b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e","Type":"ContainerDied","Data":"b9f6c8ea576a23063402692ea11de0a4171e461e837f302ad793cfd138d1c751"}
Sep 07 21:06:47.458958 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:47.458920    2558 generic.go:356] "Generic (PLEG): container finished" podID="b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e" containerID="264223d9dc8696fc24d87e37efdae95b3ec0950fff52df8c35a2a6dcfa1e1a62" exitCode=0
Sep 07 21:06:47.459404 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:47.459001    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr" event={"ID":"b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e","Type":"ContainerDied","Data":"264223d9dc8696fc24d87e37efdae95b3ec0950fff52df8c35a2a6dcfa1e1a62"}
Sep 07 21:06:47.460033 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:47.460016    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 21:06:54.488609 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:54.488574    2558 generic.go:356] "Generic (PLEG): container finished" podID="b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e" containerID="2bc88c3f8d12aee5e488f651ee4c5bd3a8c7696743de49816397c84f63eb3512" exitCode=0
Sep 07 21:06:54.489009 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:54.488652    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr" event={"ID":"b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e","Type":"ContainerDied","Data":"2bc88c3f8d12aee5e488f651ee4c5bd3a8c7696743de49816397c84f63eb3512"}
Sep 07 21:06:55.608698 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:55.608671    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr"
Sep 07 21:06:55.704867 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:55.704834    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e-util\") pod \"b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e\" (UID: \"b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e\") "
Sep 07 21:06:55.704867 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:55.704871    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkq9v\" (UniqueName: \"kubernetes.io/projected/b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e-kube-api-access-gkq9v\") pod \"b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e\" (UID: \"b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e\") "
Sep 07 21:06:55.705046 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:55.704912    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e-bundle\") pod \"b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e\" (UID: \"b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e\") "
Sep 07 21:06:55.705583 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:55.705555    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e-bundle" (OuterVolumeSpecName: "bundle") pod "b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e" (UID: "b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:06:55.707065 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:55.707030    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e-kube-api-access-gkq9v" (OuterVolumeSpecName: "kube-api-access-gkq9v") pod "b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e" (UID: "b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e"). InnerVolumeSpecName "kube-api-access-gkq9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:06:55.709356 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:55.709335    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e-util" (OuterVolumeSpecName: "util") pod "b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e" (UID: "b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:06:55.805576 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:55.805544    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e-bundle\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:06:55.805576 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:55.805574    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e-util\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:06:55.805716 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:55.805585    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkq9v\" (UniqueName: \"kubernetes.io/projected/b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e-kube-api-access-gkq9v\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:06:56.496715 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:56.496675    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr" event={"ID":"b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e","Type":"ContainerDied","Data":"b968aa243e910e5a53418df1c23401963294c6e21ffd1d48798c6d14f40e5058"}
Sep 07 21:06:56.496873 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:56.496731    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b968aa243e910e5a53418df1c23401963294c6e21ffd1d48798c6d14f40e5058"
Sep 07 21:06:56.496873 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:06:56.496695    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7xwr"
Sep 07 21:07:00.574414 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:00.574386    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whbc9"]
Sep 07 21:07:00.574787 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:00.574635    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e" containerName="extract"
Sep 07 21:07:00.574787 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:00.574645    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e" containerName="extract"
Sep 07 21:07:00.574787 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:00.574655    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e" containerName="util"
Sep 07 21:07:00.574787 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:00.574661    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e" containerName="util"
Sep 07 21:07:00.574787 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:00.574668    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e" containerName="pull"
Sep 07 21:07:00.574787 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:00.574673    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e" containerName="pull"
Sep 07 21:07:00.574787 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:00.574717    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b91d5ba3-dbcd-42cf-8bfe-f3b9148b818e" containerName="extract"
Sep 07 21:07:00.577383 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:00.577366    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whbc9"
Sep 07 21:07:00.579523 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:00.579500    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 07 21:07:00.579643 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:00.579500    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-tzpsd\""
Sep 07 21:07:00.579643 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:00.579542    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 07 21:07:00.592795 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:00.592769    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whbc9"]
Sep 07 21:07:00.636535 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:00.636505    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66104095-b2c3-4db2-9cf9-5226ee5c9b9f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-whbc9\" (UID: \"66104095-b2c3-4db2-9cf9-5226ee5c9b9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whbc9"
Sep 07 21:07:00.636694 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:00.636553    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kr4s\" (UniqueName: \"kubernetes.io/projected/66104095-b2c3-4db2-9cf9-5226ee5c9b9f-kube-api-access-7kr4s\") pod \"cert-manager-operator-controller-manager-55c444bf86-whbc9\" (UID: \"66104095-b2c3-4db2-9cf9-5226ee5c9b9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whbc9"
Sep 07 21:07:00.737040 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:00.737008    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66104095-b2c3-4db2-9cf9-5226ee5c9b9f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-whbc9\" (UID: \"66104095-b2c3-4db2-9cf9-5226ee5c9b9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whbc9"
Sep 07 21:07:00.737183 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:00.737056    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kr4s\" (UniqueName: \"kubernetes.io/projected/66104095-b2c3-4db2-9cf9-5226ee5c9b9f-kube-api-access-7kr4s\") pod \"cert-manager-operator-controller-manager-55c444bf86-whbc9\" (UID: \"66104095-b2c3-4db2-9cf9-5226ee5c9b9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whbc9"
Sep 07 21:07:00.737485 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:00.737465    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66104095-b2c3-4db2-9cf9-5226ee5c9b9f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-whbc9\" (UID: \"66104095-b2c3-4db2-9cf9-5226ee5c9b9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whbc9"
Sep 07 21:07:00.745929 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:00.745910    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kr4s\" (UniqueName: \"kubernetes.io/projected/66104095-b2c3-4db2-9cf9-5226ee5c9b9f-kube-api-access-7kr4s\") pod \"cert-manager-operator-controller-manager-55c444bf86-whbc9\" (UID: \"66104095-b2c3-4db2-9cf9-5226ee5c9b9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whbc9"
Sep 07 21:07:00.886781 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:00.886699    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whbc9"
Sep 07 21:07:01.156139 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:01.156068    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whbc9"]
Sep 07 21:07:01.159700 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:07:01.159672    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66104095_b2c3_4db2_9cf9_5226ee5c9b9f.slice/crio-ee0670d812c32910756dceb67ef99597e859c40267c1dea793cfc0bd1221b700 WatchSource:0}: Error finding container ee0670d812c32910756dceb67ef99597e859c40267c1dea793cfc0bd1221b700: Status 404 returned error can't find the container with id ee0670d812c32910756dceb67ef99597e859c40267c1dea793cfc0bd1221b700
Sep 07 21:07:01.516256 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:01.516157    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whbc9" event={"ID":"66104095-b2c3-4db2-9cf9-5226ee5c9b9f","Type":"ContainerStarted","Data":"ee0670d812c32910756dceb67ef99597e859c40267c1dea793cfc0bd1221b700"}
Sep 07 21:07:03.527143 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:03.527110    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whbc9" event={"ID":"66104095-b2c3-4db2-9cf9-5226ee5c9b9f","Type":"ContainerStarted","Data":"1a38607d61dad6fdf09ffe475a9ad03ef21afb4d5097005a625ed2d1afdea4ed"}
Sep 07 21:07:03.547083 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:03.547029    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-whbc9" podStartSLOduration=1.772611682 podStartE2EDuration="3.54701273s" totalImagesPullingTime="1.774401048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:07:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:07:03.546191591 +0000 UTC m=+319.806008845" watchObservedRunningTime="2026-09-07 21:07:03.54701273 +0000 UTC m=+319.806829975"
Sep 07 21:07:04.542273 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:04.542234    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6"]
Sep 07 21:07:04.544617 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:04.544594    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6"
Sep 07 21:07:04.546735 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:04.546715    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 21:07:04.546866 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:04.546719    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 21:07:04.547386 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:04.547370    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gq45v\""
Sep 07 21:07:04.557513 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:04.557490    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6"]
Sep 07 21:07:04.665465 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:04.665411    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41153da6-a10c-4e73-8824-545b28bc9a90-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6\" (UID: \"41153da6-a10c-4e73-8824-545b28bc9a90\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6"
Sep 07 21:07:04.665644 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:04.665517    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41153da6-a10c-4e73-8824-545b28bc9a90-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6\" (UID: \"41153da6-a10c-4e73-8824-545b28bc9a90\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6"
Sep 07 21:07:04.665644 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:04.665564    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jbmb\" (UniqueName: \"kubernetes.io/projected/41153da6-a10c-4e73-8824-545b28bc9a90-kube-api-access-6jbmb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6\" (UID: \"41153da6-a10c-4e73-8824-545b28bc9a90\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6"
Sep 07 21:07:04.766374 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:04.766304    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41153da6-a10c-4e73-8824-545b28bc9a90-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6\" (UID: \"41153da6-a10c-4e73-8824-545b28bc9a90\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6"
Sep 07 21:07:04.766538 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:04.766415    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41153da6-a10c-4e73-8824-545b28bc9a90-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6\" (UID: \"41153da6-a10c-4e73-8824-545b28bc9a90\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6"
Sep 07 21:07:04.766538 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:04.766458    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jbmb\" (UniqueName: \"kubernetes.io/projected/41153da6-a10c-4e73-8824-545b28bc9a90-kube-api-access-6jbmb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6\" (UID: \"41153da6-a10c-4e73-8824-545b28bc9a90\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6"
Sep 07 21:07:04.766712 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:04.766691    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41153da6-a10c-4e73-8824-545b28bc9a90-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6\" (UID: \"41153da6-a10c-4e73-8824-545b28bc9a90\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6"
Sep 07 21:07:04.766747 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:04.766712    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41153da6-a10c-4e73-8824-545b28bc9a90-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6\" (UID: \"41153da6-a10c-4e73-8824-545b28bc9a90\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6"
Sep 07 21:07:04.774807 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:04.774785    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jbmb\" (UniqueName: \"kubernetes.io/projected/41153da6-a10c-4e73-8824-545b28bc9a90-kube-api-access-6jbmb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6\" (UID: \"41153da6-a10c-4e73-8824-545b28bc9a90\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6"
Sep 07 21:07:04.858692 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:04.858670    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6"
Sep 07 21:07:05.125796 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:05.125733    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6"]
Sep 07 21:07:05.128257 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:07:05.128231    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41153da6_a10c_4e73_8824_545b28bc9a90.slice/crio-468ab931c415c2a924c30eebfc749c45ba7e2d45121c6b183257fae8d06f389c WatchSource:0}: Error finding container 468ab931c415c2a924c30eebfc749c45ba7e2d45121c6b183257fae8d06f389c: Status 404 returned error can't find the container with id 468ab931c415c2a924c30eebfc749c45ba7e2d45121c6b183257fae8d06f389c
Sep 07 21:07:05.536408 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:05.536300    2558 generic.go:356] "Generic (PLEG): container finished" podID="41153da6-a10c-4e73-8824-545b28bc9a90" containerID="23899408da03150e7ceff2907e53de96f482a416a4c59f0be8eccc775f1937b8" exitCode=0
Sep 07 21:07:05.536408 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:05.536343    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6" event={"ID":"41153da6-a10c-4e73-8824-545b28bc9a90","Type":"ContainerDied","Data":"23899408da03150e7ceff2907e53de96f482a416a4c59f0be8eccc775f1937b8"}
Sep 07 21:07:05.536408 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:05.536394    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6" event={"ID":"41153da6-a10c-4e73-8824-545b28bc9a90","Type":"ContainerStarted","Data":"468ab931c415c2a924c30eebfc749c45ba7e2d45121c6b183257fae8d06f389c"}
Sep 07 21:07:06.869235 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:06.869194    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5kwf8"]
Sep 07 21:07:06.872531 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:06.872510    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5kwf8"
Sep 07 21:07:06.874742 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:06.874712    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 07 21:07:06.874979 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:06.874962    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 07 21:07:06.875062 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:06.874962    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-f2799\""
Sep 07 21:07:06.881684 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:06.881664    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5kwf8"]
Sep 07 21:07:06.985713 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:06.985679    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vswt\" (UniqueName: \"kubernetes.io/projected/f232c42b-5a66-4040-b497-e21175f9a20c-kube-api-access-8vswt\") pod \"cert-manager-cainjector-559cdd8c87-5kwf8\" (UID: \"f232c42b-5a66-4040-b497-e21175f9a20c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5kwf8"
Sep 07 21:07:06.985882 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:06.985744    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f232c42b-5a66-4040-b497-e21175f9a20c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5kwf8\" (UID: \"f232c42b-5a66-4040-b497-e21175f9a20c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5kwf8"
Sep 07 21:07:07.087178 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:07.087139    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f232c42b-5a66-4040-b497-e21175f9a20c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5kwf8\" (UID: \"f232c42b-5a66-4040-b497-e21175f9a20c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5kwf8"
Sep 07 21:07:07.087375 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:07.087227    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vswt\" (UniqueName: \"kubernetes.io/projected/f232c42b-5a66-4040-b497-e21175f9a20c-kube-api-access-8vswt\") pod \"cert-manager-cainjector-559cdd8c87-5kwf8\" (UID: \"f232c42b-5a66-4040-b497-e21175f9a20c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5kwf8"
Sep 07 21:07:07.095736 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:07.095707    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f232c42b-5a66-4040-b497-e21175f9a20c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5kwf8\" (UID: \"f232c42b-5a66-4040-b497-e21175f9a20c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5kwf8"
Sep 07 21:07:07.095991 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:07.095968    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vswt\" (UniqueName: \"kubernetes.io/projected/f232c42b-5a66-4040-b497-e21175f9a20c-kube-api-access-8vswt\") pod \"cert-manager-cainjector-559cdd8c87-5kwf8\" (UID: \"f232c42b-5a66-4040-b497-e21175f9a20c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5kwf8"
Sep 07 21:07:07.194751 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:07.194662    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5kwf8"
Sep 07 21:07:07.913432 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:07.913409    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5kwf8"]
Sep 07 21:07:07.915649 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:07:07.915625    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf232c42b_5a66_4040_b497_e21175f9a20c.slice/crio-60dc370b6f64b3c4c8672cfeba18ddc3c83223160a84d7ccce541276a230e0be WatchSource:0}: Error finding container 60dc370b6f64b3c4c8672cfeba18ddc3c83223160a84d7ccce541276a230e0be: Status 404 returned error can't find the container with id 60dc370b6f64b3c4c8672cfeba18ddc3c83223160a84d7ccce541276a230e0be
Sep 07 21:07:08.551181 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:08.551150    2558 generic.go:356] "Generic (PLEG): container finished" podID="41153da6-a10c-4e73-8824-545b28bc9a90" containerID="251bb0125ec5887684d8243cd7aa4efd062337dc8487fd7b5ee411c811b8bcc3" exitCode=0
Sep 07 21:07:08.551403 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:08.551221    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6" event={"ID":"41153da6-a10c-4e73-8824-545b28bc9a90","Type":"ContainerDied","Data":"251bb0125ec5887684d8243cd7aa4efd062337dc8487fd7b5ee411c811b8bcc3"}
Sep 07 21:07:08.552378 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:08.552352    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5kwf8" event={"ID":"f232c42b-5a66-4040-b497-e21175f9a20c","Type":"ContainerStarted","Data":"60dc370b6f64b3c4c8672cfeba18ddc3c83223160a84d7ccce541276a230e0be"}
Sep 07 21:07:09.559498 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:09.559460    2558 generic.go:356] "Generic (PLEG): container finished" podID="41153da6-a10c-4e73-8824-545b28bc9a90" containerID="54175ace983fab076c691181f99467cfce2a4328830909ceaf02cf75973ac473" exitCode=0
Sep 07 21:07:09.559896 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:09.559524    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6" event={"ID":"41153da6-a10c-4e73-8824-545b28bc9a90","Type":"ContainerDied","Data":"54175ace983fab076c691181f99467cfce2a4328830909ceaf02cf75973ac473"}
Sep 07 21:07:10.658473 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:10.658444    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zmkfz"]
Sep 07 21:07:10.662883 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:10.662861    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-zmkfz"
Sep 07 21:07:10.665161 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:10.665141    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-wb5lg\""
Sep 07 21:07:10.669855 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:10.669833    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zmkfz"]
Sep 07 21:07:10.698542 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:10.698522    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6"
Sep 07 21:07:10.722416 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:10.722387    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7132faab-9342-4cfc-808e-4e41ce0d9097-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zmkfz\" (UID: \"7132faab-9342-4cfc-808e-4e41ce0d9097\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zmkfz"
Sep 07 21:07:10.722575 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:10.722468    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7q57\" (UniqueName: \"kubernetes.io/projected/7132faab-9342-4cfc-808e-4e41ce0d9097-kube-api-access-j7q57\") pod \"cert-manager-webhook-6486ffd997-zmkfz\" (UID: \"7132faab-9342-4cfc-808e-4e41ce0d9097\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zmkfz"
Sep 07 21:07:10.823467 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:10.823384    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41153da6-a10c-4e73-8824-545b28bc9a90-util\") pod \"41153da6-a10c-4e73-8824-545b28bc9a90\" (UID: \"41153da6-a10c-4e73-8824-545b28bc9a90\") "
Sep 07 21:07:10.823616 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:10.823474    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41153da6-a10c-4e73-8824-545b28bc9a90-bundle\") pod \"41153da6-a10c-4e73-8824-545b28bc9a90\" (UID: \"41153da6-a10c-4e73-8824-545b28bc9a90\") "
Sep 07 21:07:10.823616 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:10.823493    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jbmb\" (UniqueName: \"kubernetes.io/projected/41153da6-a10c-4e73-8824-545b28bc9a90-kube-api-access-6jbmb\") pod \"41153da6-a10c-4e73-8824-545b28bc9a90\" (UID: \"41153da6-a10c-4e73-8824-545b28bc9a90\") "
Sep 07 21:07:10.823616 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:10.823558    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7q57\" (UniqueName: \"kubernetes.io/projected/7132faab-9342-4cfc-808e-4e41ce0d9097-kube-api-access-j7q57\") pod \"cert-manager-webhook-6486ffd997-zmkfz\" (UID: \"7132faab-9342-4cfc-808e-4e41ce0d9097\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zmkfz"
Sep 07 21:07:10.823616 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:10.823597    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7132faab-9342-4cfc-808e-4e41ce0d9097-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zmkfz\" (UID: \"7132faab-9342-4cfc-808e-4e41ce0d9097\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zmkfz"
Sep 07 21:07:10.823861 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:10.823833    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41153da6-a10c-4e73-8824-545b28bc9a90-bundle" (OuterVolumeSpecName: "bundle") pod "41153da6-a10c-4e73-8824-545b28bc9a90" (UID: "41153da6-a10c-4e73-8824-545b28bc9a90"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:07:10.825781 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:10.825756    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41153da6-a10c-4e73-8824-545b28bc9a90-kube-api-access-6jbmb" (OuterVolumeSpecName: "kube-api-access-6jbmb") pod "41153da6-a10c-4e73-8824-545b28bc9a90" (UID: "41153da6-a10c-4e73-8824-545b28bc9a90"). InnerVolumeSpecName "kube-api-access-6jbmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:07:10.828005 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:10.827980    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41153da6-a10c-4e73-8824-545b28bc9a90-util" (OuterVolumeSpecName: "util") pod "41153da6-a10c-4e73-8824-545b28bc9a90" (UID: "41153da6-a10c-4e73-8824-545b28bc9a90"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:07:10.832120 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:10.832098    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7132faab-9342-4cfc-808e-4e41ce0d9097-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zmkfz\" (UID: \"7132faab-9342-4cfc-808e-4e41ce0d9097\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zmkfz"
Sep 07 21:07:10.832300 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:10.832279    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7q57\" (UniqueName: \"kubernetes.io/projected/7132faab-9342-4cfc-808e-4e41ce0d9097-kube-api-access-j7q57\") pod \"cert-manager-webhook-6486ffd997-zmkfz\" (UID: \"7132faab-9342-4cfc-808e-4e41ce0d9097\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zmkfz"
Sep 07 21:07:10.924424 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:10.924389    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41153da6-a10c-4e73-8824-545b28bc9a90-bundle\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:07:10.924424 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:10.924420    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jbmb\" (UniqueName: \"kubernetes.io/projected/41153da6-a10c-4e73-8824-545b28bc9a90-kube-api-access-6jbmb\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:07:10.924597 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:10.924433    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41153da6-a10c-4e73-8824-545b28bc9a90-util\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:07:10.994533 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:10.994494    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-zmkfz"
Sep 07 21:07:11.263711 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:11.263689    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zmkfz"]
Sep 07 21:07:11.266181 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:07:11.266155    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7132faab_9342_4cfc_808e_4e41ce0d9097.slice/crio-f72ced6a16792ee0a277a2110fc8104e567b2660a3a0c664cd899e67d7428731 WatchSource:0}: Error finding container f72ced6a16792ee0a277a2110fc8104e567b2660a3a0c664cd899e67d7428731: Status 404 returned error can't find the container with id f72ced6a16792ee0a277a2110fc8104e567b2660a3a0c664cd899e67d7428731
Sep 07 21:07:11.569583 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:11.569554    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6"
Sep 07 21:07:11.569745 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:11.569554    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7q6p6" event={"ID":"41153da6-a10c-4e73-8824-545b28bc9a90","Type":"ContainerDied","Data":"468ab931c415c2a924c30eebfc749c45ba7e2d45121c6b183257fae8d06f389c"}
Sep 07 21:07:11.569745 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:11.569680    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="468ab931c415c2a924c30eebfc749c45ba7e2d45121c6b183257fae8d06f389c"
Sep 07 21:07:11.571052 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:11.571025    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5kwf8" event={"ID":"f232c42b-5a66-4040-b497-e21175f9a20c","Type":"ContainerStarted","Data":"9cdbba23c33096d388b1531baeabb84ad41912fd8cc6f506fafd7148efbdef36"}
Sep 07 21:07:11.572424 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:11.572403    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-zmkfz" event={"ID":"7132faab-9342-4cfc-808e-4e41ce0d9097","Type":"ContainerStarted","Data":"d2f9ee35e7b385c2c43d5773995c05e76f6e30d3448c0a17463c0efcb21bcd4c"}
Sep 07 21:07:11.572537 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:11.572433    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-zmkfz" event={"ID":"7132faab-9342-4cfc-808e-4e41ce0d9097","Type":"ContainerStarted","Data":"f72ced6a16792ee0a277a2110fc8104e567b2660a3a0c664cd899e67d7428731"}
Sep 07 21:07:11.572537 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:11.572522    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-zmkfz"
Sep 07 21:07:11.586084 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:11.586042    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5kwf8" podStartSLOduration=2.868682867 podStartE2EDuration="5.586030417s" totalImagesPullingTime="2.71734755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:07:11.585118162 +0000 UTC m=+327.844935405" watchObservedRunningTime="2026-09-07 21:07:11.586030417 +0000 UTC m=+327.845847659"
Sep 07 21:07:11.605020 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:11.604977    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-zmkfz" podStartSLOduration=1.604966447 podStartE2EDuration="1.604966447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:07:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:07:11.604071772 +0000 UTC m=+327.863889034" watchObservedRunningTime="2026-09-07 21:07:11.604966447 +0000 UTC m=+327.864783690"
Sep 07 21:07:17.578926 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:17.578894    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-zmkfz"
Sep 07 21:07:24.680483 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:24.680449    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9"]
Sep 07 21:07:24.681023 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:24.680827    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41153da6-a10c-4e73-8824-545b28bc9a90" containerName="pull"
Sep 07 21:07:24.681023 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:24.680845    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="41153da6-a10c-4e73-8824-545b28bc9a90" containerName="pull"
Sep 07 21:07:24.681023 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:24.680856    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41153da6-a10c-4e73-8824-545b28bc9a90" containerName="extract"
Sep 07 21:07:24.681023 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:24.680864    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="41153da6-a10c-4e73-8824-545b28bc9a90" containerName="extract"
Sep 07 21:07:24.681023 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:24.680884    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41153da6-a10c-4e73-8824-545b28bc9a90" containerName="util"
Sep 07 21:07:24.681023 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:24.680892    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="41153da6-a10c-4e73-8824-545b28bc9a90" containerName="util"
Sep 07 21:07:24.681023 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:24.680964    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="41153da6-a10c-4e73-8824-545b28bc9a90" containerName="extract"
Sep 07 21:07:24.758621 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:24.758587    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9"]
Sep 07 21:07:24.758762 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:24.758704    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9"
Sep 07 21:07:24.761152 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:24.761123    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 21:07:24.761297 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:24.761131    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gq45v\""
Sep 07 21:07:24.761753 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:24.761739    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 21:07:24.931084 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:24.931007    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b2c6057-1819-4a9c-af10-2bb00a8007ba-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9\" (UID: \"4b2c6057-1819-4a9c-af10-2bb00a8007ba\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9"
Sep 07 21:07:24.931084 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:24.931040    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b2c6057-1819-4a9c-af10-2bb00a8007ba-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9\" (UID: \"4b2c6057-1819-4a9c-af10-2bb00a8007ba\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9"
Sep 07 21:07:24.931084 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:24.931064    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg2v2\" (UniqueName: \"kubernetes.io/projected/4b2c6057-1819-4a9c-af10-2bb00a8007ba-kube-api-access-jg2v2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9\" (UID: \"4b2c6057-1819-4a9c-af10-2bb00a8007ba\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9"
Sep 07 21:07:25.032347 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:25.032305    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b2c6057-1819-4a9c-af10-2bb00a8007ba-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9\" (UID: \"4b2c6057-1819-4a9c-af10-2bb00a8007ba\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9"
Sep 07 21:07:25.032347 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:25.032350    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b2c6057-1819-4a9c-af10-2bb00a8007ba-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9\" (UID: \"4b2c6057-1819-4a9c-af10-2bb00a8007ba\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9"
Sep 07 21:07:25.032553 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:25.032471    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg2v2\" (UniqueName: \"kubernetes.io/projected/4b2c6057-1819-4a9c-af10-2bb00a8007ba-kube-api-access-jg2v2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9\" (UID: \"4b2c6057-1819-4a9c-af10-2bb00a8007ba\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9"
Sep 07 21:07:25.032658 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:25.032643    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b2c6057-1819-4a9c-af10-2bb00a8007ba-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9\" (UID: \"4b2c6057-1819-4a9c-af10-2bb00a8007ba\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9"
Sep 07 21:07:25.032696 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:25.032673    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b2c6057-1819-4a9c-af10-2bb00a8007ba-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9\" (UID: \"4b2c6057-1819-4a9c-af10-2bb00a8007ba\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9"
Sep 07 21:07:25.039930 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:25.039906    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg2v2\" (UniqueName: \"kubernetes.io/projected/4b2c6057-1819-4a9c-af10-2bb00a8007ba-kube-api-access-jg2v2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9\" (UID: \"4b2c6057-1819-4a9c-af10-2bb00a8007ba\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9"
Sep 07 21:07:25.068761 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:25.068740    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9"
Sep 07 21:07:25.353126 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:25.353076    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9"]
Sep 07 21:07:25.355204 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:07:25.355176    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b2c6057_1819_4a9c_af10_2bb00a8007ba.slice/crio-a88c4e7bd7955e24aa7c2d89b2fa79f60fb5a8b9b11bc35b24de0bff312183c7 WatchSource:0}: Error finding container a88c4e7bd7955e24aa7c2d89b2fa79f60fb5a8b9b11bc35b24de0bff312183c7: Status 404 returned error can't find the container with id a88c4e7bd7955e24aa7c2d89b2fa79f60fb5a8b9b11bc35b24de0bff312183c7
Sep 07 21:07:25.628665 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:25.628581    2558 generic.go:356] "Generic (PLEG): container finished" podID="4b2c6057-1819-4a9c-af10-2bb00a8007ba" containerID="16300fa95574e855127ef8c03ac78a2f948c346a9546654e1b55376b30006f22" exitCode=0
Sep 07 21:07:25.628665 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:25.628650    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9" event={"ID":"4b2c6057-1819-4a9c-af10-2bb00a8007ba","Type":"ContainerDied","Data":"16300fa95574e855127ef8c03ac78a2f948c346a9546654e1b55376b30006f22"}
Sep 07 21:07:25.628856 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:25.628686    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9" event={"ID":"4b2c6057-1819-4a9c-af10-2bb00a8007ba","Type":"ContainerStarted","Data":"a88c4e7bd7955e24aa7c2d89b2fa79f60fb5a8b9b11bc35b24de0bff312183c7"}
Sep 07 21:07:26.639433 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:26.639397    2558 generic.go:356] "Generic (PLEG): container finished" podID="4b2c6057-1819-4a9c-af10-2bb00a8007ba" containerID="8582232e0028bddea94923123f6eb8764db04d85fd6a47183c5572082353d070" exitCode=0
Sep 07 21:07:26.639433 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:26.639434    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9" event={"ID":"4b2c6057-1819-4a9c-af10-2bb00a8007ba","Type":"ContainerDied","Data":"8582232e0028bddea94923123f6eb8764db04d85fd6a47183c5572082353d070"}
Sep 07 21:07:27.645884 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:27.645845    2558 generic.go:356] "Generic (PLEG): container finished" podID="4b2c6057-1819-4a9c-af10-2bb00a8007ba" containerID="4dee1a11c5017b2359ee4f0f87e6526893efe4eb79aebdbee1bd49a3e00b733a" exitCode=0
Sep 07 21:07:27.646281 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:27.645937    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9" event={"ID":"4b2c6057-1819-4a9c-af10-2bb00a8007ba","Type":"ContainerDied","Data":"4dee1a11c5017b2359ee4f0f87e6526893efe4eb79aebdbee1bd49a3e00b733a"}
Sep 07 21:07:28.778336 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:28.778299    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9"
Sep 07 21:07:28.865399 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:28.865372    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b2c6057-1819-4a9c-af10-2bb00a8007ba-bundle\") pod \"4b2c6057-1819-4a9c-af10-2bb00a8007ba\" (UID: \"4b2c6057-1819-4a9c-af10-2bb00a8007ba\") "
Sep 07 21:07:28.865521 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:28.865446    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg2v2\" (UniqueName: \"kubernetes.io/projected/4b2c6057-1819-4a9c-af10-2bb00a8007ba-kube-api-access-jg2v2\") pod \"4b2c6057-1819-4a9c-af10-2bb00a8007ba\" (UID: \"4b2c6057-1819-4a9c-af10-2bb00a8007ba\") "
Sep 07 21:07:28.865521 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:28.865498    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b2c6057-1819-4a9c-af10-2bb00a8007ba-util\") pod \"4b2c6057-1819-4a9c-af10-2bb00a8007ba\" (UID: \"4b2c6057-1819-4a9c-af10-2bb00a8007ba\") "
Sep 07 21:07:28.866129 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:28.866102    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b2c6057-1819-4a9c-af10-2bb00a8007ba-bundle" (OuterVolumeSpecName: "bundle") pod "4b2c6057-1819-4a9c-af10-2bb00a8007ba" (UID: "4b2c6057-1819-4a9c-af10-2bb00a8007ba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:07:28.867577 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:28.867553    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b2c6057-1819-4a9c-af10-2bb00a8007ba-kube-api-access-jg2v2" (OuterVolumeSpecName: "kube-api-access-jg2v2") pod "4b2c6057-1819-4a9c-af10-2bb00a8007ba" (UID: "4b2c6057-1819-4a9c-af10-2bb00a8007ba"). InnerVolumeSpecName "kube-api-access-jg2v2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:07:28.870949 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:28.870927    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b2c6057-1819-4a9c-af10-2bb00a8007ba-util" (OuterVolumeSpecName: "util") pod "4b2c6057-1819-4a9c-af10-2bb00a8007ba" (UID: "4b2c6057-1819-4a9c-af10-2bb00a8007ba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:07:28.967039 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:28.966959    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg2v2\" (UniqueName: \"kubernetes.io/projected/4b2c6057-1819-4a9c-af10-2bb00a8007ba-kube-api-access-jg2v2\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:07:28.967039 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:28.966990    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b2c6057-1819-4a9c-af10-2bb00a8007ba-util\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:07:28.967039 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:28.966999    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b2c6057-1819-4a9c-af10-2bb00a8007ba-bundle\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:07:29.656211 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:29.656185    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9"
Sep 07 21:07:29.656211 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:29.656186    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6xzs9" event={"ID":"4b2c6057-1819-4a9c-af10-2bb00a8007ba","Type":"ContainerDied","Data":"a88c4e7bd7955e24aa7c2d89b2fa79f60fb5a8b9b11bc35b24de0bff312183c7"}
Sep 07 21:07:29.656435 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:29.656234    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a88c4e7bd7955e24aa7c2d89b2fa79f60fb5a8b9b11bc35b24de0bff312183c7"
Sep 07 21:07:40.483279 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.483201    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q"]
Sep 07 21:07:40.483649 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.483508    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b2c6057-1819-4a9c-af10-2bb00a8007ba" containerName="extract"
Sep 07 21:07:40.483649 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.483521    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b2c6057-1819-4a9c-af10-2bb00a8007ba" containerName="extract"
Sep 07 21:07:40.483649 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.483531    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b2c6057-1819-4a9c-af10-2bb00a8007ba" containerName="util"
Sep 07 21:07:40.483649 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.483539    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b2c6057-1819-4a9c-af10-2bb00a8007ba" containerName="util"
Sep 07 21:07:40.483649 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.483547    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b2c6057-1819-4a9c-af10-2bb00a8007ba" containerName="pull"
Sep 07 21:07:40.483649 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.483552    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b2c6057-1819-4a9c-af10-2bb00a8007ba" containerName="pull"
Sep 07 21:07:40.483649 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.483594    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b2c6057-1819-4a9c-af10-2bb00a8007ba" containerName="extract"
Sep 07 21:07:40.485807 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.485790    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q"
Sep 07 21:07:40.487973 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.487955    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 21:07:40.488047 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.488009    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 21:07:40.488096 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.488077    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gq45v\""
Sep 07 21:07:40.496718 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.496695    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q"]
Sep 07 21:07:40.551979 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.551945    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/023c47d1-b5c9-4646-8f02-9ebf04126872-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q\" (UID: \"023c47d1-b5c9-4646-8f02-9ebf04126872\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q"
Sep 07 21:07:40.552154 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.551991    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/023c47d1-b5c9-4646-8f02-9ebf04126872-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q\" (UID: \"023c47d1-b5c9-4646-8f02-9ebf04126872\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q"
Sep 07 21:07:40.552154 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.552032    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn8ns\" (UniqueName: \"kubernetes.io/projected/023c47d1-b5c9-4646-8f02-9ebf04126872-kube-api-access-nn8ns\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q\" (UID: \"023c47d1-b5c9-4646-8f02-9ebf04126872\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q"
Sep 07 21:07:40.653008 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.652976    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/023c47d1-b5c9-4646-8f02-9ebf04126872-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q\" (UID: \"023c47d1-b5c9-4646-8f02-9ebf04126872\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q"
Sep 07 21:07:40.653179 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.653018    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/023c47d1-b5c9-4646-8f02-9ebf04126872-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q\" (UID: \"023c47d1-b5c9-4646-8f02-9ebf04126872\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q"
Sep 07 21:07:40.653179 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.653052    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn8ns\" (UniqueName: \"kubernetes.io/projected/023c47d1-b5c9-4646-8f02-9ebf04126872-kube-api-access-nn8ns\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q\" (UID: \"023c47d1-b5c9-4646-8f02-9ebf04126872\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q"
Sep 07 21:07:40.653408 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.653386    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/023c47d1-b5c9-4646-8f02-9ebf04126872-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q\" (UID: \"023c47d1-b5c9-4646-8f02-9ebf04126872\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q"
Sep 07 21:07:40.653448 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.653398    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/023c47d1-b5c9-4646-8f02-9ebf04126872-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q\" (UID: \"023c47d1-b5c9-4646-8f02-9ebf04126872\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q"
Sep 07 21:07:40.662417 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.662390    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn8ns\" (UniqueName: \"kubernetes.io/projected/023c47d1-b5c9-4646-8f02-9ebf04126872-kube-api-access-nn8ns\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q\" (UID: \"023c47d1-b5c9-4646-8f02-9ebf04126872\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q"
Sep 07 21:07:40.795134 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:40.795043    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q"
Sep 07 21:07:41.065828 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.065801    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q"]
Sep 07 21:07:41.067784 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:07:41.067756    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023c47d1_b5c9_4646_8f02_9ebf04126872.slice/crio-bb5f67580698626b15216ca2f62ea5e28767bceec52d869232f5b89e887cf56e WatchSource:0}: Error finding container bb5f67580698626b15216ca2f62ea5e28767bceec52d869232f5b89e887cf56e: Status 404 returned error can't find the container with id bb5f67580698626b15216ca2f62ea5e28767bceec52d869232f5b89e887cf56e
Sep 07 21:07:41.445633 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.445554    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx"]
Sep 07 21:07:41.451581 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.451552    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx"
Sep 07 21:07:41.453897 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.453872    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 07 21:07:41.454031 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.453917    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wgpwk\""
Sep 07 21:07:41.454152 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.454129    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 07 21:07:41.454441 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.454331    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 07 21:07:41.454512 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.454451    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 07 21:07:41.457783 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.457757    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6kwk\" (UniqueName: \"kubernetes.io/projected/387267bb-8c85-48ed-89f9-b6ecc8580e99-kube-api-access-b6kwk\") pod \"opendatahub-operator-controller-manager-56489b9975-l2tfx\" (UID: \"387267bb-8c85-48ed-89f9-b6ecc8580e99\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx"
Sep 07 21:07:41.457875 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.457799    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/387267bb-8c85-48ed-89f9-b6ecc8580e99-manifests\") pod \"opendatahub-operator-controller-manager-56489b9975-l2tfx\" (UID: \"387267bb-8c85-48ed-89f9-b6ecc8580e99\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx"
Sep 07 21:07:41.457875 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.457830    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/387267bb-8c85-48ed-89f9-b6ecc8580e99-tmp\") pod \"opendatahub-operator-controller-manager-56489b9975-l2tfx\" (UID: \"387267bb-8c85-48ed-89f9-b6ecc8580e99\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx"
Sep 07 21:07:41.457875 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.457866    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/387267bb-8c85-48ed-89f9-b6ecc8580e99-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56489b9975-l2tfx\" (UID: \"387267bb-8c85-48ed-89f9-b6ecc8580e99\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx"
Sep 07 21:07:41.458009 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.457900    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/387267bb-8c85-48ed-89f9-b6ecc8580e99-webhook-cert\") pod \"opendatahub-operator-controller-manager-56489b9975-l2tfx\" (UID: \"387267bb-8c85-48ed-89f9-b6ecc8580e99\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx"
Sep 07 21:07:41.465879 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.465852    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx"]
Sep 07 21:07:41.558930 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.558898    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/387267bb-8c85-48ed-89f9-b6ecc8580e99-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56489b9975-l2tfx\" (UID: \"387267bb-8c85-48ed-89f9-b6ecc8580e99\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx"
Sep 07 21:07:41.558930 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.558938    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/387267bb-8c85-48ed-89f9-b6ecc8580e99-webhook-cert\") pod \"opendatahub-operator-controller-manager-56489b9975-l2tfx\" (UID: \"387267bb-8c85-48ed-89f9-b6ecc8580e99\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx"
Sep 07 21:07:41.559472 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.558983    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6kwk\" (UniqueName: \"kubernetes.io/projected/387267bb-8c85-48ed-89f9-b6ecc8580e99-kube-api-access-b6kwk\") pod \"opendatahub-operator-controller-manager-56489b9975-l2tfx\" (UID: \"387267bb-8c85-48ed-89f9-b6ecc8580e99\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx"
Sep 07 21:07:41.559472 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.559002    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/387267bb-8c85-48ed-89f9-b6ecc8580e99-manifests\") pod \"opendatahub-operator-controller-manager-56489b9975-l2tfx\" (UID: \"387267bb-8c85-48ed-89f9-b6ecc8580e99\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx"
Sep 07 21:07:41.559472 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.559020    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/387267bb-8c85-48ed-89f9-b6ecc8580e99-tmp\") pod \"opendatahub-operator-controller-manager-56489b9975-l2tfx\" (UID: \"387267bb-8c85-48ed-89f9-b6ecc8580e99\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx"
Sep 07 21:07:41.559574 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.559540    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/387267bb-8c85-48ed-89f9-b6ecc8580e99-manifests\") pod \"opendatahub-operator-controller-manager-56489b9975-l2tfx\" (UID: \"387267bb-8c85-48ed-89f9-b6ecc8580e99\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx"
Sep 07 21:07:41.561389 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.561365    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/387267bb-8c85-48ed-89f9-b6ecc8580e99-tmp\") pod \"opendatahub-operator-controller-manager-56489b9975-l2tfx\" (UID: \"387267bb-8c85-48ed-89f9-b6ecc8580e99\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx"
Sep 07 21:07:41.561492 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.561450    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/387267bb-8c85-48ed-89f9-b6ecc8580e99-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56489b9975-l2tfx\" (UID: \"387267bb-8c85-48ed-89f9-b6ecc8580e99\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx"
Sep 07 21:07:41.561557 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.561526    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/387267bb-8c85-48ed-89f9-b6ecc8580e99-webhook-cert\") pod \"opendatahub-operator-controller-manager-56489b9975-l2tfx\" (UID: \"387267bb-8c85-48ed-89f9-b6ecc8580e99\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx"
Sep 07 21:07:41.572840 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.572818    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6kwk\" (UniqueName: \"kubernetes.io/projected/387267bb-8c85-48ed-89f9-b6ecc8580e99-kube-api-access-b6kwk\") pod \"opendatahub-operator-controller-manager-56489b9975-l2tfx\" (UID: \"387267bb-8c85-48ed-89f9-b6ecc8580e99\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx"
Sep 07 21:07:41.709201 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.709101    2558 generic.go:356] "Generic (PLEG): container finished" podID="023c47d1-b5c9-4646-8f02-9ebf04126872" containerID="593dbfc5b84daeb96e63b138fb9dbb224aa68f5faed143e87833f78d90521df3" exitCode=0
Sep 07 21:07:41.709201 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.709157    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q" event={"ID":"023c47d1-b5c9-4646-8f02-9ebf04126872","Type":"ContainerDied","Data":"593dbfc5b84daeb96e63b138fb9dbb224aa68f5faed143e87833f78d90521df3"}
Sep 07 21:07:41.709201 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.709200    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q" event={"ID":"023c47d1-b5c9-4646-8f02-9ebf04126872","Type":"ContainerStarted","Data":"bb5f67580698626b15216ca2f62ea5e28767bceec52d869232f5b89e887cf56e"}
Sep 07 21:07:41.761723 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:41.761685    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx"
Sep 07 21:07:42.034916 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:42.034888    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx"]
Sep 07 21:07:42.037679 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:07:42.037647    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod387267bb_8c85_48ed_89f9_b6ecc8580e99.slice/crio-3c5dcbc78be59762440c8e94f0afd4d4996281472d355c91a14a6e7666edc9c4 WatchSource:0}: Error finding container 3c5dcbc78be59762440c8e94f0afd4d4996281472d355c91a14a6e7666edc9c4: Status 404 returned error can't find the container with id 3c5dcbc78be59762440c8e94f0afd4d4996281472d355c91a14a6e7666edc9c4
Sep 07 21:07:42.717027 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:42.716971    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx" event={"ID":"387267bb-8c85-48ed-89f9-b6ecc8580e99","Type":"ContainerStarted","Data":"3c5dcbc78be59762440c8e94f0afd4d4996281472d355c91a14a6e7666edc9c4"}
Sep 07 21:07:42.719972 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:42.719845    2558 generic.go:356] "Generic (PLEG): container finished" podID="023c47d1-b5c9-4646-8f02-9ebf04126872" containerID="2f80a9c496fe99840b8f2df1ad106bcc0b9b085bde185c3e9a554402272aa3a9" exitCode=0
Sep 07 21:07:42.719972 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:42.719930    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q" event={"ID":"023c47d1-b5c9-4646-8f02-9ebf04126872","Type":"ContainerDied","Data":"2f80a9c496fe99840b8f2df1ad106bcc0b9b085bde185c3e9a554402272aa3a9"}
Sep 07 21:07:43.727899 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:43.727858    2558 generic.go:356] "Generic (PLEG): container finished" podID="023c47d1-b5c9-4646-8f02-9ebf04126872" containerID="749b9600d6826f95ab1674fcb65f4932c2a0fcd24aa11ce8b3a515bbbc2b62b5" exitCode=0
Sep 07 21:07:43.728297 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:43.727922    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q" event={"ID":"023c47d1-b5c9-4646-8f02-9ebf04126872","Type":"ContainerDied","Data":"749b9600d6826f95ab1674fcb65f4932c2a0fcd24aa11ce8b3a515bbbc2b62b5"}
Sep 07 21:07:44.995277 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:44.995246    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q"
Sep 07 21:07:45.083672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:45.083647    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nn8ns\" (UniqueName: \"kubernetes.io/projected/023c47d1-b5c9-4646-8f02-9ebf04126872-kube-api-access-nn8ns\") pod \"023c47d1-b5c9-4646-8f02-9ebf04126872\" (UID: \"023c47d1-b5c9-4646-8f02-9ebf04126872\") "
Sep 07 21:07:45.083775 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:45.083685    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/023c47d1-b5c9-4646-8f02-9ebf04126872-bundle\") pod \"023c47d1-b5c9-4646-8f02-9ebf04126872\" (UID: \"023c47d1-b5c9-4646-8f02-9ebf04126872\") "
Sep 07 21:07:45.083775 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:45.083731    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/023c47d1-b5c9-4646-8f02-9ebf04126872-util\") pod \"023c47d1-b5c9-4646-8f02-9ebf04126872\" (UID: \"023c47d1-b5c9-4646-8f02-9ebf04126872\") "
Sep 07 21:07:45.084371 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:45.084341    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/023c47d1-b5c9-4646-8f02-9ebf04126872-bundle" (OuterVolumeSpecName: "bundle") pod "023c47d1-b5c9-4646-8f02-9ebf04126872" (UID: "023c47d1-b5c9-4646-8f02-9ebf04126872"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:07:45.085603 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:45.085580    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/023c47d1-b5c9-4646-8f02-9ebf04126872-kube-api-access-nn8ns" (OuterVolumeSpecName: "kube-api-access-nn8ns") pod "023c47d1-b5c9-4646-8f02-9ebf04126872" (UID: "023c47d1-b5c9-4646-8f02-9ebf04126872"). InnerVolumeSpecName "kube-api-access-nn8ns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:07:45.088971 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:45.088931    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/023c47d1-b5c9-4646-8f02-9ebf04126872-util" (OuterVolumeSpecName: "util") pod "023c47d1-b5c9-4646-8f02-9ebf04126872" (UID: "023c47d1-b5c9-4646-8f02-9ebf04126872"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:07:45.184689 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:45.184658    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/023c47d1-b5c9-4646-8f02-9ebf04126872-util\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:07:45.184689 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:45.184683    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nn8ns\" (UniqueName: \"kubernetes.io/projected/023c47d1-b5c9-4646-8f02-9ebf04126872-kube-api-access-nn8ns\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:07:45.184689 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:45.184693    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/023c47d1-b5c9-4646-8f02-9ebf04126872-bundle\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:07:45.738007 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:45.737970    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx" event={"ID":"387267bb-8c85-48ed-89f9-b6ecc8580e99","Type":"ContainerStarted","Data":"29f7dee21885f9fc56f31d7f2a55f3baa7f71a456593f9671216b927e18a498b"}
Sep 07 21:07:45.740010 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:45.739983    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q" event={"ID":"023c47d1-b5c9-4646-8f02-9ebf04126872","Type":"ContainerDied","Data":"bb5f67580698626b15216ca2f62ea5e28767bceec52d869232f5b89e887cf56e"}
Sep 07 21:07:45.740101 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:45.740019    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cjt2q"
Sep 07 21:07:45.740101 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:45.740021    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb5f67580698626b15216ca2f62ea5e28767bceec52d869232f5b89e887cf56e"
Sep 07 21:07:46.745324 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:46.745272    2558 generic.go:356] "Generic (PLEG): container finished" podID="387267bb-8c85-48ed-89f9-b6ecc8580e99" containerID="29f7dee21885f9fc56f31d7f2a55f3baa7f71a456593f9671216b927e18a498b" exitCode=0
Sep 07 21:07:46.745734 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:46.745363    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx" event={"ID":"387267bb-8c85-48ed-89f9-b6ecc8580e99","Type":"ContainerDied","Data":"29f7dee21885f9fc56f31d7f2a55f3baa7f71a456593f9671216b927e18a498b"}
Sep 07 21:07:47.753852 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:47.753821    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx" event={"ID":"387267bb-8c85-48ed-89f9-b6ecc8580e99","Type":"ContainerStarted","Data":"d6a925a1832dfbb2aa5180835a9d5fbd9375aeaf0bde88996ca467c3f9532c23"}
Sep 07 21:07:47.754219 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:47.753930    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx"
Sep 07 21:07:47.777027 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:47.776940    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx" podStartSLOduration=2.305191411 podStartE2EDuration="6.77692643s" totalImagesPullingTime="3.398566173s" totalInitContainerRuntime="1.073168846s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:07:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:07:47.775834547 +0000 UTC m=+364.035651801" watchObservedRunningTime="2026-09-07 21:07:47.77692643 +0000 UTC m=+364.036743673"
Sep 07 21:07:58.765144 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:07:58.765114    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-l2tfx"
Sep 07 21:08:00.826676 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:00.826644    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-58b8d644dc-6cm72"]
Sep 07 21:08:00.827034 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:00.826950    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="023c47d1-b5c9-4646-8f02-9ebf04126872" containerName="extract"
Sep 07 21:08:00.827034 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:00.826961    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="023c47d1-b5c9-4646-8f02-9ebf04126872" containerName="extract"
Sep 07 21:08:00.827034 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:00.826973    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="023c47d1-b5c9-4646-8f02-9ebf04126872" containerName="pull"
Sep 07 21:08:00.827034 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:00.826978    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="023c47d1-b5c9-4646-8f02-9ebf04126872" containerName="pull"
Sep 07 21:08:00.827034 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:00.826990    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="023c47d1-b5c9-4646-8f02-9ebf04126872" containerName="util"
Sep 07 21:08:00.827034 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:00.826995    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="023c47d1-b5c9-4646-8f02-9ebf04126872" containerName="util"
Sep 07 21:08:00.827217 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:00.827047    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="023c47d1-b5c9-4646-8f02-9ebf04126872" containerName="extract"
Sep 07 21:08:00.836284 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:00.836261    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58b8d644dc-6cm72"
Sep 07 21:08:00.840488 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:00.840457    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 07 21:08:00.843463 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:00.843438    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 07 21:08:00.843991 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:00.843967    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-t6cx2\""
Sep 07 21:08:00.844077 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:00.844000    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 07 21:08:00.845891 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:00.845874    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 07 21:08:00.853925 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:00.853903    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58b8d644dc-6cm72"]
Sep 07 21:08:00.889713 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:00.889684    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b82ae09f-78de-4419-a2d5-12e058c42486-tls-certs\") pod \"kube-auth-proxy-58b8d644dc-6cm72\" (UID: \"b82ae09f-78de-4419-a2d5-12e058c42486\") " pod="openshift-ingress/kube-auth-proxy-58b8d644dc-6cm72"
Sep 07 21:08:00.889713 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:00.889710    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b82ae09f-78de-4419-a2d5-12e058c42486-tmp\") pod \"kube-auth-proxy-58b8d644dc-6cm72\" (UID: \"b82ae09f-78de-4419-a2d5-12e058c42486\") " pod="openshift-ingress/kube-auth-proxy-58b8d644dc-6cm72"
Sep 07 21:08:00.889887 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:00.889751    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l9th\" (UniqueName: \"kubernetes.io/projected/b82ae09f-78de-4419-a2d5-12e058c42486-kube-api-access-7l9th\") pod \"kube-auth-proxy-58b8d644dc-6cm72\" (UID: \"b82ae09f-78de-4419-a2d5-12e058c42486\") " pod="openshift-ingress/kube-auth-proxy-58b8d644dc-6cm72"
Sep 07 21:08:00.991078 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:00.991044    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b82ae09f-78de-4419-a2d5-12e058c42486-tls-certs\") pod \"kube-auth-proxy-58b8d644dc-6cm72\" (UID: \"b82ae09f-78de-4419-a2d5-12e058c42486\") " pod="openshift-ingress/kube-auth-proxy-58b8d644dc-6cm72"
Sep 07 21:08:00.991078 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:00.991077    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b82ae09f-78de-4419-a2d5-12e058c42486-tmp\") pod \"kube-auth-proxy-58b8d644dc-6cm72\" (UID: \"b82ae09f-78de-4419-a2d5-12e058c42486\") " pod="openshift-ingress/kube-auth-proxy-58b8d644dc-6cm72"
Sep 07 21:08:00.991358 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:00.991113    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l9th\" (UniqueName: \"kubernetes.io/projected/b82ae09f-78de-4419-a2d5-12e058c42486-kube-api-access-7l9th\") pod \"kube-auth-proxy-58b8d644dc-6cm72\" (UID: \"b82ae09f-78de-4419-a2d5-12e058c42486\") " pod="openshift-ingress/kube-auth-proxy-58b8d644dc-6cm72"
Sep 07 21:08:00.991358 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:08:00.991204    2558 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 07 21:08:00.991358 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:08:00.991290    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b82ae09f-78de-4419-a2d5-12e058c42486-tls-certs podName:b82ae09f-78de-4419-a2d5-12e058c42486 nodeName:}" failed. No retries permitted until 2026-09-07 21:08:01.491269105 +0000 UTC m=+377.751086339 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b82ae09f-78de-4419-a2d5-12e058c42486-tls-certs") pod "kube-auth-proxy-58b8d644dc-6cm72" (UID: "b82ae09f-78de-4419-a2d5-12e058c42486") : secret "kube-auth-proxy-tls" not found
Sep 07 21:08:00.993353 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:00.993324    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b82ae09f-78de-4419-a2d5-12e058c42486-tmp\") pod \"kube-auth-proxy-58b8d644dc-6cm72\" (UID: \"b82ae09f-78de-4419-a2d5-12e058c42486\") " pod="openshift-ingress/kube-auth-proxy-58b8d644dc-6cm72"
Sep 07 21:08:01.000722 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:01.000701    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l9th\" (UniqueName: \"kubernetes.io/projected/b82ae09f-78de-4419-a2d5-12e058c42486-kube-api-access-7l9th\") pod \"kube-auth-proxy-58b8d644dc-6cm72\" (UID: \"b82ae09f-78de-4419-a2d5-12e058c42486\") " pod="openshift-ingress/kube-auth-proxy-58b8d644dc-6cm72"
Sep 07 21:08:01.495548 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:01.495508    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b82ae09f-78de-4419-a2d5-12e058c42486-tls-certs\") pod \"kube-auth-proxy-58b8d644dc-6cm72\" (UID: \"b82ae09f-78de-4419-a2d5-12e058c42486\") " pod="openshift-ingress/kube-auth-proxy-58b8d644dc-6cm72"
Sep 07 21:08:01.497971 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:01.497945    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b82ae09f-78de-4419-a2d5-12e058c42486-tls-certs\") pod \"kube-auth-proxy-58b8d644dc-6cm72\" (UID: \"b82ae09f-78de-4419-a2d5-12e058c42486\") " pod="openshift-ingress/kube-auth-proxy-58b8d644dc-6cm72"
Sep 07 21:08:01.746440 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:01.746349    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58b8d644dc-6cm72"
Sep 07 21:08:02.025185 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:02.025161    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58b8d644dc-6cm72"]
Sep 07 21:08:02.027402 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:08:02.027377    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82ae09f_78de_4419_a2d5_12e058c42486.slice/crio-65bbc6e5e89a14e5e70785a1d11dd0a17d12c4bd66e56d972e261e596fb9bad0 WatchSource:0}: Error finding container 65bbc6e5e89a14e5e70785a1d11dd0a17d12c4bd66e56d972e261e596fb9bad0: Status 404 returned error can't find the container with id 65bbc6e5e89a14e5e70785a1d11dd0a17d12c4bd66e56d972e261e596fb9bad0
Sep 07 21:08:02.828350 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:02.828296    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58b8d644dc-6cm72" event={"ID":"b82ae09f-78de-4419-a2d5-12e058c42486","Type":"ContainerStarted","Data":"65bbc6e5e89a14e5e70785a1d11dd0a17d12c4bd66e56d972e261e596fb9bad0"}
Sep 07 21:08:05.843448 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:05.843409    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58b8d644dc-6cm72" event={"ID":"b82ae09f-78de-4419-a2d5-12e058c42486","Type":"ContainerStarted","Data":"e1c66c029c59ccfd25ece9f6744e2f4487a6a0f6b14a84ea9010d7c2f6eaa31a"}
Sep 07 21:08:05.860007 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:05.859953    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-58b8d644dc-6cm72" podStartSLOduration=3.044626416 podStartE2EDuration="5.859937327s" totalImagesPullingTime="2.815310911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:08:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:08:05.857893229 +0000 UTC m=+382.117710482" watchObservedRunningTime="2026-09-07 21:08:05.859937327 +0000 UTC m=+382.119754570"
Sep 07 21:08:08.069831 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.069799    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"]
Sep 07 21:08:08.076009 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.075216    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.078098 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.078072    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 07 21:08:08.078241 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.078209    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-c2ztk\""
Sep 07 21:08:08.085965 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.085940    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"]
Sep 07 21:08:08.151295 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.151264    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54c7e865-1815-45a2-a362-fedd2c89aeed-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.151295 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.151295    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54c7e865-1815-45a2-a362-fedd2c89aeed-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.151512 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.151384    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54c7e865-1815-45a2-a362-fedd2c89aeed-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.151512 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.151416    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54c7e865-1815-45a2-a362-fedd2c89aeed-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.151512 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.151438    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6vv6\" (UniqueName: \"kubernetes.io/projected/54c7e865-1815-45a2-a362-fedd2c89aeed-kube-api-access-g6vv6\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.151512 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.151472    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54c7e865-1815-45a2-a362-fedd2c89aeed-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.151512 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.151487    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54c7e865-1815-45a2-a362-fedd2c89aeed-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.151670 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.151545    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54c7e865-1815-45a2-a362-fedd2c89aeed-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.151670 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.151560    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54c7e865-1815-45a2-a362-fedd2c89aeed-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.252358 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.252300    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54c7e865-1815-45a2-a362-fedd2c89aeed-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.252358 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.252356    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54c7e865-1815-45a2-a362-fedd2c89aeed-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.252590 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.252390    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54c7e865-1815-45a2-a362-fedd2c89aeed-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.252590 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.252410    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54c7e865-1815-45a2-a362-fedd2c89aeed-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.252590 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.252435    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54c7e865-1815-45a2-a362-fedd2c89aeed-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.252590 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.252458    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54c7e865-1815-45a2-a362-fedd2c89aeed-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.252590 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.252487    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6vv6\" (UniqueName: \"kubernetes.io/projected/54c7e865-1815-45a2-a362-fedd2c89aeed-kube-api-access-g6vv6\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.252590 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.252527    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54c7e865-1815-45a2-a362-fedd2c89aeed-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.252590 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.252551    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54c7e865-1815-45a2-a362-fedd2c89aeed-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.252979 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.252769    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54c7e865-1815-45a2-a362-fedd2c89aeed-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.252979 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.252851    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54c7e865-1815-45a2-a362-fedd2c89aeed-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.253093 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.253058    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54c7e865-1815-45a2-a362-fedd2c89aeed-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.253147 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.253127    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54c7e865-1815-45a2-a362-fedd2c89aeed-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.253223 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.253204    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54c7e865-1815-45a2-a362-fedd2c89aeed-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.254913 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.254888    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54c7e865-1815-45a2-a362-fedd2c89aeed-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.255044 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.255025    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54c7e865-1815-45a2-a362-fedd2c89aeed-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.259446 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.259415    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54c7e865-1815-45a2-a362-fedd2c89aeed-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.260107 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.260089    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6vv6\" (UniqueName: \"kubernetes.io/projected/54c7e865-1815-45a2-a362-fedd2c89aeed-kube-api-access-g6vv6\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b\" (UID: \"54c7e865-1815-45a2-a362-fedd2c89aeed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.387876 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.387793    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:08.662889 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.662809    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"]
Sep 07 21:08:08.665043 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:08:08.665016    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c7e865_1815_45a2_a362_fedd2c89aeed.slice/crio-ca83c82bf713aab7b04a1b9fdb88151176a0a26cb7e1c33c6751eb10dd2bfaa1 WatchSource:0}: Error finding container ca83c82bf713aab7b04a1b9fdb88151176a0a26cb7e1c33c6751eb10dd2bfaa1: Status 404 returned error can't find the container with id ca83c82bf713aab7b04a1b9fdb88151176a0a26cb7e1c33c6751eb10dd2bfaa1
Sep 07 21:08:08.857673 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:08.857634    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b" event={"ID":"54c7e865-1815-45a2-a362-fedd2c89aeed","Type":"ContainerStarted","Data":"ca83c82bf713aab7b04a1b9fdb88151176a0a26cb7e1c33c6751eb10dd2bfaa1"}
Sep 07 21:08:11.361236 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:11.361193    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6kmmw"]
Sep 07 21:08:11.369690 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:11.369665    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-6kmmw"
Sep 07 21:08:11.371640 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:11.371281    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6kmmw"]
Sep 07 21:08:11.371958 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:11.371937    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-zxc6x\""
Sep 07 21:08:11.372151 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:11.372117    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 07 21:08:11.480207 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:11.480173    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12fd3d5d-1931-4dd1-9209-96bc9467e957-cert\") pod \"odh-model-controller-7998c67dc4-6kmmw\" (UID: \"12fd3d5d-1931-4dd1-9209-96bc9467e957\") " pod="opendatahub/odh-model-controller-7998c67dc4-6kmmw"
Sep 07 21:08:11.480400 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:11.480374    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jqw4\" (UniqueName: \"kubernetes.io/projected/12fd3d5d-1931-4dd1-9209-96bc9467e957-kube-api-access-8jqw4\") pod \"odh-model-controller-7998c67dc4-6kmmw\" (UID: \"12fd3d5d-1931-4dd1-9209-96bc9467e957\") " pod="opendatahub/odh-model-controller-7998c67dc4-6kmmw"
Sep 07 21:08:11.581227 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:11.581183    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jqw4\" (UniqueName: \"kubernetes.io/projected/12fd3d5d-1931-4dd1-9209-96bc9467e957-kube-api-access-8jqw4\") pod \"odh-model-controller-7998c67dc4-6kmmw\" (UID: \"12fd3d5d-1931-4dd1-9209-96bc9467e957\") " pod="opendatahub/odh-model-controller-7998c67dc4-6kmmw"
Sep 07 21:08:11.581387 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:11.581248    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12fd3d5d-1931-4dd1-9209-96bc9467e957-cert\") pod \"odh-model-controller-7998c67dc4-6kmmw\" (UID: \"12fd3d5d-1931-4dd1-9209-96bc9467e957\") " pod="opendatahub/odh-model-controller-7998c67dc4-6kmmw"
Sep 07 21:08:11.581443 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:08:11.581400    2558 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 07 21:08:11.581480 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:08:11.581467    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12fd3d5d-1931-4dd1-9209-96bc9467e957-cert podName:12fd3d5d-1931-4dd1-9209-96bc9467e957 nodeName:}" failed. No retries permitted until 2026-09-07 21:08:12.081439025 +0000 UTC m=+388.341256246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/12fd3d5d-1931-4dd1-9209-96bc9467e957-cert") pod "odh-model-controller-7998c67dc4-6kmmw" (UID: "12fd3d5d-1931-4dd1-9209-96bc9467e957") : secret "odh-model-controller-webhook-cert" not found
Sep 07 21:08:11.591701 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:11.591670    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jqw4\" (UniqueName: \"kubernetes.io/projected/12fd3d5d-1931-4dd1-9209-96bc9467e957-kube-api-access-8jqw4\") pod \"odh-model-controller-7998c67dc4-6kmmw\" (UID: \"12fd3d5d-1931-4dd1-9209-96bc9467e957\") " pod="opendatahub/odh-model-controller-7998c67dc4-6kmmw"
Sep 07 21:08:11.622081 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:11.622036    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:08:11.622170 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:11.622131    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:08:11.622207 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:11.622168    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:08:11.879662 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:11.879568    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b" event={"ID":"54c7e865-1815-45a2-a362-fedd2c89aeed","Type":"ContainerStarted","Data":"c1aab583e25242d97bcbeafe6bc38ded7c3dda3a8abdbcbf8ec6ba14ef7e04df"}
Sep 07 21:08:11.885373 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:11.885335    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-b48cx"]
Sep 07 21:08:11.888513 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:11.888494    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-b48cx"
Sep 07 21:08:11.890602 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:11.890581    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-lpzh5\""
Sep 07 21:08:11.890705 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:11.890582    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 07 21:08:11.897380 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:11.897346    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-b48cx"]
Sep 07 21:08:11.901558 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:11.901516    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b" podStartSLOduration=0.946983523 podStartE2EDuration="3.901499721s" totalImagesPullingTime="2.954516198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:08:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:08:11.900530067 +0000 UTC m=+388.160347309" watchObservedRunningTime="2026-09-07 21:08:11.901499721 +0000 UTC m=+388.161316964"
Sep 07 21:08:11.985614 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:11.985585    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t8l9\" (UniqueName: \"kubernetes.io/projected/693558c0-fde6-48d9-845f-21f2d3784c58-kube-api-access-7t8l9\") pod \"model-serving-api-54d89bd5fc-b48cx\" (UID: \"693558c0-fde6-48d9-845f-21f2d3784c58\") " pod="opendatahub/model-serving-api-54d89bd5fc-b48cx"
Sep 07 21:08:11.985943 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:11.985916    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/693558c0-fde6-48d9-845f-21f2d3784c58-tls-certs\") pod \"model-serving-api-54d89bd5fc-b48cx\" (UID: \"693558c0-fde6-48d9-845f-21f2d3784c58\") " pod="opendatahub/model-serving-api-54d89bd5fc-b48cx"
Sep 07 21:08:12.086744 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:12.086704    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/693558c0-fde6-48d9-845f-21f2d3784c58-tls-certs\") pod \"model-serving-api-54d89bd5fc-b48cx\" (UID: \"693558c0-fde6-48d9-845f-21f2d3784c58\") " pod="opendatahub/model-serving-api-54d89bd5fc-b48cx"
Sep 07 21:08:12.086908 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:12.086759    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t8l9\" (UniqueName: \"kubernetes.io/projected/693558c0-fde6-48d9-845f-21f2d3784c58-kube-api-access-7t8l9\") pod \"model-serving-api-54d89bd5fc-b48cx\" (UID: \"693558c0-fde6-48d9-845f-21f2d3784c58\") " pod="opendatahub/model-serving-api-54d89bd5fc-b48cx"
Sep 07 21:08:12.086908 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:12.086802    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12fd3d5d-1931-4dd1-9209-96bc9467e957-cert\") pod \"odh-model-controller-7998c67dc4-6kmmw\" (UID: \"12fd3d5d-1931-4dd1-9209-96bc9467e957\") " pod="opendatahub/odh-model-controller-7998c67dc4-6kmmw"
Sep 07 21:08:12.086908 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:08:12.086859    2558 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 07 21:08:12.087086 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:08:12.086922    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/693558c0-fde6-48d9-845f-21f2d3784c58-tls-certs podName:693558c0-fde6-48d9-845f-21f2d3784c58 nodeName:}" failed. No retries permitted until 2026-09-07 21:08:12.586904166 +0000 UTC m=+388.846721392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/693558c0-fde6-48d9-845f-21f2d3784c58-tls-certs") pod "model-serving-api-54d89bd5fc-b48cx" (UID: "693558c0-fde6-48d9-845f-21f2d3784c58") : secret "model-serving-api-tls" not found
Sep 07 21:08:12.089204 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:12.089175    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12fd3d5d-1931-4dd1-9209-96bc9467e957-cert\") pod \"odh-model-controller-7998c67dc4-6kmmw\" (UID: \"12fd3d5d-1931-4dd1-9209-96bc9467e957\") " pod="opendatahub/odh-model-controller-7998c67dc4-6kmmw"
Sep 07 21:08:12.094892 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:12.094867    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t8l9\" (UniqueName: \"kubernetes.io/projected/693558c0-fde6-48d9-845f-21f2d3784c58-kube-api-access-7t8l9\") pod \"model-serving-api-54d89bd5fc-b48cx\" (UID: \"693558c0-fde6-48d9-845f-21f2d3784c58\") " pod="opendatahub/model-serving-api-54d89bd5fc-b48cx"
Sep 07 21:08:12.284599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:12.284510    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-6kmmw"
Sep 07 21:08:12.388985 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:12.388947    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:12.393286 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:12.393262    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:12.556910 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:12.556887    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6kmmw"]
Sep 07 21:08:12.559216 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:08:12.559183    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12fd3d5d_1931_4dd1_9209_96bc9467e957.slice/crio-07e1fc5cb2270fcd2c068f4b43214e3d60d8118262a3c4d32b29ab7d5fb353d0 WatchSource:0}: Error finding container 07e1fc5cb2270fcd2c068f4b43214e3d60d8118262a3c4d32b29ab7d5fb353d0: Status 404 returned error can't find the container with id 07e1fc5cb2270fcd2c068f4b43214e3d60d8118262a3c4d32b29ab7d5fb353d0
Sep 07 21:08:12.590858 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:12.590829    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/693558c0-fde6-48d9-845f-21f2d3784c58-tls-certs\") pod \"model-serving-api-54d89bd5fc-b48cx\" (UID: \"693558c0-fde6-48d9-845f-21f2d3784c58\") " pod="opendatahub/model-serving-api-54d89bd5fc-b48cx"
Sep 07 21:08:12.593230 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:12.593194    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/693558c0-fde6-48d9-845f-21f2d3784c58-tls-certs\") pod \"model-serving-api-54d89bd5fc-b48cx\" (UID: \"693558c0-fde6-48d9-845f-21f2d3784c58\") " pod="opendatahub/model-serving-api-54d89bd5fc-b48cx"
Sep 07 21:08:12.802425 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:12.802392    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-b48cx"
Sep 07 21:08:12.884724 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:12.884687    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-6kmmw" event={"ID":"12fd3d5d-1931-4dd1-9209-96bc9467e957","Type":"ContainerStarted","Data":"07e1fc5cb2270fcd2c068f4b43214e3d60d8118262a3c4d32b29ab7d5fb353d0"}
Sep 07 21:08:12.884943 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:12.884928    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:12.885859 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:12.885838    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b"
Sep 07 21:08:13.070109 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:13.070087    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-b48cx"]
Sep 07 21:08:13.072419 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:08:13.072391    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod693558c0_fde6_48d9_845f_21f2d3784c58.slice/crio-fb2287e52d2431e869c32ea69959700216b9a020f8406d5a4f7692fad89a5499 WatchSource:0}: Error finding container fb2287e52d2431e869c32ea69959700216b9a020f8406d5a4f7692fad89a5499: Status 404 returned error can't find the container with id fb2287e52d2431e869c32ea69959700216b9a020f8406d5a4f7692fad89a5499
Sep 07 21:08:13.892035 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:13.891995    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-b48cx" event={"ID":"693558c0-fde6-48d9-845f-21f2d3784c58","Type":"ContainerStarted","Data":"fb2287e52d2431e869c32ea69959700216b9a020f8406d5a4f7692fad89a5499"}
Sep 07 21:08:16.907176 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:16.907138    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-b48cx" event={"ID":"693558c0-fde6-48d9-845f-21f2d3784c58","Type":"ContainerStarted","Data":"fe0d39f1a7344426fa1936d72011bdd452d4ab9894075699b57ec96f9bcf57d7"}
Sep 07 21:08:16.907727 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:16.907205    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-b48cx"
Sep 07 21:08:16.908694 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:16.908666    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-6kmmw" event={"ID":"12fd3d5d-1931-4dd1-9209-96bc9467e957","Type":"ContainerStarted","Data":"879eeaaf46488262602f1624c91f890f1887c5e57b6dbb34c37f7af73a3baec9"}
Sep 07 21:08:16.908808 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:16.908711    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-6kmmw"
Sep 07 21:08:17.005491 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:17.005442    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-b48cx" podStartSLOduration=3.008081933 podStartE2EDuration="6.005426245s" totalImagesPullingTime="2.997344312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:08:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:08:16.947200155 +0000 UTC m=+393.207017410" watchObservedRunningTime="2026-09-07 21:08:17.005426245 +0000 UTC m=+393.265243487"
Sep 07 21:08:17.006193 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:17.006164    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-6kmmw" podStartSLOduration=2.448118784 podStartE2EDuration="6.006151928s" totalImagesPullingTime="3.558033144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:08:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:08:17.004162178 +0000 UTC m=+393.263979443" watchObservedRunningTime="2026-09-07 21:08:17.006151928 +0000 UTC m=+393.265969171"
Sep 07 21:08:18.152988 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.152953    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"]
Sep 07 21:08:18.156205 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.156188    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.158502 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.158474    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 07 21:08:18.158502 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.158492    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-65gdm\""
Sep 07 21:08:18.158639 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.158548    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 07 21:08:18.158639 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.158548    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 07 21:08:18.169339 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.169299    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"]
Sep 07 21:08:18.238045 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.238009    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29063649-cdae-425f-bfa8-00eb70f6f132-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-gpwnm\" (UID: \"29063649-cdae-425f-bfa8-00eb70f6f132\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.238045 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.238049    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29063649-cdae-425f-bfa8-00eb70f6f132-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-gpwnm\" (UID: \"29063649-cdae-425f-bfa8-00eb70f6f132\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.238227 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.238111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29063649-cdae-425f-bfa8-00eb70f6f132-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-gpwnm\" (UID: \"29063649-cdae-425f-bfa8-00eb70f6f132\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.238227 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.238141    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29063649-cdae-425f-bfa8-00eb70f6f132-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-gpwnm\" (UID: \"29063649-cdae-425f-bfa8-00eb70f6f132\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.238227 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.238169    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29063649-cdae-425f-bfa8-00eb70f6f132-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-gpwnm\" (UID: \"29063649-cdae-425f-bfa8-00eb70f6f132\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.238227 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.238186    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29063649-cdae-425f-bfa8-00eb70f6f132-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-gpwnm\" (UID: \"29063649-cdae-425f-bfa8-00eb70f6f132\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.238227 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.238203    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f96jx\" (UniqueName: \"kubernetes.io/projected/29063649-cdae-425f-bfa8-00eb70f6f132-kube-api-access-f96jx\") pod \"istiod-openshift-gateway-5677ccb49b-gpwnm\" (UID: \"29063649-cdae-425f-bfa8-00eb70f6f132\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.339330 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.339288    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29063649-cdae-425f-bfa8-00eb70f6f132-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-gpwnm\" (UID: \"29063649-cdae-425f-bfa8-00eb70f6f132\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.339330 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.339335    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f96jx\" (UniqueName: \"kubernetes.io/projected/29063649-cdae-425f-bfa8-00eb70f6f132-kube-api-access-f96jx\") pod \"istiod-openshift-gateway-5677ccb49b-gpwnm\" (UID: \"29063649-cdae-425f-bfa8-00eb70f6f132\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.339564 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.339361    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29063649-cdae-425f-bfa8-00eb70f6f132-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-gpwnm\" (UID: \"29063649-cdae-425f-bfa8-00eb70f6f132\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.339564 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.339387    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29063649-cdae-425f-bfa8-00eb70f6f132-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-gpwnm\" (UID: \"29063649-cdae-425f-bfa8-00eb70f6f132\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.339564 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.339431    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29063649-cdae-425f-bfa8-00eb70f6f132-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-gpwnm\" (UID: \"29063649-cdae-425f-bfa8-00eb70f6f132\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.339564 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.339460    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29063649-cdae-425f-bfa8-00eb70f6f132-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-gpwnm\" (UID: \"29063649-cdae-425f-bfa8-00eb70f6f132\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.339564 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.339490    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29063649-cdae-425f-bfa8-00eb70f6f132-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-gpwnm\" (UID: \"29063649-cdae-425f-bfa8-00eb70f6f132\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.340277 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.340247    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29063649-cdae-425f-bfa8-00eb70f6f132-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-gpwnm\" (UID: \"29063649-cdae-425f-bfa8-00eb70f6f132\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.341704 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.341682    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29063649-cdae-425f-bfa8-00eb70f6f132-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-gpwnm\" (UID: \"29063649-cdae-425f-bfa8-00eb70f6f132\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.341806 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.341736    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29063649-cdae-425f-bfa8-00eb70f6f132-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-gpwnm\" (UID: \"29063649-cdae-425f-bfa8-00eb70f6f132\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.341852 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.341812    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29063649-cdae-425f-bfa8-00eb70f6f132-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-gpwnm\" (UID: \"29063649-cdae-425f-bfa8-00eb70f6f132\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.341886 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.341870    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29063649-cdae-425f-bfa8-00eb70f6f132-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-gpwnm\" (UID: \"29063649-cdae-425f-bfa8-00eb70f6f132\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.348058 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.348037    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29063649-cdae-425f-bfa8-00eb70f6f132-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-gpwnm\" (UID: \"29063649-cdae-425f-bfa8-00eb70f6f132\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.351400 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.351380    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f96jx\" (UniqueName: \"kubernetes.io/projected/29063649-cdae-425f-bfa8-00eb70f6f132-kube-api-access-f96jx\") pod \"istiod-openshift-gateway-5677ccb49b-gpwnm\" (UID: \"29063649-cdae-425f-bfa8-00eb70f6f132\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.465810 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.465719    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:18.747447 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.747423    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"]
Sep 07 21:08:18.749082 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:08:18.749055    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29063649_cdae_425f_bfa8_00eb70f6f132.slice/crio-be17ab5317178f83db91a8d8934efda4ba42bdbd63739eed43d3d9179d78dbc6 WatchSource:0}: Error finding container be17ab5317178f83db91a8d8934efda4ba42bdbd63739eed43d3d9179d78dbc6: Status 404 returned error can't find the container with id be17ab5317178f83db91a8d8934efda4ba42bdbd63739eed43d3d9179d78dbc6
Sep 07 21:08:18.920833 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:18.920799    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm" event={"ID":"29063649-cdae-425f-bfa8-00eb70f6f132","Type":"ContainerStarted","Data":"be17ab5317178f83db91a8d8934efda4ba42bdbd63739eed43d3d9179d78dbc6"}
Sep 07 21:08:21.136037 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:21.136001    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:08:21.136337 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:21.136092    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:08:21.943790 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:21.943751    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm" event={"ID":"29063649-cdae-425f-bfa8-00eb70f6f132","Type":"ContainerStarted","Data":"0eacbce2c6562c9eae544eb0eb4722bd3e5b4506a93386c671406b74619047f6"}
Sep 07 21:08:21.943991 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:21.943971    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:21.985326 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:21.985257    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm" podStartSLOduration=1.6006159 podStartE2EDuration="3.98524007s" totalImagesPullingTime="2.38462417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:08:21.982833312 +0000 UTC m=+398.242650574" watchObservedRunningTime="2026-09-07 21:08:21.98524007 +0000 UTC m=+398.245057303"
Sep 07 21:08:22.950792 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:22.950754    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm"
Sep 07 21:08:27.917768 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:27.917715    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-6kmmw"
Sep 07 21:08:27.919988 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:08:27.919966    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-b48cx"
Sep 07 21:09:15.649855 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.649821    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t"]
Sep 07 21:09:15.652326 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.652288    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t"
Sep 07 21:09:15.654759 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.654736    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gq45v\""
Sep 07 21:09:15.654908 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.654892    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 21:09:15.655396 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.655379    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 21:09:15.661959 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.661939    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t"]
Sep 07 21:09:15.701381 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.701360    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad834413-2d6e-4032-b752-9a556b7c960a-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t\" (UID: \"ad834413-2d6e-4032-b752-9a556b7c960a\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t"
Sep 07 21:09:15.701489 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.701392    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llmwf\" (UniqueName: \"kubernetes.io/projected/ad834413-2d6e-4032-b752-9a556b7c960a-kube-api-access-llmwf\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t\" (UID: \"ad834413-2d6e-4032-b752-9a556b7c960a\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t"
Sep 07 21:09:15.701530 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.701488    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad834413-2d6e-4032-b752-9a556b7c960a-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t\" (UID: \"ad834413-2d6e-4032-b752-9a556b7c960a\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t"
Sep 07 21:09:15.747387 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.747356    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb"]
Sep 07 21:09:15.749679 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.749664    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb"
Sep 07 21:09:15.757623 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.757600    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb"]
Sep 07 21:09:15.802393 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.802369    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/085f63d5-fedb-4ddd-a815-3edc70e9dad5-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb\" (UID: \"085f63d5-fedb-4ddd-a815-3edc70e9dad5\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb"
Sep 07 21:09:15.802563 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.802403    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad834413-2d6e-4032-b752-9a556b7c960a-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t\" (UID: \"ad834413-2d6e-4032-b752-9a556b7c960a\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t"
Sep 07 21:09:15.802563 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.802427    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llmwf\" (UniqueName: \"kubernetes.io/projected/ad834413-2d6e-4032-b752-9a556b7c960a-kube-api-access-llmwf\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t\" (UID: \"ad834413-2d6e-4032-b752-9a556b7c960a\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t"
Sep 07 21:09:15.802563 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.802470    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4n7l\" (UniqueName: \"kubernetes.io/projected/085f63d5-fedb-4ddd-a815-3edc70e9dad5-kube-api-access-m4n7l\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb\" (UID: \"085f63d5-fedb-4ddd-a815-3edc70e9dad5\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb"
Sep 07 21:09:15.802563 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.802512    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/085f63d5-fedb-4ddd-a815-3edc70e9dad5-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb\" (UID: \"085f63d5-fedb-4ddd-a815-3edc70e9dad5\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb"
Sep 07 21:09:15.802781 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.802585    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad834413-2d6e-4032-b752-9a556b7c960a-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t\" (UID: \"ad834413-2d6e-4032-b752-9a556b7c960a\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t"
Sep 07 21:09:15.802874 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.802854    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad834413-2d6e-4032-b752-9a556b7c960a-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t\" (UID: \"ad834413-2d6e-4032-b752-9a556b7c960a\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t"
Sep 07 21:09:15.802925 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.802884    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad834413-2d6e-4032-b752-9a556b7c960a-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t\" (UID: \"ad834413-2d6e-4032-b752-9a556b7c960a\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t"
Sep 07 21:09:15.810372 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.810346    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llmwf\" (UniqueName: \"kubernetes.io/projected/ad834413-2d6e-4032-b752-9a556b7c960a-kube-api-access-llmwf\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t\" (UID: \"ad834413-2d6e-4032-b752-9a556b7c960a\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t"
Sep 07 21:09:15.844187 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.844160    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf"]
Sep 07 21:09:15.846633 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.846616    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf"
Sep 07 21:09:15.855747 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.855728    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf"]
Sep 07 21:09:15.903637 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.903561    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8qph\" (UniqueName: \"kubernetes.io/projected/03467ecb-488b-4c73-bcb5-4a0d86ee2e70-kube-api-access-d8qph\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf\" (UID: \"03467ecb-488b-4c73-bcb5-4a0d86ee2e70\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf"
Sep 07 21:09:15.903637 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.903598    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4n7l\" (UniqueName: \"kubernetes.io/projected/085f63d5-fedb-4ddd-a815-3edc70e9dad5-kube-api-access-m4n7l\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb\" (UID: \"085f63d5-fedb-4ddd-a815-3edc70e9dad5\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb"
Sep 07 21:09:15.903637 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.903624    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/085f63d5-fedb-4ddd-a815-3edc70e9dad5-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb\" (UID: \"085f63d5-fedb-4ddd-a815-3edc70e9dad5\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb"
Sep 07 21:09:15.903889 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.903694    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03467ecb-488b-4c73-bcb5-4a0d86ee2e70-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf\" (UID: \"03467ecb-488b-4c73-bcb5-4a0d86ee2e70\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf"
Sep 07 21:09:15.903889 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.903743    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03467ecb-488b-4c73-bcb5-4a0d86ee2e70-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf\" (UID: \"03467ecb-488b-4c73-bcb5-4a0d86ee2e70\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf"
Sep 07 21:09:15.903889 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.903787    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/085f63d5-fedb-4ddd-a815-3edc70e9dad5-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb\" (UID: \"085f63d5-fedb-4ddd-a815-3edc70e9dad5\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb"
Sep 07 21:09:15.904140 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.904121    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/085f63d5-fedb-4ddd-a815-3edc70e9dad5-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb\" (UID: \"085f63d5-fedb-4ddd-a815-3edc70e9dad5\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb"
Sep 07 21:09:15.904140 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.904132    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/085f63d5-fedb-4ddd-a815-3edc70e9dad5-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb\" (UID: \"085f63d5-fedb-4ddd-a815-3edc70e9dad5\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb"
Sep 07 21:09:15.911224 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.911197    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4n7l\" (UniqueName: \"kubernetes.io/projected/085f63d5-fedb-4ddd-a815-3edc70e9dad5-kube-api-access-m4n7l\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb\" (UID: \"085f63d5-fedb-4ddd-a815-3edc70e9dad5\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb"
Sep 07 21:09:15.944494 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.944467    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs"]
Sep 07 21:09:15.946940 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.946925    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs"
Sep 07 21:09:15.955624 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.955604    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs"]
Sep 07 21:09:15.962103 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:15.962085    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t"
Sep 07 21:09:16.004303 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:16.004263    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb9k8\" (UniqueName: \"kubernetes.io/projected/b254f085-cc90-4136-b19a-c5b3768e9cb0-kube-api-access-zb9k8\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs\" (UID: \"b254f085-cc90-4136-b19a-c5b3768e9cb0\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs"
Sep 07 21:09:16.004490 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:16.004401    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03467ecb-488b-4c73-bcb5-4a0d86ee2e70-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf\" (UID: \"03467ecb-488b-4c73-bcb5-4a0d86ee2e70\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf"
Sep 07 21:09:16.004490 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:16.004449    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03467ecb-488b-4c73-bcb5-4a0d86ee2e70-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf\" (UID: \"03467ecb-488b-4c73-bcb5-4a0d86ee2e70\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf"
Sep 07 21:09:16.004600 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:16.004511    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b254f085-cc90-4136-b19a-c5b3768e9cb0-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs\" (UID: \"b254f085-cc90-4136-b19a-c5b3768e9cb0\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs"
Sep 07 21:09:16.004600 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:16.004548    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8qph\" (UniqueName: \"kubernetes.io/projected/03467ecb-488b-4c73-bcb5-4a0d86ee2e70-kube-api-access-d8qph\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf\" (UID: \"03467ecb-488b-4c73-bcb5-4a0d86ee2e70\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf"
Sep 07 21:09:16.004600 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:16.004575    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b254f085-cc90-4136-b19a-c5b3768e9cb0-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs\" (UID: \"b254f085-cc90-4136-b19a-c5b3768e9cb0\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs"
Sep 07 21:09:16.004802 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:16.004782    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03467ecb-488b-4c73-bcb5-4a0d86ee2e70-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf\" (UID: \"03467ecb-488b-4c73-bcb5-4a0d86ee2e70\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf"
Sep 07 21:09:16.004859 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:16.004801    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03467ecb-488b-4c73-bcb5-4a0d86ee2e70-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf\" (UID: \"03467ecb-488b-4c73-bcb5-4a0d86ee2e70\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf"
Sep 07 21:09:16.014412 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:16.014385    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8qph\" (UniqueName: \"kubernetes.io/projected/03467ecb-488b-4c73-bcb5-4a0d86ee2e70-kube-api-access-d8qph\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf\" (UID: \"03467ecb-488b-4c73-bcb5-4a0d86ee2e70\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf"
Sep 07 21:09:16.059158 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:16.059128    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb"
Sep 07 21:09:16.105932 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:16.105885    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b254f085-cc90-4136-b19a-c5b3768e9cb0-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs\" (UID: \"b254f085-cc90-4136-b19a-c5b3768e9cb0\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs"
Sep 07 21:09:16.106068 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:16.105940    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b254f085-cc90-4136-b19a-c5b3768e9cb0-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs\" (UID: \"b254f085-cc90-4136-b19a-c5b3768e9cb0\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs"
Sep 07 21:09:16.106068 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:16.105997    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb9k8\" (UniqueName: \"kubernetes.io/projected/b254f085-cc90-4136-b19a-c5b3768e9cb0-kube-api-access-zb9k8\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs\" (UID: \"b254f085-cc90-4136-b19a-c5b3768e9cb0\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs"
Sep 07 21:09:16.107158 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:16.107105    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b254f085-cc90-4136-b19a-c5b3768e9cb0-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs\" (UID: \"b254f085-cc90-4136-b19a-c5b3768e9cb0\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs"
Sep 07 21:09:16.107367 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:16.107340    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b254f085-cc90-4136-b19a-c5b3768e9cb0-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs\" (UID: \"b254f085-cc90-4136-b19a-c5b3768e9cb0\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs"
Sep 07 21:09:16.115730 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:16.115690    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb9k8\" (UniqueName: \"kubernetes.io/projected/b254f085-cc90-4136-b19a-c5b3768e9cb0-kube-api-access-zb9k8\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs\" (UID: \"b254f085-cc90-4136-b19a-c5b3768e9cb0\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs"
Sep 07 21:09:16.156284 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:16.156217    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf"
Sep 07 21:09:16.234643 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:16.234616    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t"]
Sep 07 21:09:16.235884 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:09:16.235858    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad834413_2d6e_4032_b752_9a556b7c960a.slice/crio-f0e938df4d07bf6f67dbd46548b4e76ea55a93f04da5df40a5b386e40c8342ae WatchSource:0}: Error finding container f0e938df4d07bf6f67dbd46548b4e76ea55a93f04da5df40a5b386e40c8342ae: Status 404 returned error can't find the container with id f0e938df4d07bf6f67dbd46548b4e76ea55a93f04da5df40a5b386e40c8342ae
Sep 07 21:09:16.257229 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:16.257207    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs"
Sep 07 21:09:16.330925 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:16.330901    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb"]
Sep 07 21:09:16.332975 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:09:16.332938    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod085f63d5_fedb_4ddd_a815_3edc70e9dad5.slice/crio-8e876e9ad82e846d56afd8ebe1c383acb8afa941786c442abf03f26cdf9342ea WatchSource:0}: Error finding container 8e876e9ad82e846d56afd8ebe1c383acb8afa941786c442abf03f26cdf9342ea: Status 404 returned error can't find the container with id 8e876e9ad82e846d56afd8ebe1c383acb8afa941786c442abf03f26cdf9342ea
Sep 07 21:09:16.426714 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:16.426691    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf"]
Sep 07 21:09:16.429574 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:09:16.429549    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03467ecb_488b_4c73_bcb5_4a0d86ee2e70.slice/crio-118f8873dc7ca46bdf12f4f28b67918e92fe5256a8ee71dd86205cc4d3d0bb03 WatchSource:0}: Error finding container 118f8873dc7ca46bdf12f4f28b67918e92fe5256a8ee71dd86205cc4d3d0bb03: Status 404 returned error can't find the container with id 118f8873dc7ca46bdf12f4f28b67918e92fe5256a8ee71dd86205cc4d3d0bb03
Sep 07 21:09:16.531244 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:16.531212    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs"]
Sep 07 21:09:16.531868 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:09:16.531842    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb254f085_cc90_4136_b19a_c5b3768e9cb0.slice/crio-b842f796f50cdeb01396f1e333f4c5feda5e1c266492be4437ecbc06db8c14ba WatchSource:0}: Error finding container b842f796f50cdeb01396f1e333f4c5feda5e1c266492be4437ecbc06db8c14ba: Status 404 returned error can't find the container with id b842f796f50cdeb01396f1e333f4c5feda5e1c266492be4437ecbc06db8c14ba
Sep 07 21:09:17.202492 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:17.202461    2558 generic.go:356] "Generic (PLEG): container finished" podID="03467ecb-488b-4c73-bcb5-4a0d86ee2e70" containerID="8895b09df55a7c5a018c6db223861f15eb5c1f0a05f50383c730521782620ac5" exitCode=0
Sep 07 21:09:17.202982 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:17.202547    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf" event={"ID":"03467ecb-488b-4c73-bcb5-4a0d86ee2e70","Type":"ContainerDied","Data":"8895b09df55a7c5a018c6db223861f15eb5c1f0a05f50383c730521782620ac5"}
Sep 07 21:09:17.202982 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:17.202594    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf" event={"ID":"03467ecb-488b-4c73-bcb5-4a0d86ee2e70","Type":"ContainerStarted","Data":"118f8873dc7ca46bdf12f4f28b67918e92fe5256a8ee71dd86205cc4d3d0bb03"}
Sep 07 21:09:17.204149 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:17.204129    2558 generic.go:356] "Generic (PLEG): container finished" podID="ad834413-2d6e-4032-b752-9a556b7c960a" containerID="13dddcb54b217ffb2dbd2360e6264e690cb282f543782d3ee2836a6791d435b9" exitCode=0
Sep 07 21:09:17.204238 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:17.204216    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t" event={"ID":"ad834413-2d6e-4032-b752-9a556b7c960a","Type":"ContainerDied","Data":"13dddcb54b217ffb2dbd2360e6264e690cb282f543782d3ee2836a6791d435b9"}
Sep 07 21:09:17.204301 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:17.204267    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t" event={"ID":"ad834413-2d6e-4032-b752-9a556b7c960a","Type":"ContainerStarted","Data":"f0e938df4d07bf6f67dbd46548b4e76ea55a93f04da5df40a5b386e40c8342ae"}
Sep 07 21:09:17.205875 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:17.205852    2558 generic.go:356] "Generic (PLEG): container finished" podID="b254f085-cc90-4136-b19a-c5b3768e9cb0" containerID="9e803410cb91193b1325ed5051dc3719ea043a77aa44240d1a778ee636ade4d9" exitCode=0
Sep 07 21:09:17.205964 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:17.205939    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs" event={"ID":"b254f085-cc90-4136-b19a-c5b3768e9cb0","Type":"ContainerDied","Data":"9e803410cb91193b1325ed5051dc3719ea043a77aa44240d1a778ee636ade4d9"}
Sep 07 21:09:17.206023 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:17.205976    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs" event={"ID":"b254f085-cc90-4136-b19a-c5b3768e9cb0","Type":"ContainerStarted","Data":"b842f796f50cdeb01396f1e333f4c5feda5e1c266492be4437ecbc06db8c14ba"}
Sep 07 21:09:17.207634 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:17.207617    2558 generic.go:356] "Generic (PLEG): container finished" podID="085f63d5-fedb-4ddd-a815-3edc70e9dad5" containerID="164590c0b561cc2a112a044104a91a88af78e6eab8dc88117f3f6889b89558ca" exitCode=0
Sep 07 21:09:17.207706 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:17.207646    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb" event={"ID":"085f63d5-fedb-4ddd-a815-3edc70e9dad5","Type":"ContainerDied","Data":"164590c0b561cc2a112a044104a91a88af78e6eab8dc88117f3f6889b89558ca"}
Sep 07 21:09:17.207706 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:17.207679    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb" event={"ID":"085f63d5-fedb-4ddd-a815-3edc70e9dad5","Type":"ContainerStarted","Data":"8e876e9ad82e846d56afd8ebe1c383acb8afa941786c442abf03f26cdf9342ea"}
Sep 07 21:09:18.217587 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:18.217557    2558 generic.go:356] "Generic (PLEG): container finished" podID="b254f085-cc90-4136-b19a-c5b3768e9cb0" containerID="ef773b6d0446190241d1d8370602d63afe7d663a54d556edfed27d2b0a1f579c" exitCode=0
Sep 07 21:09:18.217933 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:18.217604    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs" event={"ID":"b254f085-cc90-4136-b19a-c5b3768e9cb0","Type":"ContainerDied","Data":"ef773b6d0446190241d1d8370602d63afe7d663a54d556edfed27d2b0a1f579c"}
Sep 07 21:09:18.219791 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:18.219767    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf" event={"ID":"03467ecb-488b-4c73-bcb5-4a0d86ee2e70","Type":"ContainerStarted","Data":"02ad9c2169420a66288ee0de234ccfeb0d6408e0b24806069ca4ed293a52d03d"}
Sep 07 21:09:19.226610 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:19.226533    2558 generic.go:356] "Generic (PLEG): container finished" podID="b254f085-cc90-4136-b19a-c5b3768e9cb0" containerID="58d42d75130b470dd12575e3abf8583861d2a1203e75ad257d3a148d890f9b7d" exitCode=0
Sep 07 21:09:19.226967 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:19.226618    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs" event={"ID":"b254f085-cc90-4136-b19a-c5b3768e9cb0","Type":"ContainerDied","Data":"58d42d75130b470dd12575e3abf8583861d2a1203e75ad257d3a148d890f9b7d"}
Sep 07 21:09:19.228609 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:19.228585    2558 generic.go:356] "Generic (PLEG): container finished" podID="03467ecb-488b-4c73-bcb5-4a0d86ee2e70" containerID="02ad9c2169420a66288ee0de234ccfeb0d6408e0b24806069ca4ed293a52d03d" exitCode=0
Sep 07 21:09:19.228609 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:19.228606    2558 generic.go:356] "Generic (PLEG): container finished" podID="03467ecb-488b-4c73-bcb5-4a0d86ee2e70" containerID="185b52a6df25c7e6a5341a45b313844cf13951196f4767514d9cc0fad0e3f454" exitCode=0
Sep 07 21:09:19.228786 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:19.228654    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf" event={"ID":"03467ecb-488b-4c73-bcb5-4a0d86ee2e70","Type":"ContainerDied","Data":"02ad9c2169420a66288ee0de234ccfeb0d6408e0b24806069ca4ed293a52d03d"}
Sep 07 21:09:19.228786 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:19.228688    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf" event={"ID":"03467ecb-488b-4c73-bcb5-4a0d86ee2e70","Type":"ContainerDied","Data":"185b52a6df25c7e6a5341a45b313844cf13951196f4767514d9cc0fad0e3f454"}
Sep 07 21:09:19.230437 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:19.230415    2558 generic.go:356] "Generic (PLEG): container finished" podID="ad834413-2d6e-4032-b752-9a556b7c960a" containerID="627ea92e9946403a39b7596bb1632c551964dbeb9ad3ac52c17ffb323a8e9a4a" exitCode=0
Sep 07 21:09:19.230529 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:19.230469    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t" event={"ID":"ad834413-2d6e-4032-b752-9a556b7c960a","Type":"ContainerDied","Data":"627ea92e9946403a39b7596bb1632c551964dbeb9ad3ac52c17ffb323a8e9a4a"}
Sep 07 21:09:20.237945 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:20.237912    2558 generic.go:356] "Generic (PLEG): container finished" podID="ad834413-2d6e-4032-b752-9a556b7c960a" containerID="9f7fc39134eaa566bfe3a753a0b873d8499fdb4c6f6884abe63b80be12d7583f" exitCode=0
Sep 07 21:09:20.238347 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:20.237994    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t" event={"ID":"ad834413-2d6e-4032-b752-9a556b7c960a","Type":"ContainerDied","Data":"9f7fc39134eaa566bfe3a753a0b873d8499fdb4c6f6884abe63b80be12d7583f"}
Sep 07 21:09:20.387502 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:20.387477    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf"
Sep 07 21:09:20.390237 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:20.390220    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs"
Sep 07 21:09:20.443496 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:20.443471    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03467ecb-488b-4c73-bcb5-4a0d86ee2e70-bundle\") pod \"03467ecb-488b-4c73-bcb5-4a0d86ee2e70\" (UID: \"03467ecb-488b-4c73-bcb5-4a0d86ee2e70\") "
Sep 07 21:09:20.443496 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:20.443498    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b254f085-cc90-4136-b19a-c5b3768e9cb0-util\") pod \"b254f085-cc90-4136-b19a-c5b3768e9cb0\" (UID: \"b254f085-cc90-4136-b19a-c5b3768e9cb0\") "
Sep 07 21:09:20.443665 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:20.443518    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zb9k8\" (UniqueName: \"kubernetes.io/projected/b254f085-cc90-4136-b19a-c5b3768e9cb0-kube-api-access-zb9k8\") pod \"b254f085-cc90-4136-b19a-c5b3768e9cb0\" (UID: \"b254f085-cc90-4136-b19a-c5b3768e9cb0\") "
Sep 07 21:09:20.443665 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:20.443583    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b254f085-cc90-4136-b19a-c5b3768e9cb0-bundle\") pod \"b254f085-cc90-4136-b19a-c5b3768e9cb0\" (UID: \"b254f085-cc90-4136-b19a-c5b3768e9cb0\") "
Sep 07 21:09:20.443665 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:20.443618    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03467ecb-488b-4c73-bcb5-4a0d86ee2e70-util\") pod \"03467ecb-488b-4c73-bcb5-4a0d86ee2e70\" (UID: \"03467ecb-488b-4c73-bcb5-4a0d86ee2e70\") "
Sep 07 21:09:20.443775 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:20.443688    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8qph\" (UniqueName: \"kubernetes.io/projected/03467ecb-488b-4c73-bcb5-4a0d86ee2e70-kube-api-access-d8qph\") pod \"03467ecb-488b-4c73-bcb5-4a0d86ee2e70\" (UID: \"03467ecb-488b-4c73-bcb5-4a0d86ee2e70\") "
Sep 07 21:09:20.444021 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:20.443995    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03467ecb-488b-4c73-bcb5-4a0d86ee2e70-bundle" (OuterVolumeSpecName: "bundle") pod "03467ecb-488b-4c73-bcb5-4a0d86ee2e70" (UID: "03467ecb-488b-4c73-bcb5-4a0d86ee2e70"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:09:20.444376 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:20.444347    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b254f085-cc90-4136-b19a-c5b3768e9cb0-bundle" (OuterVolumeSpecName: "bundle") pod "b254f085-cc90-4136-b19a-c5b3768e9cb0" (UID: "b254f085-cc90-4136-b19a-c5b3768e9cb0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:09:20.445823 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:20.445788    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03467ecb-488b-4c73-bcb5-4a0d86ee2e70-kube-api-access-d8qph" (OuterVolumeSpecName: "kube-api-access-d8qph") pod "03467ecb-488b-4c73-bcb5-4a0d86ee2e70" (UID: "03467ecb-488b-4c73-bcb5-4a0d86ee2e70"). InnerVolumeSpecName "kube-api-access-d8qph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:09:20.445912 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:20.445888    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b254f085-cc90-4136-b19a-c5b3768e9cb0-kube-api-access-zb9k8" (OuterVolumeSpecName: "kube-api-access-zb9k8") pod "b254f085-cc90-4136-b19a-c5b3768e9cb0" (UID: "b254f085-cc90-4136-b19a-c5b3768e9cb0"). InnerVolumeSpecName "kube-api-access-zb9k8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:09:20.449179 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:20.449157    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b254f085-cc90-4136-b19a-c5b3768e9cb0-util" (OuterVolumeSpecName: "util") pod "b254f085-cc90-4136-b19a-c5b3768e9cb0" (UID: "b254f085-cc90-4136-b19a-c5b3768e9cb0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:09:20.451936 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:20.451908    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03467ecb-488b-4c73-bcb5-4a0d86ee2e70-util" (OuterVolumeSpecName: "util") pod "03467ecb-488b-4c73-bcb5-4a0d86ee2e70" (UID: "03467ecb-488b-4c73-bcb5-4a0d86ee2e70"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:09:20.545524 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:20.545438    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8qph\" (UniqueName: \"kubernetes.io/projected/03467ecb-488b-4c73-bcb5-4a0d86ee2e70-kube-api-access-d8qph\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:09:20.545524 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:20.545466    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03467ecb-488b-4c73-bcb5-4a0d86ee2e70-bundle\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:09:20.545524 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:20.545477    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b254f085-cc90-4136-b19a-c5b3768e9cb0-util\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:09:20.545524 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:20.545489    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zb9k8\" (UniqueName: \"kubernetes.io/projected/b254f085-cc90-4136-b19a-c5b3768e9cb0-kube-api-access-zb9k8\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:09:20.545524 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:20.545501    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b254f085-cc90-4136-b19a-c5b3768e9cb0-bundle\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:09:20.545524 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:20.545513    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03467ecb-488b-4c73-bcb5-4a0d86ee2e70-util\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:09:21.244843 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:21.244806    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs"
Sep 07 21:09:21.244843 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:21.244832    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ld4xs" event={"ID":"b254f085-cc90-4136-b19a-c5b3768e9cb0","Type":"ContainerDied","Data":"b842f796f50cdeb01396f1e333f4c5feda5e1c266492be4437ecbc06db8c14ba"}
Sep 07 21:09:21.245260 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:21.244898    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b842f796f50cdeb01396f1e333f4c5feda5e1c266492be4437ecbc06db8c14ba"
Sep 07 21:09:21.246847 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:21.246827    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf"
Sep 07 21:09:21.246951 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:21.246850    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a09hlxf" event={"ID":"03467ecb-488b-4c73-bcb5-4a0d86ee2e70","Type":"ContainerDied","Data":"118f8873dc7ca46bdf12f4f28b67918e92fe5256a8ee71dd86205cc4d3d0bb03"}
Sep 07 21:09:21.246951 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:21.246889    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="118f8873dc7ca46bdf12f4f28b67918e92fe5256a8ee71dd86205cc4d3d0bb03"
Sep 07 21:09:21.360569 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:21.360542    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t"
Sep 07 21:09:21.454228 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:21.454196    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad834413-2d6e-4032-b752-9a556b7c960a-bundle\") pod \"ad834413-2d6e-4032-b752-9a556b7c960a\" (UID: \"ad834413-2d6e-4032-b752-9a556b7c960a\") "
Sep 07 21:09:21.454405 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:21.454287    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad834413-2d6e-4032-b752-9a556b7c960a-util\") pod \"ad834413-2d6e-4032-b752-9a556b7c960a\" (UID: \"ad834413-2d6e-4032-b752-9a556b7c960a\") "
Sep 07 21:09:21.454405 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:21.454325    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llmwf\" (UniqueName: \"kubernetes.io/projected/ad834413-2d6e-4032-b752-9a556b7c960a-kube-api-access-llmwf\") pod \"ad834413-2d6e-4032-b752-9a556b7c960a\" (UID: \"ad834413-2d6e-4032-b752-9a556b7c960a\") "
Sep 07 21:09:21.454730 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:21.454701    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad834413-2d6e-4032-b752-9a556b7c960a-bundle" (OuterVolumeSpecName: "bundle") pod "ad834413-2d6e-4032-b752-9a556b7c960a" (UID: "ad834413-2d6e-4032-b752-9a556b7c960a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:09:21.456444 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:21.456415    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad834413-2d6e-4032-b752-9a556b7c960a-kube-api-access-llmwf" (OuterVolumeSpecName: "kube-api-access-llmwf") pod "ad834413-2d6e-4032-b752-9a556b7c960a" (UID: "ad834413-2d6e-4032-b752-9a556b7c960a"). InnerVolumeSpecName "kube-api-access-llmwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:09:21.462692 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:21.462652    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad834413-2d6e-4032-b752-9a556b7c960a-util" (OuterVolumeSpecName: "util") pod "ad834413-2d6e-4032-b752-9a556b7c960a" (UID: "ad834413-2d6e-4032-b752-9a556b7c960a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:09:21.555286 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:21.555260    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad834413-2d6e-4032-b752-9a556b7c960a-bundle\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:09:21.555286 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:21.555286    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad834413-2d6e-4032-b752-9a556b7c960a-util\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:09:21.555490 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:21.555294    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llmwf\" (UniqueName: \"kubernetes.io/projected/ad834413-2d6e-4032-b752-9a556b7c960a-kube-api-access-llmwf\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:09:22.253041 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:22.252967    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t"
Sep 07 21:09:22.253041 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:22.252993    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwq26t" event={"ID":"ad834413-2d6e-4032-b752-9a556b7c960a","Type":"ContainerDied","Data":"f0e938df4d07bf6f67dbd46548b4e76ea55a93f04da5df40a5b386e40c8342ae"}
Sep 07 21:09:22.253041 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:22.253038    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0e938df4d07bf6f67dbd46548b4e76ea55a93f04da5df40a5b386e40c8342ae"
Sep 07 21:09:43.356067 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:43.356027    2558 generic.go:356] "Generic (PLEG): container finished" podID="085f63d5-fedb-4ddd-a815-3edc70e9dad5" containerID="71c97cd75779641a400237302d494ae88d14c47332b58b037166c32c646c5e83" exitCode=0
Sep 07 21:09:43.356440 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:43.356105    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb" event={"ID":"085f63d5-fedb-4ddd-a815-3edc70e9dad5","Type":"ContainerDied","Data":"71c97cd75779641a400237302d494ae88d14c47332b58b037166c32c646c5e83"}
Sep 07 21:09:44.362714 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:44.362675    2558 generic.go:356] "Generic (PLEG): container finished" podID="085f63d5-fedb-4ddd-a815-3edc70e9dad5" containerID="0ee56670b665a111102d627bd5d84665bdbc58a8122f8eebfd89f838e2330241" exitCode=0
Sep 07 21:09:44.363058 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:44.362760    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb" event={"ID":"085f63d5-fedb-4ddd-a815-3edc70e9dad5","Type":"ContainerDied","Data":"0ee56670b665a111102d627bd5d84665bdbc58a8122f8eebfd89f838e2330241"}
Sep 07 21:09:45.492684 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:45.492662    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb"
Sep 07 21:09:45.657876 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:45.657779    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/085f63d5-fedb-4ddd-a815-3edc70e9dad5-bundle\") pod \"085f63d5-fedb-4ddd-a815-3edc70e9dad5\" (UID: \"085f63d5-fedb-4ddd-a815-3edc70e9dad5\") "
Sep 07 21:09:45.657876 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:45.657854    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/085f63d5-fedb-4ddd-a815-3edc70e9dad5-util\") pod \"085f63d5-fedb-4ddd-a815-3edc70e9dad5\" (UID: \"085f63d5-fedb-4ddd-a815-3edc70e9dad5\") "
Sep 07 21:09:45.658140 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:45.657949    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4n7l\" (UniqueName: \"kubernetes.io/projected/085f63d5-fedb-4ddd-a815-3edc70e9dad5-kube-api-access-m4n7l\") pod \"085f63d5-fedb-4ddd-a815-3edc70e9dad5\" (UID: \"085f63d5-fedb-4ddd-a815-3edc70e9dad5\") "
Sep 07 21:09:45.658373 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:45.658344    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/085f63d5-fedb-4ddd-a815-3edc70e9dad5-bundle" (OuterVolumeSpecName: "bundle") pod "085f63d5-fedb-4ddd-a815-3edc70e9dad5" (UID: "085f63d5-fedb-4ddd-a815-3edc70e9dad5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:09:45.660094 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:45.660066    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/085f63d5-fedb-4ddd-a815-3edc70e9dad5-kube-api-access-m4n7l" (OuterVolumeSpecName: "kube-api-access-m4n7l") pod "085f63d5-fedb-4ddd-a815-3edc70e9dad5" (UID: "085f63d5-fedb-4ddd-a815-3edc70e9dad5"). InnerVolumeSpecName "kube-api-access-m4n7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:09:45.663933 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:45.663904    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/085f63d5-fedb-4ddd-a815-3edc70e9dad5-util" (OuterVolumeSpecName: "util") pod "085f63d5-fedb-4ddd-a815-3edc70e9dad5" (UID: "085f63d5-fedb-4ddd-a815-3edc70e9dad5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:09:45.758628 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:45.758588    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4n7l\" (UniqueName: \"kubernetes.io/projected/085f63d5-fedb-4ddd-a815-3edc70e9dad5-kube-api-access-m4n7l\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:09:45.758628 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:45.758621    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/085f63d5-fedb-4ddd-a815-3edc70e9dad5-bundle\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:09:45.758628 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:45.758630    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/085f63d5-fedb-4ddd-a815-3edc70e9dad5-util\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:09:46.373747 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:46.373721    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb"
Sep 07 21:09:46.373918 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:46.373721    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c2nbfb" event={"ID":"085f63d5-fedb-4ddd-a815-3edc70e9dad5","Type":"ContainerDied","Data":"8e876e9ad82e846d56afd8ebe1c383acb8afa941786c442abf03f26cdf9342ea"}
Sep 07 21:09:46.373918 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:46.373849    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e876e9ad82e846d56afd8ebe1c383acb8afa941786c442abf03f26cdf9342ea"
Sep 07 21:09:58.798195 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798160    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw"]
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798478    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="085f63d5-fedb-4ddd-a815-3edc70e9dad5" containerName="util"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798489    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="085f63d5-fedb-4ddd-a815-3edc70e9dad5" containerName="util"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798497    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03467ecb-488b-4c73-bcb5-4a0d86ee2e70" containerName="pull"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798503    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="03467ecb-488b-4c73-bcb5-4a0d86ee2e70" containerName="pull"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798514    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad834413-2d6e-4032-b752-9a556b7c960a" containerName="util"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798520    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad834413-2d6e-4032-b752-9a556b7c960a" containerName="util"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798527    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad834413-2d6e-4032-b752-9a556b7c960a" containerName="pull"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798532    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad834413-2d6e-4032-b752-9a556b7c960a" containerName="pull"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798539    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad834413-2d6e-4032-b752-9a556b7c960a" containerName="extract"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798544    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad834413-2d6e-4032-b752-9a556b7c960a" containerName="extract"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798552    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b254f085-cc90-4136-b19a-c5b3768e9cb0" containerName="util"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798556    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b254f085-cc90-4136-b19a-c5b3768e9cb0" containerName="util"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798561    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b254f085-cc90-4136-b19a-c5b3768e9cb0" containerName="extract"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798566    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b254f085-cc90-4136-b19a-c5b3768e9cb0" containerName="extract"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798573    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b254f085-cc90-4136-b19a-c5b3768e9cb0" containerName="pull"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798578    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b254f085-cc90-4136-b19a-c5b3768e9cb0" containerName="pull"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798584    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03467ecb-488b-4c73-bcb5-4a0d86ee2e70" containerName="util"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798590    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="03467ecb-488b-4c73-bcb5-4a0d86ee2e70" containerName="util"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798597    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03467ecb-488b-4c73-bcb5-4a0d86ee2e70" containerName="extract"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798601    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="03467ecb-488b-4c73-bcb5-4a0d86ee2e70" containerName="extract"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798609    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="085f63d5-fedb-4ddd-a815-3edc70e9dad5" containerName="extract"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798614    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="085f63d5-fedb-4ddd-a815-3edc70e9dad5" containerName="extract"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798622    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="085f63d5-fedb-4ddd-a815-3edc70e9dad5" containerName="pull"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798626    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="085f63d5-fedb-4ddd-a815-3edc70e9dad5" containerName="pull"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798671    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="085f63d5-fedb-4ddd-a815-3edc70e9dad5" containerName="extract"
Sep 07 21:09:58.798672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798682    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad834413-2d6e-4032-b752-9a556b7c960a" containerName="extract"
Sep 07 21:09:58.799445 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798689    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="03467ecb-488b-4c73-bcb5-4a0d86ee2e70" containerName="extract"
Sep 07 21:09:58.799445 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.798695    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b254f085-cc90-4136-b19a-c5b3768e9cb0" containerName="extract"
Sep 07 21:09:58.802917 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.802900    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw"
Sep 07 21:09:58.806357 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.806332    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rnbnr\""
Sep 07 21:09:58.806818 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.806801    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 07 21:09:58.807209 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.807195    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 07 21:09:58.823382 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.823353    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw"]
Sep 07 21:09:58.872098 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.872059    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbdxk\" (UniqueName: \"kubernetes.io/projected/6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206-kube-api-access-wbdxk\") pod \"kuadrant-operator-controller-manager-58fc56757c-xfxdw\" (UID: \"6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw"
Sep 07 21:09:58.872258 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.872119    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-xfxdw\" (UID: \"6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw"
Sep 07 21:09:58.972682 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.972649    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbdxk\" (UniqueName: \"kubernetes.io/projected/6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206-kube-api-access-wbdxk\") pod \"kuadrant-operator-controller-manager-58fc56757c-xfxdw\" (UID: \"6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw"
Sep 07 21:09:58.972846 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.972709    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-xfxdw\" (UID: \"6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw"
Sep 07 21:09:58.973049 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.973032    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-xfxdw\" (UID: \"6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw"
Sep 07 21:09:58.981615 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:58.981582    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbdxk\" (UniqueName: \"kubernetes.io/projected/6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206-kube-api-access-wbdxk\") pod \"kuadrant-operator-controller-manager-58fc56757c-xfxdw\" (UID: \"6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw"
Sep 07 21:09:59.112571 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:59.112534    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw"
Sep 07 21:09:59.394564 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:59.394533    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw"]
Sep 07 21:09:59.397914 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:09:59.397890    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cbc5bdb_003a_40fe_b9c5_1d2c6a12a206.slice/crio-4a853f06b2e7236ec31371d6a299e1cbd5171d8ce561887e25075e33221f0c16 WatchSource:0}: Error finding container 4a853f06b2e7236ec31371d6a299e1cbd5171d8ce561887e25075e33221f0c16: Status 404 returned error can't find the container with id 4a853f06b2e7236ec31371d6a299e1cbd5171d8ce561887e25075e33221f0c16
Sep 07 21:09:59.439052 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:09:59.439019    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw" event={"ID":"6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206","Type":"ContainerStarted","Data":"4a853f06b2e7236ec31371d6a299e1cbd5171d8ce561887e25075e33221f0c16"}
Sep 07 21:10:03.025063 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:03.025025    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-xg25t"]
Sep 07 21:10:03.028639 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:03.028618    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xg25t"
Sep 07 21:10:03.031057 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:03.031021    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-tjs7n\""
Sep 07 21:10:03.031195 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:03.031147    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 07 21:10:03.042423 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:03.042395    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-xg25t"]
Sep 07 21:10:03.105883 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:03.105845    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t8pr\" (UniqueName: \"kubernetes.io/projected/089701ef-604b-4d35-a5b2-6cac3448486e-kube-api-access-9t8pr\") pod \"dns-operator-controller-manager-5985564776-xg25t\" (UID: \"089701ef-604b-4d35-a5b2-6cac3448486e\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-xg25t"
Sep 07 21:10:03.206873 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:03.206836    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t8pr\" (UniqueName: \"kubernetes.io/projected/089701ef-604b-4d35-a5b2-6cac3448486e-kube-api-access-9t8pr\") pod \"dns-operator-controller-manager-5985564776-xg25t\" (UID: \"089701ef-604b-4d35-a5b2-6cac3448486e\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-xg25t"
Sep 07 21:10:03.214868 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:03.214833    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t8pr\" (UniqueName: \"kubernetes.io/projected/089701ef-604b-4d35-a5b2-6cac3448486e-kube-api-access-9t8pr\") pod \"dns-operator-controller-manager-5985564776-xg25t\" (UID: \"089701ef-604b-4d35-a5b2-6cac3448486e\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-xg25t"
Sep 07 21:10:03.341436 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:03.341396    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xg25t"
Sep 07 21:10:03.812831 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:03.812805    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-xg25t"]
Sep 07 21:10:03.815365 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:10:03.815333    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod089701ef_604b_4d35_a5b2_6cac3448486e.slice/crio-2a08aa83e26497b191cbb00e87486516e8caa21621ba984c2bc8408d581b1229 WatchSource:0}: Error finding container 2a08aa83e26497b191cbb00e87486516e8caa21621ba984c2bc8408d581b1229: Status 404 returned error can't find the container with id 2a08aa83e26497b191cbb00e87486516e8caa21621ba984c2bc8408d581b1229
Sep 07 21:10:04.472741 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:04.472700    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw" event={"ID":"6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206","Type":"ContainerStarted","Data":"ea582010efac2ce6a07a3bfdc913a1b9dccdb64f02c5a3bb2f1b8a2209165709"}
Sep 07 21:10:04.473180 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:04.472775    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw"
Sep 07 21:10:04.474174 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:04.474151    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xg25t" event={"ID":"089701ef-604b-4d35-a5b2-6cac3448486e","Type":"ContainerStarted","Data":"2a08aa83e26497b191cbb00e87486516e8caa21621ba984c2bc8408d581b1229"}
Sep 07 21:10:04.493971 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:04.493920    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw" podStartSLOduration=2.27289844 podStartE2EDuration="6.493889483s" totalImagesPullingTime="4.220991043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:10:04.492010311 +0000 UTC m=+500.751827577" watchObservedRunningTime="2026-09-07 21:10:04.493889483 +0000 UTC m=+500.753706725"
Sep 07 21:10:05.890390 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:05.890293    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-tbpj2"]
Sep 07 21:10:05.893676 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:05.893658    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-tbpj2"
Sep 07 21:10:05.896423 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:05.896400    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-bcbs9\""
Sep 07 21:10:05.904162 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:05.904140    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-tbpj2"]
Sep 07 21:10:05.932219 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:05.932182    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgvlp\" (UniqueName: \"kubernetes.io/projected/c593e9e1-f878-4bdf-9df7-73d889296964-kube-api-access-qgvlp\") pod \"authorino-operator-68d88948d8-tbpj2\" (UID: \"c593e9e1-f878-4bdf-9df7-73d889296964\") " pod="kuadrant-system/authorino-operator-68d88948d8-tbpj2"
Sep 07 21:10:06.033199 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:06.033152    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgvlp\" (UniqueName: \"kubernetes.io/projected/c593e9e1-f878-4bdf-9df7-73d889296964-kube-api-access-qgvlp\") pod \"authorino-operator-68d88948d8-tbpj2\" (UID: \"c593e9e1-f878-4bdf-9df7-73d889296964\") " pod="kuadrant-system/authorino-operator-68d88948d8-tbpj2"
Sep 07 21:10:06.043914 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:06.043885    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgvlp\" (UniqueName: \"kubernetes.io/projected/c593e9e1-f878-4bdf-9df7-73d889296964-kube-api-access-qgvlp\") pod \"authorino-operator-68d88948d8-tbpj2\" (UID: \"c593e9e1-f878-4bdf-9df7-73d889296964\") " pod="kuadrant-system/authorino-operator-68d88948d8-tbpj2"
Sep 07 21:10:06.204145 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:06.204059    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-tbpj2"
Sep 07 21:10:06.490446 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:06.490422    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-tbpj2"]
Sep 07 21:10:06.492607 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:10:06.492581    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc593e9e1_f878_4bdf_9df7_73d889296964.slice/crio-14e41629d539afea6269f66e2b24a8d331159f88ac25205ec60baf1b098c2300 WatchSource:0}: Error finding container 14e41629d539afea6269f66e2b24a8d331159f88ac25205ec60baf1b098c2300: Status 404 returned error can't find the container with id 14e41629d539afea6269f66e2b24a8d331159f88ac25205ec60baf1b098c2300
Sep 07 21:10:06.493138 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:06.493107    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xg25t" event={"ID":"089701ef-604b-4d35-a5b2-6cac3448486e","Type":"ContainerStarted","Data":"77721256b96c67bc3ead898aba214cb50d303fbe76e58b0b106f1b9f36722c69"}
Sep 07 21:10:06.493259 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:06.493239    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xg25t"
Sep 07 21:10:06.521222 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:06.521157    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xg25t" podStartSLOduration=1.755085448 podStartE2EDuration="3.521140763s" totalImagesPullingTime="1.766055315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:10:06.519335911 +0000 UTC m=+502.779153165" watchObservedRunningTime="2026-09-07 21:10:06.521140763 +0000 UTC m=+502.780958006"
Sep 07 21:10:07.499188 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:07.499149    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-tbpj2" event={"ID":"c593e9e1-f878-4bdf-9df7-73d889296964","Type":"ContainerStarted","Data":"14e41629d539afea6269f66e2b24a8d331159f88ac25205ec60baf1b098c2300"}
Sep 07 21:10:08.505817 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:08.505724    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-tbpj2" event={"ID":"c593e9e1-f878-4bdf-9df7-73d889296964","Type":"ContainerStarted","Data":"e90f1727ca54efd8bea09bb485e985d829e4633b5bf316dd6bf8271514064366"}
Sep 07 21:10:08.506166 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:08.505847    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-tbpj2"
Sep 07 21:10:08.525811 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:08.525763    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-tbpj2" podStartSLOduration=1.766067868 podStartE2EDuration="3.525745552s" totalImagesPullingTime="1.759677684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:10:08.523724192 +0000 UTC m=+504.783541432" watchObservedRunningTime="2026-09-07 21:10:08.525745552 +0000 UTC m=+504.785562795"
Sep 07 21:10:15.487906 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:15.487873    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw"
Sep 07 21:10:17.501918 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.501886    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xg25t"
Sep 07 21:10:17.558651 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.558620    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw"]
Sep 07 21:10:17.558839 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.558815    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw" podUID="6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206" containerName="manager" containerID="cri-o://ea582010efac2ce6a07a3bfdc913a1b9dccdb64f02c5a3bb2f1b8a2209165709" gracePeriod=2
Sep 07 21:10:17.571278 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.571249    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw"]
Sep 07 21:10:17.582444 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.582421    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4"]
Sep 07 21:10:17.582756 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.582743    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206" containerName="manager"
Sep 07 21:10:17.582798 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.582758    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206" containerName="manager"
Sep 07 21:10:17.582858 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.582847    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206" containerName="manager"
Sep 07 21:10:17.585159 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:10:17.585131    2558 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-58fc56757c-xfxdw\": pods \"kuadrant-operator-controller-manager-58fc56757c-xfxdw\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw"
Sep 07 21:10:17.585821 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.585799    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4"
Sep 07 21:10:17.587792 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:10:17.587763    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-xfxdw\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" podUID="6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw"
Sep 07 21:10:17.607193 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.607158    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4"]
Sep 07 21:10:17.642589 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.642557    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c73586c4-2efb-420f-946f-127725498a06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-mq7q4\" (UID: \"c73586c4-2efb-420f-946f-127725498a06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4"
Sep 07 21:10:17.642725 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.642671    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgh2l\" (UniqueName: \"kubernetes.io/projected/c73586c4-2efb-420f-946f-127725498a06-kube-api-access-fgh2l\") pod \"kuadrant-operator-controller-manager-58fc56757c-mq7q4\" (UID: \"c73586c4-2efb-420f-946f-127725498a06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4"
Sep 07 21:10:17.743467 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.743437    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgh2l\" (UniqueName: \"kubernetes.io/projected/c73586c4-2efb-420f-946f-127725498a06-kube-api-access-fgh2l\") pod \"kuadrant-operator-controller-manager-58fc56757c-mq7q4\" (UID: \"c73586c4-2efb-420f-946f-127725498a06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4"
Sep 07 21:10:17.743588 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.743496    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c73586c4-2efb-420f-946f-127725498a06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-mq7q4\" (UID: \"c73586c4-2efb-420f-946f-127725498a06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4"
Sep 07 21:10:17.743912 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.743892    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c73586c4-2efb-420f-946f-127725498a06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-mq7q4\" (UID: \"c73586c4-2efb-420f-946f-127725498a06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4"
Sep 07 21:10:17.754842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.754779    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgh2l\" (UniqueName: \"kubernetes.io/projected/c73586c4-2efb-420f-946f-127725498a06-kube-api-access-fgh2l\") pod \"kuadrant-operator-controller-manager-58fc56757c-mq7q4\" (UID: \"c73586c4-2efb-420f-946f-127725498a06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4"
Sep 07 21:10:17.799906 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.799879    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw"
Sep 07 21:10:17.801765 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:10:17.801738    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-xfxdw\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" podUID="6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw"
Sep 07 21:10:17.844213 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.844181    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206-extensions-socket-volume\") pod \"6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206\" (UID: \"6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206\") "
Sep 07 21:10:17.844365 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.844262    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbdxk\" (UniqueName: \"kubernetes.io/projected/6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206-kube-api-access-wbdxk\") pod \"6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206\" (UID: \"6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206\") "
Sep 07 21:10:17.844783 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.844757    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206" (UID: "6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:10:17.846535 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.846515    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206-kube-api-access-wbdxk" (OuterVolumeSpecName: "kube-api-access-wbdxk") pod "6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206" (UID: "6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206"). InnerVolumeSpecName "kube-api-access-wbdxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:10:17.943657 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.943621    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4"
Sep 07 21:10:17.944918 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.944896    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206-extensions-socket-volume\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:10:17.944999 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:17.944920    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbdxk\" (UniqueName: \"kubernetes.io/projected/6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206-kube-api-access-wbdxk\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:10:18.228572 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:18.228545    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4"]
Sep 07 21:10:18.230537 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:10:18.230512    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc73586c4_2efb_420f_946f_127725498a06.slice/crio-23fa244b7072335462f5489d3687224dc703882290bcb97e08c31c2ac9386b87 WatchSource:0}: Error finding container 23fa244b7072335462f5489d3687224dc703882290bcb97e08c31c2ac9386b87: Status 404 returned error can't find the container with id 23fa244b7072335462f5489d3687224dc703882290bcb97e08c31c2ac9386b87
Sep 07 21:10:18.308005 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:18.307978    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206" path="/var/lib/kubelet/pods/6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206/volumes"
Sep 07 21:10:18.557145 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:18.557113    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4" event={"ID":"c73586c4-2efb-420f-946f-127725498a06","Type":"ContainerStarted","Data":"f7e40b3f6309b1e3fca02c3e4835a852582fd6146ea9f275c36ef2d3aad36081"}
Sep 07 21:10:18.557590 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:18.557170    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4" event={"ID":"c73586c4-2efb-420f-946f-127725498a06","Type":"ContainerStarted","Data":"23fa244b7072335462f5489d3687224dc703882290bcb97e08c31c2ac9386b87"}
Sep 07 21:10:18.557590 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:18.557202    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4"
Sep 07 21:10:18.558617 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:18.558594    2558 generic.go:356] "Generic (PLEG): container finished" podID="6cbc5bdb-003a-40fe-b9c5-1d2c6a12a206" containerID="ea582010efac2ce6a07a3bfdc913a1b9dccdb64f02c5a3bb2f1b8a2209165709" exitCode=0
Sep 07 21:10:18.558713 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:18.558630    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xfxdw"
Sep 07 21:10:18.558713 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:18.558683    2558 scope.go:117] "RemoveContainer" containerID="ea582010efac2ce6a07a3bfdc913a1b9dccdb64f02c5a3bb2f1b8a2209165709"
Sep 07 21:10:18.567083 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:18.567065    2558 scope.go:117] "RemoveContainer" containerID="ea582010efac2ce6a07a3bfdc913a1b9dccdb64f02c5a3bb2f1b8a2209165709"
Sep 07 21:10:18.567357 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:10:18.567339    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea582010efac2ce6a07a3bfdc913a1b9dccdb64f02c5a3bb2f1b8a2209165709\": container with ID starting with ea582010efac2ce6a07a3bfdc913a1b9dccdb64f02c5a3bb2f1b8a2209165709 not found: ID does not exist" containerID="ea582010efac2ce6a07a3bfdc913a1b9dccdb64f02c5a3bb2f1b8a2209165709"
Sep 07 21:10:18.567409 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:18.567363    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea582010efac2ce6a07a3bfdc913a1b9dccdb64f02c5a3bb2f1b8a2209165709"} err="failed to get container status \"ea582010efac2ce6a07a3bfdc913a1b9dccdb64f02c5a3bb2f1b8a2209165709\": rpc error: code = NotFound desc = could not find container \"ea582010efac2ce6a07a3bfdc913a1b9dccdb64f02c5a3bb2f1b8a2209165709\": container with ID starting with ea582010efac2ce6a07a3bfdc913a1b9dccdb64f02c5a3bb2f1b8a2209165709 not found: ID does not exist"
Sep 07 21:10:18.579655 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:18.579610    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4" podStartSLOduration=1.579591932 podStartE2EDuration="1.579591932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:10:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:10:18.577163318 +0000 UTC m=+514.836980562" watchObservedRunningTime="2026-09-07 21:10:18.579591932 +0000 UTC m=+514.839409175"
Sep 07 21:10:19.514153 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:19.514122    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-tbpj2"
Sep 07 21:10:29.567925 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:29.567894    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4"
Sep 07 21:10:34.232343 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:34.232294    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4"]
Sep 07 21:10:34.232867 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:34.232561    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4" podUID="c73586c4-2efb-420f-946f-127725498a06" containerName="manager" containerID="cri-o://f7e40b3f6309b1e3fca02c3e4835a852582fd6146ea9f275c36ef2d3aad36081" gracePeriod=10
Sep 07 21:10:34.519027 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:34.518992    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4"
Sep 07 21:10:34.591728 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:34.591697    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgh2l\" (UniqueName: \"kubernetes.io/projected/c73586c4-2efb-420f-946f-127725498a06-kube-api-access-fgh2l\") pod \"c73586c4-2efb-420f-946f-127725498a06\" (UID: \"c73586c4-2efb-420f-946f-127725498a06\") "
Sep 07 21:10:34.591916 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:34.591759    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c73586c4-2efb-420f-946f-127725498a06-extensions-socket-volume\") pod \"c73586c4-2efb-420f-946f-127725498a06\" (UID: \"c73586c4-2efb-420f-946f-127725498a06\") "
Sep 07 21:10:34.592132 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:34.592105    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c73586c4-2efb-420f-946f-127725498a06-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c73586c4-2efb-420f-946f-127725498a06" (UID: "c73586c4-2efb-420f-946f-127725498a06"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:10:34.593811 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:34.593787    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c73586c4-2efb-420f-946f-127725498a06-kube-api-access-fgh2l" (OuterVolumeSpecName: "kube-api-access-fgh2l") pod "c73586c4-2efb-420f-946f-127725498a06" (UID: "c73586c4-2efb-420f-946f-127725498a06"). InnerVolumeSpecName "kube-api-access-fgh2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:10:34.643534 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:34.643495    2558 generic.go:356] "Generic (PLEG): container finished" podID="c73586c4-2efb-420f-946f-127725498a06" containerID="f7e40b3f6309b1e3fca02c3e4835a852582fd6146ea9f275c36ef2d3aad36081" exitCode=0
Sep 07 21:10:34.643681 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:34.643550    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4"
Sep 07 21:10:34.643681 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:34.643581    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4" event={"ID":"c73586c4-2efb-420f-946f-127725498a06","Type":"ContainerDied","Data":"f7e40b3f6309b1e3fca02c3e4835a852582fd6146ea9f275c36ef2d3aad36081"}
Sep 07 21:10:34.643681 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:34.643665    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4" event={"ID":"c73586c4-2efb-420f-946f-127725498a06","Type":"ContainerDied","Data":"23fa244b7072335462f5489d3687224dc703882290bcb97e08c31c2ac9386b87"}
Sep 07 21:10:34.643809 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:34.643690    2558 scope.go:117] "RemoveContainer" containerID="f7e40b3f6309b1e3fca02c3e4835a852582fd6146ea9f275c36ef2d3aad36081"
Sep 07 21:10:34.660754 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:34.660730    2558 scope.go:117] "RemoveContainer" containerID="f7e40b3f6309b1e3fca02c3e4835a852582fd6146ea9f275c36ef2d3aad36081"
Sep 07 21:10:34.661019 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:10:34.661002    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7e40b3f6309b1e3fca02c3e4835a852582fd6146ea9f275c36ef2d3aad36081\": container with ID starting with f7e40b3f6309b1e3fca02c3e4835a852582fd6146ea9f275c36ef2d3aad36081 not found: ID does not exist" containerID="f7e40b3f6309b1e3fca02c3e4835a852582fd6146ea9f275c36ef2d3aad36081"
Sep 07 21:10:34.661064 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:34.661029    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7e40b3f6309b1e3fca02c3e4835a852582fd6146ea9f275c36ef2d3aad36081"} err="failed to get container status \"f7e40b3f6309b1e3fca02c3e4835a852582fd6146ea9f275c36ef2d3aad36081\": rpc error: code = NotFound desc = could not find container \"f7e40b3f6309b1e3fca02c3e4835a852582fd6146ea9f275c36ef2d3aad36081\": container with ID starting with f7e40b3f6309b1e3fca02c3e4835a852582fd6146ea9f275c36ef2d3aad36081 not found: ID does not exist"
Sep 07 21:10:34.669102 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:34.669077    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4"]
Sep 07 21:10:34.672967 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:34.672944    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mq7q4"]
Sep 07 21:10:34.693121 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:34.693094    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c73586c4-2efb-420f-946f-127725498a06-extensions-socket-volume\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:10:34.693121 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:34.693120    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgh2l\" (UniqueName: \"kubernetes.io/projected/c73586c4-2efb-420f-946f-127725498a06-kube-api-access-fgh2l\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:10:36.308235 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:36.308204    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c73586c4-2efb-420f-946f-127725498a06" path="/var/lib/kubelet/pods/c73586c4-2efb-420f-946f-127725498a06/volumes"
Sep 07 21:10:50.496158 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.496124    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"]
Sep 07 21:10:50.496561 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.496452    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c73586c4-2efb-420f-946f-127725498a06" containerName="manager"
Sep 07 21:10:50.496561 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.496465    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c73586c4-2efb-420f-946f-127725498a06" containerName="manager"
Sep 07 21:10:50.496561 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.496550    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c73586c4-2efb-420f-946f-127725498a06" containerName="manager"
Sep 07 21:10:50.501734 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.501712    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.505371 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.505351    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-89ztr\""
Sep 07 21:10:50.516550 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.516527    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"]
Sep 07 21:10:50.531204 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.531177    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef9ca3c5-5438-430a-8b66-8862c766feb8-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.531204 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.531210    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef9ca3c5-5438-430a-8b66-8862c766feb8-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.531399 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.531244    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef9ca3c5-5438-430a-8b66-8862c766feb8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.531399 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.531304    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef9ca3c5-5438-430a-8b66-8862c766feb8-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.531399 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.531345    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef9ca3c5-5438-430a-8b66-8862c766feb8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.531399 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.531366    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef9ca3c5-5438-430a-8b66-8862c766feb8-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.531399 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.531387    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef9ca3c5-5438-430a-8b66-8862c766feb8-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.531581 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.531521    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef9ca3c5-5438-430a-8b66-8862c766feb8-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.531635 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.531595    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5sm5\" (UniqueName: \"kubernetes.io/projected/ef9ca3c5-5438-430a-8b66-8862c766feb8-kube-api-access-j5sm5\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.632884 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.632845    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef9ca3c5-5438-430a-8b66-8862c766feb8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.633077 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.632901    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef9ca3c5-5438-430a-8b66-8862c766feb8-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.633077 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.633025    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef9ca3c5-5438-430a-8b66-8862c766feb8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.633077 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.633072    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef9ca3c5-5438-430a-8b66-8862c766feb8-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.633245 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.633098    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef9ca3c5-5438-430a-8b66-8862c766feb8-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.633245 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.633144    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef9ca3c5-5438-430a-8b66-8862c766feb8-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.633245 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.633201    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5sm5\" (UniqueName: \"kubernetes.io/projected/ef9ca3c5-5438-430a-8b66-8862c766feb8-kube-api-access-j5sm5\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.633435 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.633243    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef9ca3c5-5438-430a-8b66-8862c766feb8-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.633435 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.633251    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef9ca3c5-5438-430a-8b66-8862c766feb8-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.633435 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.633277    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef9ca3c5-5438-430a-8b66-8862c766feb8-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.633606 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.633587    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef9ca3c5-5438-430a-8b66-8862c766feb8-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.633724 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.633659    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef9ca3c5-5438-430a-8b66-8862c766feb8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.633724 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.633667    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef9ca3c5-5438-430a-8b66-8862c766feb8-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.633838 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.633763    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef9ca3c5-5438-430a-8b66-8862c766feb8-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.635585 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.635560    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef9ca3c5-5438-430a-8b66-8862c766feb8-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.635792 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.635775    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef9ca3c5-5438-430a-8b66-8862c766feb8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.642935 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.642911    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef9ca3c5-5438-430a-8b66-8862c766feb8-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.643155 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.643138    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5sm5\" (UniqueName: \"kubernetes.io/projected/ef9ca3c5-5438-430a-8b66-8862c766feb8-kube-api-access-j5sm5\") pod \"maas-default-gateway-openshift-default-78bb78ff78-f8cm7\" (UID: \"ef9ca3c5-5438-430a-8b66-8862c766feb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:50.811842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:50.811812    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:51.085018 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:51.084991    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"]
Sep 07 21:10:51.086820 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:10:51.086786    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef9ca3c5_5438_430a_8b66_8862c766feb8.slice/crio-a6750ee8e71a7c4524e99c35bfe50069a07e51db08440cf10c3a755b4216ab75 WatchSource:0}: Error finding container a6750ee8e71a7c4524e99c35bfe50069a07e51db08440cf10c3a755b4216ab75: Status 404 returned error can't find the container with id a6750ee8e71a7c4524e99c35bfe50069a07e51db08440cf10c3a755b4216ab75
Sep 07 21:10:51.088992 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:51.088956    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:10:51.089095 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:51.089037    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:10:51.089095 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:51.089068    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:10:51.734057 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:51.734018    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7" event={"ID":"ef9ca3c5-5438-430a-8b66-8862c766feb8","Type":"ContainerStarted","Data":"e6659d428c38334a70be2ef85b8266c66cd5334445bb5b9152774b7a3c0f5657"}
Sep 07 21:10:51.734466 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:51.734080    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7" event={"ID":"ef9ca3c5-5438-430a-8b66-8862c766feb8","Type":"ContainerStarted","Data":"a6750ee8e71a7c4524e99c35bfe50069a07e51db08440cf10c3a755b4216ab75"}
Sep 07 21:10:51.754545 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:51.754493    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7" podStartSLOduration=1.7544754230000001 podStartE2EDuration="1.754475423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:10:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:10:51.753222497 +0000 UTC m=+548.013039758" watchObservedRunningTime="2026-09-07 21:10:51.754475423 +0000 UTC m=+548.014292666"
Sep 07 21:10:51.812463 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:51.812428    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:52.692949 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:52.692914    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qgpx4"]
Sep 07 21:10:52.696572 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:52.696555    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-qgpx4"
Sep 07 21:10:52.698666 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:52.698643    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lj85v\""
Sep 07 21:10:52.698770 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:52.698681    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 07 21:10:52.703611 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:52.703589    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qgpx4"]
Sep 07 21:10:52.754440 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:52.754405    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/536a239d-9898-470c-bd27-a0f7506170a2-config-file\") pod \"limitador-limitador-859c4d96d6-qgpx4\" (UID: \"536a239d-9898-470c-bd27-a0f7506170a2\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qgpx4"
Sep 07 21:10:52.755068 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:52.755037    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz526\" (UniqueName: \"kubernetes.io/projected/536a239d-9898-470c-bd27-a0f7506170a2-kube-api-access-pz526\") pod \"limitador-limitador-859c4d96d6-qgpx4\" (UID: \"536a239d-9898-470c-bd27-a0f7506170a2\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qgpx4"
Sep 07 21:10:52.781830 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:52.781796    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qgpx4"]
Sep 07 21:10:52.817033 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:52.817007    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:52.856280 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:52.856243    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz526\" (UniqueName: \"kubernetes.io/projected/536a239d-9898-470c-bd27-a0f7506170a2-kube-api-access-pz526\") pod \"limitador-limitador-859c4d96d6-qgpx4\" (UID: \"536a239d-9898-470c-bd27-a0f7506170a2\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qgpx4"
Sep 07 21:10:52.856485 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:52.856333    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/536a239d-9898-470c-bd27-a0f7506170a2-config-file\") pod \"limitador-limitador-859c4d96d6-qgpx4\" (UID: \"536a239d-9898-470c-bd27-a0f7506170a2\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qgpx4"
Sep 07 21:10:52.856998 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:52.856979    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/536a239d-9898-470c-bd27-a0f7506170a2-config-file\") pod \"limitador-limitador-859c4d96d6-qgpx4\" (UID: \"536a239d-9898-470c-bd27-a0f7506170a2\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qgpx4"
Sep 07 21:10:52.864885 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:52.864852    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz526\" (UniqueName: \"kubernetes.io/projected/536a239d-9898-470c-bd27-a0f7506170a2-kube-api-access-pz526\") pod \"limitador-limitador-859c4d96d6-qgpx4\" (UID: \"536a239d-9898-470c-bd27-a0f7506170a2\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qgpx4"
Sep 07 21:10:53.008512 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:53.008418    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-qgpx4"
Sep 07 21:10:53.277146 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:53.277065    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qgpx4"]
Sep 07 21:10:53.280638 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:10:53.280598    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod536a239d_9898_470c_bd27_a0f7506170a2.slice/crio-53bf47f0b114d1c87a6f398dec184a634eb260fc921cecdbfb425a5f2749ecf3 WatchSource:0}: Error finding container 53bf47f0b114d1c87a6f398dec184a634eb260fc921cecdbfb425a5f2749ecf3: Status 404 returned error can't find the container with id 53bf47f0b114d1c87a6f398dec184a634eb260fc921cecdbfb425a5f2749ecf3
Sep 07 21:10:53.746011 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:53.745976    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-qgpx4" event={"ID":"536a239d-9898-470c-bd27-a0f7506170a2","Type":"ContainerStarted","Data":"53bf47f0b114d1c87a6f398dec184a634eb260fc921cecdbfb425a5f2749ecf3"}
Sep 07 21:10:53.746217 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:53.746171    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:53.747082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:53.747060    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:10:55.757759 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:55.757723    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-qgpx4" event={"ID":"536a239d-9898-470c-bd27-a0f7506170a2","Type":"ContainerStarted","Data":"b51c339b992690f46c2b075148b76397169f6caab4fd5b1aa9abad74078fb6c1"}
Sep 07 21:10:55.773603 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:55.773556    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-qgpx4" podStartSLOduration=2.309147635 podStartE2EDuration="3.773538609s" totalImagesPullingTime="1.464390974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:10:55.772085521 +0000 UTC m=+552.031902764" watchObservedRunningTime="2026-09-07 21:10:55.773538609 +0000 UTC m=+552.033355854"
Sep 07 21:10:56.764006 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:10:56.763972    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-qgpx4"
Sep 07 21:11:07.663877 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:07.663845    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qgpx4"]
Sep 07 21:11:07.664498 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:07.664032    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-qgpx4" podUID="536a239d-9898-470c-bd27-a0f7506170a2" containerName="limitador" containerID="cri-o://b51c339b992690f46c2b075148b76397169f6caab4fd5b1aa9abad74078fb6c1" gracePeriod=30
Sep 07 21:11:07.664930 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:07.664783    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-qgpx4"
Sep 07 21:11:08.206985 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:08.206960    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-qgpx4"
Sep 07 21:11:08.283272 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:08.283186    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/536a239d-9898-470c-bd27-a0f7506170a2-config-file\") pod \"536a239d-9898-470c-bd27-a0f7506170a2\" (UID: \"536a239d-9898-470c-bd27-a0f7506170a2\") "
Sep 07 21:11:08.283272 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:08.283267    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz526\" (UniqueName: \"kubernetes.io/projected/536a239d-9898-470c-bd27-a0f7506170a2-kube-api-access-pz526\") pod \"536a239d-9898-470c-bd27-a0f7506170a2\" (UID: \"536a239d-9898-470c-bd27-a0f7506170a2\") "
Sep 07 21:11:08.283687 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:08.283659    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/536a239d-9898-470c-bd27-a0f7506170a2-config-file" (OuterVolumeSpecName: "config-file") pod "536a239d-9898-470c-bd27-a0f7506170a2" (UID: "536a239d-9898-470c-bd27-a0f7506170a2"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:11:08.285368 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:08.285347    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/536a239d-9898-470c-bd27-a0f7506170a2-kube-api-access-pz526" (OuterVolumeSpecName: "kube-api-access-pz526") pod "536a239d-9898-470c-bd27-a0f7506170a2" (UID: "536a239d-9898-470c-bd27-a0f7506170a2"). InnerVolumeSpecName "kube-api-access-pz526". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:11:08.384773 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:08.384738    2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/536a239d-9898-470c-bd27-a0f7506170a2-config-file\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:11:08.384773 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:08.384767    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz526\" (UniqueName: \"kubernetes.io/projected/536a239d-9898-470c-bd27-a0f7506170a2-kube-api-access-pz526\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:11:08.826034 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:08.825997    2558 generic.go:356] "Generic (PLEG): container finished" podID="536a239d-9898-470c-bd27-a0f7506170a2" containerID="b51c339b992690f46c2b075148b76397169f6caab4fd5b1aa9abad74078fb6c1" exitCode=0
Sep 07 21:11:08.826432 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:08.826046    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-qgpx4"
Sep 07 21:11:08.826432 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:08.826086    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-qgpx4" event={"ID":"536a239d-9898-470c-bd27-a0f7506170a2","Type":"ContainerDied","Data":"b51c339b992690f46c2b075148b76397169f6caab4fd5b1aa9abad74078fb6c1"}
Sep 07 21:11:08.826432 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:08.826154    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-qgpx4" event={"ID":"536a239d-9898-470c-bd27-a0f7506170a2","Type":"ContainerDied","Data":"53bf47f0b114d1c87a6f398dec184a634eb260fc921cecdbfb425a5f2749ecf3"}
Sep 07 21:11:08.826432 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:08.826184    2558 scope.go:117] "RemoveContainer" containerID="b51c339b992690f46c2b075148b76397169f6caab4fd5b1aa9abad74078fb6c1"
Sep 07 21:11:08.835640 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:08.835622    2558 scope.go:117] "RemoveContainer" containerID="b51c339b992690f46c2b075148b76397169f6caab4fd5b1aa9abad74078fb6c1"
Sep 07 21:11:08.835918 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:11:08.835900    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b51c339b992690f46c2b075148b76397169f6caab4fd5b1aa9abad74078fb6c1\": container with ID starting with b51c339b992690f46c2b075148b76397169f6caab4fd5b1aa9abad74078fb6c1 not found: ID does not exist" containerID="b51c339b992690f46c2b075148b76397169f6caab4fd5b1aa9abad74078fb6c1"
Sep 07 21:11:08.835973 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:08.835926    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b51c339b992690f46c2b075148b76397169f6caab4fd5b1aa9abad74078fb6c1"} err="failed to get container status \"b51c339b992690f46c2b075148b76397169f6caab4fd5b1aa9abad74078fb6c1\": rpc error: code = NotFound desc = could not find container \"b51c339b992690f46c2b075148b76397169f6caab4fd5b1aa9abad74078fb6c1\": container with ID starting with b51c339b992690f46c2b075148b76397169f6caab4fd5b1aa9abad74078fb6c1 not found: ID does not exist"
Sep 07 21:11:08.847400 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:08.847375    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qgpx4"]
Sep 07 21:11:08.859477 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:08.859458    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qgpx4"]
Sep 07 21:11:09.240781 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:09.240711    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mwzrx"]
Sep 07 21:11:09.246597 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:09.246565    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="536a239d-9898-470c-bd27-a0f7506170a2" containerName="limitador"
Sep 07 21:11:09.248422 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:09.246770    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="536a239d-9898-470c-bd27-a0f7506170a2" containerName="limitador"
Sep 07 21:11:09.248422 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:09.246982    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="536a239d-9898-470c-bd27-a0f7506170a2" containerName="limitador"
Sep 07 21:11:09.252081 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:09.252047    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mwzrx"]
Sep 07 21:11:09.252173 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:09.252155    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mwzrx"
Sep 07 21:11:09.254485 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:09.254460    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 21:11:09.254610 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:09.254471    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 07 21:11:09.254610 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:09.254600    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 07 21:11:09.255222 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:09.255202    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-2dc7x\""
Sep 07 21:11:09.292159 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:09.292133    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e8f13238-2fdf-45ce-8a06-ffbd270b33ce-data\") pod \"postgres-69fb4594cf-mwzrx\" (UID: \"e8f13238-2fdf-45ce-8a06-ffbd270b33ce\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mwzrx"
Sep 07 21:11:09.292261 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:09.292206    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmx5t\" (UniqueName: \"kubernetes.io/projected/e8f13238-2fdf-45ce-8a06-ffbd270b33ce-kube-api-access-mmx5t\") pod \"postgres-69fb4594cf-mwzrx\" (UID: \"e8f13238-2fdf-45ce-8a06-ffbd270b33ce\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mwzrx"
Sep 07 21:11:09.393298 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:09.393261    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e8f13238-2fdf-45ce-8a06-ffbd270b33ce-data\") pod \"postgres-69fb4594cf-mwzrx\" (UID: \"e8f13238-2fdf-45ce-8a06-ffbd270b33ce\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mwzrx"
Sep 07 21:11:09.393497 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:09.393374    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmx5t\" (UniqueName: \"kubernetes.io/projected/e8f13238-2fdf-45ce-8a06-ffbd270b33ce-kube-api-access-mmx5t\") pod \"postgres-69fb4594cf-mwzrx\" (UID: \"e8f13238-2fdf-45ce-8a06-ffbd270b33ce\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mwzrx"
Sep 07 21:11:09.393680 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:09.393659    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e8f13238-2fdf-45ce-8a06-ffbd270b33ce-data\") pod \"postgres-69fb4594cf-mwzrx\" (UID: \"e8f13238-2fdf-45ce-8a06-ffbd270b33ce\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mwzrx"
Sep 07 21:11:09.402149 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:09.402123    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmx5t\" (UniqueName: \"kubernetes.io/projected/e8f13238-2fdf-45ce-8a06-ffbd270b33ce-kube-api-access-mmx5t\") pod \"postgres-69fb4594cf-mwzrx\" (UID: \"e8f13238-2fdf-45ce-8a06-ffbd270b33ce\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mwzrx"
Sep 07 21:11:09.563863 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:09.563833    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mwzrx"
Sep 07 21:11:09.832587 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:09.832442    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mwzrx"]
Sep 07 21:11:09.836927 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:11:09.836900    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8f13238_2fdf_45ce_8a06_ffbd270b33ce.slice/crio-b68b2b993717e64fbfa124d73421254d2fd2b43ed05493cd6104ae765a9904f4 WatchSource:0}: Error finding container b68b2b993717e64fbfa124d73421254d2fd2b43ed05493cd6104ae765a9904f4: Status 404 returned error can't find the container with id b68b2b993717e64fbfa124d73421254d2fd2b43ed05493cd6104ae765a9904f4
Sep 07 21:11:10.308162 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:10.308126    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="536a239d-9898-470c-bd27-a0f7506170a2" path="/var/lib/kubelet/pods/536a239d-9898-470c-bd27-a0f7506170a2/volumes"
Sep 07 21:11:10.846303 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:10.846229    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mwzrx" event={"ID":"e8f13238-2fdf-45ce-8a06-ffbd270b33ce","Type":"ContainerStarted","Data":"b68b2b993717e64fbfa124d73421254d2fd2b43ed05493cd6104ae765a9904f4"}
Sep 07 21:11:14.873781 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:14.873751    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mwzrx" event={"ID":"e8f13238-2fdf-45ce-8a06-ffbd270b33ce","Type":"ContainerStarted","Data":"e696e311c6a175e8d5c00ce401f067b388825e6fd27af8d911ddd4e82430e178"}
Sep 07 21:11:14.874096 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:14.873866    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mwzrx"
Sep 07 21:11:14.889515 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:14.889464    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mwzrx" podStartSLOduration=0.927838305 podStartE2EDuration="5.889447769s" totalImagesPullingTime="4.961609464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:11:14.886967181 +0000 UTC m=+571.146784431" watchObservedRunningTime="2026-09-07 21:11:14.889447769 +0000 UTC m=+571.149265012"
Sep 07 21:11:20.909503 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:20.909474    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mwzrx"
Sep 07 21:11:28.250771 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.250731    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9d4d876c8-82m4c"]
Sep 07 21:11:28.271557 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.271523    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9d4d876c8-82m4c"]
Sep 07 21:11:28.271709 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.271608    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9d4d876c8-82m4c"
Sep 07 21:11:28.273945 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.273919    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 07 21:11:28.274212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.274186    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dchmp\""
Sep 07 21:11:28.274372 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.273956    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 07 21:11:28.274450 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.274378    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 07 21:11:28.364686 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.364621    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdv7x\" (UniqueName: \"kubernetes.io/projected/048efa52-77e8-4266-92ed-69631bf65724-kube-api-access-xdv7x\") pod \"maas-controller-9d4d876c8-82m4c\" (UID: \"048efa52-77e8-4266-92ed-69631bf65724\") " pod="opendatahub/maas-controller-9d4d876c8-82m4c"
Sep 07 21:11:28.364686 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.364688    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/048efa52-77e8-4266-92ed-69631bf65724-webhook-cert\") pod \"maas-controller-9d4d876c8-82m4c\" (UID: \"048efa52-77e8-4266-92ed-69631bf65724\") " pod="opendatahub/maas-controller-9d4d876c8-82m4c"
Sep 07 21:11:28.364903 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.364714    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/048efa52-77e8-4266-92ed-69631bf65724-metrics-certs\") pod \"maas-controller-9d4d876c8-82m4c\" (UID: \"048efa52-77e8-4266-92ed-69631bf65724\") " pod="opendatahub/maas-controller-9d4d876c8-82m4c"
Sep 07 21:11:28.418209 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.418169    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59f5bb5dd-65tbd"]
Sep 07 21:11:28.420936 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.420913    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59f5bb5dd-65tbd"
Sep 07 21:11:28.431873 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.431847    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59f5bb5dd-65tbd"]
Sep 07 21:11:28.465629 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.465596    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdv7x\" (UniqueName: \"kubernetes.io/projected/048efa52-77e8-4266-92ed-69631bf65724-kube-api-access-xdv7x\") pod \"maas-controller-9d4d876c8-82m4c\" (UID: \"048efa52-77e8-4266-92ed-69631bf65724\") " pod="opendatahub/maas-controller-9d4d876c8-82m4c"
Sep 07 21:11:28.465629 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.465638    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/048efa52-77e8-4266-92ed-69631bf65724-webhook-cert\") pod \"maas-controller-9d4d876c8-82m4c\" (UID: \"048efa52-77e8-4266-92ed-69631bf65724\") " pod="opendatahub/maas-controller-9d4d876c8-82m4c"
Sep 07 21:11:28.465875 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.465663    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/048efa52-77e8-4266-92ed-69631bf65724-metrics-certs\") pod \"maas-controller-9d4d876c8-82m4c\" (UID: \"048efa52-77e8-4266-92ed-69631bf65724\") " pod="opendatahub/maas-controller-9d4d876c8-82m4c"
Sep 07 21:11:28.465875 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:11:28.465787    2558 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 07 21:11:28.465875 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:11:28.465855    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048efa52-77e8-4266-92ed-69631bf65724-metrics-certs podName:048efa52-77e8-4266-92ed-69631bf65724 nodeName:}" failed. No retries permitted until 2026-09-07 21:11:28.965834321 +0000 UTC m=+585.225651562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/048efa52-77e8-4266-92ed-69631bf65724-metrics-certs") pod "maas-controller-9d4d876c8-82m4c" (UID: "048efa52-77e8-4266-92ed-69631bf65724") : secret "maas-controller-metrics-tls" not found
Sep 07 21:11:28.468038 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.468015    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/048efa52-77e8-4266-92ed-69631bf65724-webhook-cert\") pod \"maas-controller-9d4d876c8-82m4c\" (UID: \"048efa52-77e8-4266-92ed-69631bf65724\") " pod="opendatahub/maas-controller-9d4d876c8-82m4c"
Sep 07 21:11:28.476253 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.476218    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdv7x\" (UniqueName: \"kubernetes.io/projected/048efa52-77e8-4266-92ed-69631bf65724-kube-api-access-xdv7x\") pod \"maas-controller-9d4d876c8-82m4c\" (UID: \"048efa52-77e8-4266-92ed-69631bf65724\") " pod="opendatahub/maas-controller-9d4d876c8-82m4c"
Sep 07 21:11:28.566872 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.566841    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxw6m\" (UniqueName: \"kubernetes.io/projected/90686432-ff48-415f-b61f-da2998912abe-kube-api-access-cxw6m\") pod \"maas-controller-59f5bb5dd-65tbd\" (UID: \"90686432-ff48-415f-b61f-da2998912abe\") " pod="opendatahub/maas-controller-59f5bb5dd-65tbd"
Sep 07 21:11:28.567034 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.566895    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90686432-ff48-415f-b61f-da2998912abe-webhook-cert\") pod \"maas-controller-59f5bb5dd-65tbd\" (UID: \"90686432-ff48-415f-b61f-da2998912abe\") " pod="opendatahub/maas-controller-59f5bb5dd-65tbd"
Sep 07 21:11:28.567034 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.566955    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90686432-ff48-415f-b61f-da2998912abe-metrics-certs\") pod \"maas-controller-59f5bb5dd-65tbd\" (UID: \"90686432-ff48-415f-b61f-da2998912abe\") " pod="opendatahub/maas-controller-59f5bb5dd-65tbd"
Sep 07 21:11:28.667612 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.667569    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxw6m\" (UniqueName: \"kubernetes.io/projected/90686432-ff48-415f-b61f-da2998912abe-kube-api-access-cxw6m\") pod \"maas-controller-59f5bb5dd-65tbd\" (UID: \"90686432-ff48-415f-b61f-da2998912abe\") " pod="opendatahub/maas-controller-59f5bb5dd-65tbd"
Sep 07 21:11:28.667803 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.667637    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90686432-ff48-415f-b61f-da2998912abe-webhook-cert\") pod \"maas-controller-59f5bb5dd-65tbd\" (UID: \"90686432-ff48-415f-b61f-da2998912abe\") " pod="opendatahub/maas-controller-59f5bb5dd-65tbd"
Sep 07 21:11:28.667803 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.667732    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90686432-ff48-415f-b61f-da2998912abe-metrics-certs\") pod \"maas-controller-59f5bb5dd-65tbd\" (UID: \"90686432-ff48-415f-b61f-da2998912abe\") " pod="opendatahub/maas-controller-59f5bb5dd-65tbd"
Sep 07 21:11:28.667871 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:11:28.667834    2558 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 07 21:11:28.667923 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:11:28.667912    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90686432-ff48-415f-b61f-da2998912abe-metrics-certs podName:90686432-ff48-415f-b61f-da2998912abe nodeName:}" failed. No retries permitted until 2026-09-07 21:11:29.16789248 +0000 UTC m=+585.427709704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90686432-ff48-415f-b61f-da2998912abe-metrics-certs") pod "maas-controller-59f5bb5dd-65tbd" (UID: "90686432-ff48-415f-b61f-da2998912abe") : secret "maas-controller-metrics-tls" not found
Sep 07 21:11:28.670285 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.670249    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90686432-ff48-415f-b61f-da2998912abe-webhook-cert\") pod \"maas-controller-59f5bb5dd-65tbd\" (UID: \"90686432-ff48-415f-b61f-da2998912abe\") " pod="opendatahub/maas-controller-59f5bb5dd-65tbd"
Sep 07 21:11:28.676074 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.676047    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxw6m\" (UniqueName: \"kubernetes.io/projected/90686432-ff48-415f-b61f-da2998912abe-kube-api-access-cxw6m\") pod \"maas-controller-59f5bb5dd-65tbd\" (UID: \"90686432-ff48-415f-b61f-da2998912abe\") " pod="opendatahub/maas-controller-59f5bb5dd-65tbd"
Sep 07 21:11:28.971733 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.971650    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/048efa52-77e8-4266-92ed-69631bf65724-metrics-certs\") pod \"maas-controller-9d4d876c8-82m4c\" (UID: \"048efa52-77e8-4266-92ed-69631bf65724\") " pod="opendatahub/maas-controller-9d4d876c8-82m4c"
Sep 07 21:11:28.974034 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:28.974001    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/048efa52-77e8-4266-92ed-69631bf65724-metrics-certs\") pod \"maas-controller-9d4d876c8-82m4c\" (UID: \"048efa52-77e8-4266-92ed-69631bf65724\") " pod="opendatahub/maas-controller-9d4d876c8-82m4c"
Sep 07 21:11:29.173395 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:29.173341    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90686432-ff48-415f-b61f-da2998912abe-metrics-certs\") pod \"maas-controller-59f5bb5dd-65tbd\" (UID: \"90686432-ff48-415f-b61f-da2998912abe\") " pod="opendatahub/maas-controller-59f5bb5dd-65tbd"
Sep 07 21:11:29.175765 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:29.175737    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90686432-ff48-415f-b61f-da2998912abe-metrics-certs\") pod \"maas-controller-59f5bb5dd-65tbd\" (UID: \"90686432-ff48-415f-b61f-da2998912abe\") " pod="opendatahub/maas-controller-59f5bb5dd-65tbd"
Sep 07 21:11:29.183625 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:29.183610    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9d4d876c8-82m4c"
Sep 07 21:11:29.332250 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:29.332211    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59f5bb5dd-65tbd"
Sep 07 21:11:29.452897 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:29.452871    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9d4d876c8-82m4c"]
Sep 07 21:11:29.454383 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:11:29.454356    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod048efa52_77e8_4266_92ed_69631bf65724.slice/crio-b0672b20fb36d7227b28cf5778a8d49bef1faf4b917692055ef5ab574f7f346e WatchSource:0}: Error finding container b0672b20fb36d7227b28cf5778a8d49bef1faf4b917692055ef5ab574f7f346e: Status 404 returned error can't find the container with id b0672b20fb36d7227b28cf5778a8d49bef1faf4b917692055ef5ab574f7f346e
Sep 07 21:11:29.602390 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:29.602363    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59f5bb5dd-65tbd"]
Sep 07 21:11:29.604453 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:11:29.604423    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90686432_ff48_415f_b61f_da2998912abe.slice/crio-b7810b66994d9e495491ae5db01719c29e7cb82195ebb31b87d278081a032aed WatchSource:0}: Error finding container b7810b66994d9e495491ae5db01719c29e7cb82195ebb31b87d278081a032aed: Status 404 returned error can't find the container with id b7810b66994d9e495491ae5db01719c29e7cb82195ebb31b87d278081a032aed
Sep 07 21:11:29.952954 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:29.952865    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59f5bb5dd-65tbd" event={"ID":"90686432-ff48-415f-b61f-da2998912abe","Type":"ContainerStarted","Data":"b7810b66994d9e495491ae5db01719c29e7cb82195ebb31b87d278081a032aed"}
Sep 07 21:11:29.954178 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:29.954144    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9d4d876c8-82m4c" event={"ID":"048efa52-77e8-4266-92ed-69631bf65724","Type":"ContainerStarted","Data":"b0672b20fb36d7227b28cf5778a8d49bef1faf4b917692055ef5ab574f7f346e"}
Sep 07 21:11:32.974322 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:32.974270    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9d4d876c8-82m4c" event={"ID":"048efa52-77e8-4266-92ed-69631bf65724","Type":"ContainerStarted","Data":"3e39cfe795189489aceb6ca6694fc1d443da5c289d7053910517452cb7cac993"}
Sep 07 21:11:32.974801 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:32.974439    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9d4d876c8-82m4c"
Sep 07 21:11:32.975982 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:32.975961    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59f5bb5dd-65tbd" event={"ID":"90686432-ff48-415f-b61f-da2998912abe","Type":"ContainerStarted","Data":"a617f2262c095749bf4f741beaeb1dbe82a9e81848ad897d5901ee9f5ea95f17"}
Sep 07 21:11:32.976080 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:32.976072    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59f5bb5dd-65tbd"
Sep 07 21:11:32.992369 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:32.992326    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9d4d876c8-82m4c" podStartSLOduration=2.370416191 podStartE2EDuration="4.992301777s" totalImagesPullingTime="2.621885586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:11:32.990184121 +0000 UTC m=+589.250001381" watchObservedRunningTime="2026-09-07 21:11:32.992301777 +0000 UTC m=+589.252119020"
Sep 07 21:11:33.007098 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:33.007052    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59f5bb5dd-65tbd" podStartSLOduration=2.524743055 podStartE2EDuration="5.007038364s" totalImagesPullingTime="2.482295309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:11:33.006081924 +0000 UTC m=+589.265899186" watchObservedRunningTime="2026-09-07 21:11:33.007038364 +0000 UTC m=+589.266855616"
Sep 07 21:11:43.983370 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:43.983338    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59f5bb5dd-65tbd"
Sep 07 21:11:43.983828 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:43.983416    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9d4d876c8-82m4c"
Sep 07 21:11:44.045176 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:44.045141    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9d4d876c8-82m4c"]
Sep 07 21:11:44.045431 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:44.045379    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-9d4d876c8-82m4c" podUID="048efa52-77e8-4266-92ed-69631bf65724" containerName="manager" containerID="cri-o://3e39cfe795189489aceb6ca6694fc1d443da5c289d7053910517452cb7cac993" gracePeriod=30
Sep 07 21:11:44.193426 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:44.193393    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-kv96r_d804af86-d937-4ea6-afb8-760911a10437/console-operator/1.log"
Sep 07 21:11:44.193732 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:44.193710    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-kv96r_d804af86-d937-4ea6-afb8-760911a10437/console-operator/1.log"
Sep 07 21:11:44.304963 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:44.304938    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9d4d876c8-82m4c"
Sep 07 21:11:44.409603 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:44.409570    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/048efa52-77e8-4266-92ed-69631bf65724-webhook-cert\") pod \"048efa52-77e8-4266-92ed-69631bf65724\" (UID: \"048efa52-77e8-4266-92ed-69631bf65724\") "
Sep 07 21:11:44.409777 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:44.409625    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdv7x\" (UniqueName: \"kubernetes.io/projected/048efa52-77e8-4266-92ed-69631bf65724-kube-api-access-xdv7x\") pod \"048efa52-77e8-4266-92ed-69631bf65724\" (UID: \"048efa52-77e8-4266-92ed-69631bf65724\") "
Sep 07 21:11:44.409777 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:44.409649    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/048efa52-77e8-4266-92ed-69631bf65724-metrics-certs\") pod \"048efa52-77e8-4266-92ed-69631bf65724\" (UID: \"048efa52-77e8-4266-92ed-69631bf65724\") "
Sep 07 21:11:44.411886 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:44.411851    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/048efa52-77e8-4266-92ed-69631bf65724-kube-api-access-xdv7x" (OuterVolumeSpecName: "kube-api-access-xdv7x") pod "048efa52-77e8-4266-92ed-69631bf65724" (UID: "048efa52-77e8-4266-92ed-69631bf65724"). InnerVolumeSpecName "kube-api-access-xdv7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:11:44.411996 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:44.411857    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/048efa52-77e8-4266-92ed-69631bf65724-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "048efa52-77e8-4266-92ed-69631bf65724" (UID: "048efa52-77e8-4266-92ed-69631bf65724"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:11:44.411996 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:44.411916    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/048efa52-77e8-4266-92ed-69631bf65724-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "048efa52-77e8-4266-92ed-69631bf65724" (UID: "048efa52-77e8-4266-92ed-69631bf65724"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:11:44.510724 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:44.510627    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/048efa52-77e8-4266-92ed-69631bf65724-webhook-cert\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:11:44.510724 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:44.510654    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdv7x\" (UniqueName: \"kubernetes.io/projected/048efa52-77e8-4266-92ed-69631bf65724-kube-api-access-xdv7x\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:11:44.510724 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:44.510664    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/048efa52-77e8-4266-92ed-69631bf65724-metrics-certs\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:11:45.041062 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:45.041019    2558 generic.go:356] "Generic (PLEG): container finished" podID="048efa52-77e8-4266-92ed-69631bf65724" containerID="3e39cfe795189489aceb6ca6694fc1d443da5c289d7053910517452cb7cac993" exitCode=0
Sep 07 21:11:45.041062 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:45.041067    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9d4d876c8-82m4c"
Sep 07 21:11:45.041579 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:45.041074    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9d4d876c8-82m4c" event={"ID":"048efa52-77e8-4266-92ed-69631bf65724","Type":"ContainerDied","Data":"3e39cfe795189489aceb6ca6694fc1d443da5c289d7053910517452cb7cac993"}
Sep 07 21:11:45.041579 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:45.041123    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9d4d876c8-82m4c" event={"ID":"048efa52-77e8-4266-92ed-69631bf65724","Type":"ContainerDied","Data":"b0672b20fb36d7227b28cf5778a8d49bef1faf4b917692055ef5ab574f7f346e"}
Sep 07 21:11:45.041579 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:45.041155    2558 scope.go:117] "RemoveContainer" containerID="3e39cfe795189489aceb6ca6694fc1d443da5c289d7053910517452cb7cac993"
Sep 07 21:11:45.050367 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:45.050161    2558 scope.go:117] "RemoveContainer" containerID="3e39cfe795189489aceb6ca6694fc1d443da5c289d7053910517452cb7cac993"
Sep 07 21:11:45.050480 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:11:45.050462    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e39cfe795189489aceb6ca6694fc1d443da5c289d7053910517452cb7cac993\": container with ID starting with 3e39cfe795189489aceb6ca6694fc1d443da5c289d7053910517452cb7cac993 not found: ID does not exist" containerID="3e39cfe795189489aceb6ca6694fc1d443da5c289d7053910517452cb7cac993"
Sep 07 21:11:45.050523 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:45.050490    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e39cfe795189489aceb6ca6694fc1d443da5c289d7053910517452cb7cac993"} err="failed to get container status \"3e39cfe795189489aceb6ca6694fc1d443da5c289d7053910517452cb7cac993\": rpc error: code = NotFound desc = could not find container \"3e39cfe795189489aceb6ca6694fc1d443da5c289d7053910517452cb7cac993\": container with ID starting with 3e39cfe795189489aceb6ca6694fc1d443da5c289d7053910517452cb7cac993 not found: ID does not exist"
Sep 07 21:11:45.061635 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:45.061606    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9d4d876c8-82m4c"]
Sep 07 21:11:45.065542 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:45.065511    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-9d4d876c8-82m4c"]
Sep 07 21:11:46.308362 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:11:46.308328    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="048efa52-77e8-4266-92ed-69631bf65724" path="/var/lib/kubelet/pods/048efa52-77e8-4266-92ed-69631bf65724/volumes"
Sep 07 21:12:05.380271 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.380235    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"]
Sep 07 21:12:05.380698 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.380605    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="048efa52-77e8-4266-92ed-69631bf65724" containerName="manager"
Sep 07 21:12:05.380698 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.380618    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="048efa52-77e8-4266-92ed-69631bf65724" containerName="manager"
Sep 07 21:12:05.380779 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.380696    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="048efa52-77e8-4266-92ed-69631bf65724" containerName="manager"
Sep 07 21:12:05.386201 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.386180    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"
Sep 07 21:12:05.389445 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.389421    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 07 21:12:05.389570 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.389449    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9nj5g\""
Sep 07 21:12:05.389570 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.389468    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 07 21:12:05.393804 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.393779    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"]
Sep 07 21:12:05.499920 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.499886    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e06b20dc-b600-4188-adbd-1130b45a8114-maas-api-tls\") pod \"maas-api-7fd99f4487-75zrh\" (UID: \"e06b20dc-b600-4188-adbd-1130b45a8114\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"
Sep 07 21:12:05.500110 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.499938    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e06b20dc-b600-4188-adbd-1130b45a8114-metrics-certs\") pod \"maas-api-7fd99f4487-75zrh\" (UID: \"e06b20dc-b600-4188-adbd-1130b45a8114\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"
Sep 07 21:12:05.500110 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.499977    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e06b20dc-b600-4188-adbd-1130b45a8114-openshift-service-ca\") pod \"maas-api-7fd99f4487-75zrh\" (UID: \"e06b20dc-b600-4188-adbd-1130b45a8114\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"
Sep 07 21:12:05.500110 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.500084    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2zv5\" (UniqueName: \"kubernetes.io/projected/e06b20dc-b600-4188-adbd-1130b45a8114-kube-api-access-c2zv5\") pod \"maas-api-7fd99f4487-75zrh\" (UID: \"e06b20dc-b600-4188-adbd-1130b45a8114\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"
Sep 07 21:12:05.601051 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.601019    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2zv5\" (UniqueName: \"kubernetes.io/projected/e06b20dc-b600-4188-adbd-1130b45a8114-kube-api-access-c2zv5\") pod \"maas-api-7fd99f4487-75zrh\" (UID: \"e06b20dc-b600-4188-adbd-1130b45a8114\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"
Sep 07 21:12:05.601238 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.601073    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e06b20dc-b600-4188-adbd-1130b45a8114-maas-api-tls\") pod \"maas-api-7fd99f4487-75zrh\" (UID: \"e06b20dc-b600-4188-adbd-1130b45a8114\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"
Sep 07 21:12:05.601238 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.601104    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e06b20dc-b600-4188-adbd-1130b45a8114-metrics-certs\") pod \"maas-api-7fd99f4487-75zrh\" (UID: \"e06b20dc-b600-4188-adbd-1130b45a8114\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"
Sep 07 21:12:05.601238 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.601124    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e06b20dc-b600-4188-adbd-1130b45a8114-openshift-service-ca\") pod \"maas-api-7fd99f4487-75zrh\" (UID: \"e06b20dc-b600-4188-adbd-1130b45a8114\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"
Sep 07 21:12:05.601839 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.601813    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e06b20dc-b600-4188-adbd-1130b45a8114-openshift-service-ca\") pod \"maas-api-7fd99f4487-75zrh\" (UID: \"e06b20dc-b600-4188-adbd-1130b45a8114\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"
Sep 07 21:12:05.603750 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.603721    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e06b20dc-b600-4188-adbd-1130b45a8114-metrics-certs\") pod \"maas-api-7fd99f4487-75zrh\" (UID: \"e06b20dc-b600-4188-adbd-1130b45a8114\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"
Sep 07 21:12:05.603841 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.603765    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e06b20dc-b600-4188-adbd-1130b45a8114-maas-api-tls\") pod \"maas-api-7fd99f4487-75zrh\" (UID: \"e06b20dc-b600-4188-adbd-1130b45a8114\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"
Sep 07 21:12:05.608505 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.608485    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2zv5\" (UniqueName: \"kubernetes.io/projected/e06b20dc-b600-4188-adbd-1130b45a8114-kube-api-access-c2zv5\") pod \"maas-api-7fd99f4487-75zrh\" (UID: \"e06b20dc-b600-4188-adbd-1130b45a8114\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"
Sep 07 21:12:05.698632 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.698525    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"
Sep 07 21:12:05.832564 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.832527    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-98j97"]
Sep 07 21:12:05.859330 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.859289    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-98j97"]
Sep 07 21:12:05.859486 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.859415    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-98j97"
Sep 07 21:12:05.861769 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.861745    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6hfqs\""
Sep 07 21:12:05.861910 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.861882    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 07 21:12:05.978627 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.978432    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"]
Sep 07 21:12:05.981959 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:12:05.981921    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode06b20dc_b600_4188_adbd_1130b45a8114.slice/crio-8eb4cde15aafd0bb7b5d72d894de06711cbe6d6d28e7eed3c90ddf052eae02e8 WatchSource:0}: Error finding container 8eb4cde15aafd0bb7b5d72d894de06711cbe6d6d28e7eed3c90ddf052eae02e8: Status 404 returned error can't find the container with id 8eb4cde15aafd0bb7b5d72d894de06711cbe6d6d28e7eed3c90ddf052eae02e8
Sep 07 21:12:05.983370 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:05.983352    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 21:12:06.005327 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:06.005273    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cbff39d-1a82-477b-bbab-d9ee5703f17d-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-98j97\" (UID: \"6cbff39d-1a82-477b-bbab-d9ee5703f17d\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-98j97"
Sep 07 21:12:06.005507 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:06.005418    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwmk7\" (UniqueName: \"kubernetes.io/projected/6cbff39d-1a82-477b-bbab-d9ee5703f17d-kube-api-access-hwmk7\") pod \"payload-pre-processing-59fbc47bf8-98j97\" (UID: \"6cbff39d-1a82-477b-bbab-d9ee5703f17d\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-98j97"
Sep 07 21:12:06.106706 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:06.106669    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cbff39d-1a82-477b-bbab-d9ee5703f17d-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-98j97\" (UID: \"6cbff39d-1a82-477b-bbab-d9ee5703f17d\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-98j97"
Sep 07 21:12:06.106879 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:06.106749    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwmk7\" (UniqueName: \"kubernetes.io/projected/6cbff39d-1a82-477b-bbab-d9ee5703f17d-kube-api-access-hwmk7\") pod \"payload-pre-processing-59fbc47bf8-98j97\" (UID: \"6cbff39d-1a82-477b-bbab-d9ee5703f17d\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-98j97"
Sep 07 21:12:06.107497 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:06.107475    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cbff39d-1a82-477b-bbab-d9ee5703f17d-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-98j97\" (UID: \"6cbff39d-1a82-477b-bbab-d9ee5703f17d\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-98j97"
Sep 07 21:12:06.134682 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:06.134654    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwmk7\" (UniqueName: \"kubernetes.io/projected/6cbff39d-1a82-477b-bbab-d9ee5703f17d-kube-api-access-hwmk7\") pod \"payload-pre-processing-59fbc47bf8-98j97\" (UID: \"6cbff39d-1a82-477b-bbab-d9ee5703f17d\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-98j97"
Sep 07 21:12:06.151372 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:06.151338    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh" event={"ID":"e06b20dc-b600-4188-adbd-1130b45a8114","Type":"ContainerStarted","Data":"8eb4cde15aafd0bb7b5d72d894de06711cbe6d6d28e7eed3c90ddf052eae02e8"}
Sep 07 21:12:06.171636 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:06.171606    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-98j97"
Sep 07 21:12:06.444537 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:06.444513    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-98j97"]
Sep 07 21:12:06.446106 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:12:06.446078    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cbff39d_1a82_477b_bbab_d9ee5703f17d.slice/crio-799e88a2ffd62131e3faa20537859d3f971d6e92100a262c6d656f1c7b4dac79 WatchSource:0}: Error finding container 799e88a2ffd62131e3faa20537859d3f971d6e92100a262c6d656f1c7b4dac79: Status 404 returned error can't find the container with id 799e88a2ffd62131e3faa20537859d3f971d6e92100a262c6d656f1c7b4dac79
Sep 07 21:12:07.169363 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:07.169275    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-98j97" event={"ID":"6cbff39d-1a82-477b-bbab-d9ee5703f17d","Type":"ContainerStarted","Data":"799e88a2ffd62131e3faa20537859d3f971d6e92100a262c6d656f1c7b4dac79"}
Sep 07 21:12:08.177039 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:08.176947    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh" event={"ID":"e06b20dc-b600-4188-adbd-1130b45a8114","Type":"ContainerStarted","Data":"7348d82cfe8e48250aca974edc0aa614cd843d8582e07886092c691669561293"}
Sep 07 21:12:08.177039 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:08.177021    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"
Sep 07 21:12:08.194664 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:08.194601    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh" podStartSLOduration=1.251627193 podStartE2EDuration="3.194578681s" totalImagesPullingTime="1.942951488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:12:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:12:08.192953989 +0000 UTC m=+624.452771258" watchObservedRunningTime="2026-09-07 21:12:08.194578681 +0000 UTC m=+624.454395926"
Sep 07 21:12:09.184795 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:09.184751    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-98j97" event={"ID":"6cbff39d-1a82-477b-bbab-d9ee5703f17d","Type":"ContainerStarted","Data":"3b6e3ef4bcf39bfdbbfb3bb37f518ab362f69a1a118e60462349776785b2d5d0"}
Sep 07 21:12:09.200477 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:09.200421    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-98j97" podStartSLOduration=2.075150108 podStartE2EDuration="4.20040555s" totalImagesPullingTime="2.125255442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:12:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:12:09.199379603 +0000 UTC m=+625.459196857" watchObservedRunningTime="2026-09-07 21:12:09.20040555 +0000 UTC m=+625.460222794"
Sep 07 21:12:10.190205 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:10.190167    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-98j97"
Sep 07 21:12:14.190184 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:14.190152    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"
Sep 07 21:12:16.223519 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:16.223488    2558 generic.go:356] "Generic (PLEG): container finished" podID="ef9ca3c5-5438-430a-8b66-8862c766feb8" containerID="e6659d428c38334a70be2ef85b8266c66cd5334445bb5b9152774b7a3c0f5657" exitCode=0
Sep 07 21:12:16.223914 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:16.223537    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7" event={"ID":"ef9ca3c5-5438-430a-8b66-8862c766feb8","Type":"ContainerDied","Data":"e6659d428c38334a70be2ef85b8266c66cd5334445bb5b9152774b7a3c0f5657"}
Sep 07 21:12:16.223955 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:16.223932    2558 scope.go:117] "RemoveContainer" containerID="e6659d428c38334a70be2ef85b8266c66cd5334445bb5b9152774b7a3c0f5657"
Sep 07 21:12:16.225023 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:16.224991    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:12:16.225087 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:16.225059    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:12:16.225134 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:16.225088    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:12:17.230731 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:17.230698    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7" event={"ID":"ef9ca3c5-5438-430a-8b66-8862c766feb8","Type":"ContainerStarted","Data":"f01af3d6eac0e425835d20ca58caf1ee2668fe8440d1c1c5e3162bca47d98e2b"}
Sep 07 21:12:17.812563 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:17.812524    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:12:17.812796 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:17.812775    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-f8cm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 07 21:12:17.812855 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:17.812821    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7" podUID="ef9ca3c5-5438-430a-8b66-8862c766feb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 07 21:12:18.812444 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:18.812407    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-f8cm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 07 21:12:18.812901 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:18.812469    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7" podUID="ef9ca3c5-5438-430a-8b66-8862c766feb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 07 21:12:19.813070 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:19.813037    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-f8cm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 07 21:12:19.813509 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:19.813091    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7" podUID="ef9ca3c5-5438-430a-8b66-8862c766feb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 07 21:12:20.812557 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:20.812523    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-f8cm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 07 21:12:20.812732 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:20.812578    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7" podUID="ef9ca3c5-5438-430a-8b66-8862c766feb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 07 21:12:21.198495 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:21.198404    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-98j97"
Sep 07 21:12:21.812244 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:21.812208    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-f8cm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 07 21:12:21.812428 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:21.812271    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7" podUID="ef9ca3c5-5438-430a-8b66-8862c766feb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 07 21:12:22.816181 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:22.816149    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:12:22.816565 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:22.816542    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:12:22.817185 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:22.817165    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7"
Sep 07 21:12:26.869807 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:26.869770    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"]
Sep 07 21:12:26.873993 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:26.873970    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:26.877050 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:26.877020    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rhzs9\""
Sep 07 21:12:26.877168 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:26.877071    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 07 21:12:26.877168 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:26.877072    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 07 21:12:26.877168 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:26.877089    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 07 21:12:26.884476 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:26.884441    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"]
Sep 07 21:12:27.004165 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:27.004129    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ada87056-3aea-43b7-848b-1718c97b0ae5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb\" (UID: \"ada87056-3aea-43b7-848b-1718c97b0ae5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:27.004165 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:27.004163    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ada87056-3aea-43b7-848b-1718c97b0ae5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb\" (UID: \"ada87056-3aea-43b7-848b-1718c97b0ae5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:27.004398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:27.004193    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ada87056-3aea-43b7-848b-1718c97b0ae5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb\" (UID: \"ada87056-3aea-43b7-848b-1718c97b0ae5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:27.004398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:27.004267    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ada87056-3aea-43b7-848b-1718c97b0ae5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb\" (UID: \"ada87056-3aea-43b7-848b-1718c97b0ae5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:27.004398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:27.004356    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ada87056-3aea-43b7-848b-1718c97b0ae5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb\" (UID: \"ada87056-3aea-43b7-848b-1718c97b0ae5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:27.004499 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:27.004399    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfg8l\" (UniqueName: \"kubernetes.io/projected/ada87056-3aea-43b7-848b-1718c97b0ae5-kube-api-access-gfg8l\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb\" (UID: \"ada87056-3aea-43b7-848b-1718c97b0ae5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:27.105819 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:27.105782    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ada87056-3aea-43b7-848b-1718c97b0ae5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb\" (UID: \"ada87056-3aea-43b7-848b-1718c97b0ae5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:27.105967 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:27.105832    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ada87056-3aea-43b7-848b-1718c97b0ae5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb\" (UID: \"ada87056-3aea-43b7-848b-1718c97b0ae5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:27.105967 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:27.105859    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfg8l\" (UniqueName: \"kubernetes.io/projected/ada87056-3aea-43b7-848b-1718c97b0ae5-kube-api-access-gfg8l\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb\" (UID: \"ada87056-3aea-43b7-848b-1718c97b0ae5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:27.105967 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:27.105886    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ada87056-3aea-43b7-848b-1718c97b0ae5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb\" (UID: \"ada87056-3aea-43b7-848b-1718c97b0ae5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:27.105967 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:27.105900    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ada87056-3aea-43b7-848b-1718c97b0ae5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb\" (UID: \"ada87056-3aea-43b7-848b-1718c97b0ae5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:27.105967 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:27.105923    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ada87056-3aea-43b7-848b-1718c97b0ae5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb\" (UID: \"ada87056-3aea-43b7-848b-1718c97b0ae5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:27.106266 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:27.106238    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ada87056-3aea-43b7-848b-1718c97b0ae5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb\" (UID: \"ada87056-3aea-43b7-848b-1718c97b0ae5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:27.106398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:27.106342    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ada87056-3aea-43b7-848b-1718c97b0ae5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb\" (UID: \"ada87056-3aea-43b7-848b-1718c97b0ae5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:27.106457 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:27.106429    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ada87056-3aea-43b7-848b-1718c97b0ae5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb\" (UID: \"ada87056-3aea-43b7-848b-1718c97b0ae5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:27.108226 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:27.108209    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ada87056-3aea-43b7-848b-1718c97b0ae5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb\" (UID: \"ada87056-3aea-43b7-848b-1718c97b0ae5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:27.108417 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:27.108401    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ada87056-3aea-43b7-848b-1718c97b0ae5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb\" (UID: \"ada87056-3aea-43b7-848b-1718c97b0ae5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:27.113071 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:27.113047    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfg8l\" (UniqueName: \"kubernetes.io/projected/ada87056-3aea-43b7-848b-1718c97b0ae5-kube-api-access-gfg8l\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb\" (UID: \"ada87056-3aea-43b7-848b-1718c97b0ae5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:27.186747 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:27.186670    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:27.458074 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:27.458046    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"]
Sep 07 21:12:27.460017 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:12:27.459986    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podada87056_3aea_43b7_848b_1718c97b0ae5.slice/crio-d1e168b198272c0aa6835d7a64bd7b6ca736296c0a7aec52e4f8dbd50511a9fe WatchSource:0}: Error finding container d1e168b198272c0aa6835d7a64bd7b6ca736296c0a7aec52e4f8dbd50511a9fe: Status 404 returned error can't find the container with id d1e168b198272c0aa6835d7a64bd7b6ca736296c0a7aec52e4f8dbd50511a9fe
Sep 07 21:12:28.310088 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:28.310050    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb" event={"ID":"ada87056-3aea-43b7-848b-1718c97b0ae5","Type":"ContainerStarted","Data":"d1e168b198272c0aa6835d7a64bd7b6ca736296c0a7aec52e4f8dbd50511a9fe"}
Sep 07 21:12:29.313537 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:29.313500    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb" event={"ID":"ada87056-3aea-43b7-848b-1718c97b0ae5","Type":"ContainerStarted","Data":"09ed3bd129ba84e3fcb7589e02b2f92631850d3a97c3ba58eb45817461730d57"}
Sep 07 21:12:29.331553 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:29.331505    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb" podStartSLOduration=2.067826935 podStartE2EDuration="3.331488429s" totalImagesPullingTime="1.263661494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:12:29.328835256 +0000 UTC m=+645.588652512" watchObservedRunningTime="2026-09-07 21:12:29.331488429 +0000 UTC m=+645.591305735"
Sep 07 21:12:37.187293 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:37.187242    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:37.187825 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:37.187365    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:37.199973 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:37.199934    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:12:37.365779 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:12:37.365748    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb"
Sep 07 21:13:05.051917 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.051878    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"]
Sep 07 21:13:05.057935 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.057911    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:05.059903 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.059882    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 07 21:13:05.060196 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.060173    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73cc8345-f8db-40d7-9411-0f71b6ebc349-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-glhbx\" (UID: \"73cc8345-f8db-40d7-9411-0f71b6ebc349\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:05.060266 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.060208    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73cc8345-f8db-40d7-9411-0f71b6ebc349-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-glhbx\" (UID: \"73cc8345-f8db-40d7-9411-0f71b6ebc349\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:05.060266 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.060224    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73cc8345-f8db-40d7-9411-0f71b6ebc349-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-glhbx\" (UID: \"73cc8345-f8db-40d7-9411-0f71b6ebc349\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:05.060395 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.060328    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73cc8345-f8db-40d7-9411-0f71b6ebc349-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-glhbx\" (UID: \"73cc8345-f8db-40d7-9411-0f71b6ebc349\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:05.060395 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.060363    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f67mp\" (UniqueName: \"kubernetes.io/projected/73cc8345-f8db-40d7-9411-0f71b6ebc349-kube-api-access-f67mp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-glhbx\" (UID: \"73cc8345-f8db-40d7-9411-0f71b6ebc349\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:05.060478 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.060405    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73cc8345-f8db-40d7-9411-0f71b6ebc349-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-glhbx\" (UID: \"73cc8345-f8db-40d7-9411-0f71b6ebc349\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:05.065265 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.065238    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"]
Sep 07 21:13:05.160991 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.160944    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73cc8345-f8db-40d7-9411-0f71b6ebc349-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-glhbx\" (UID: \"73cc8345-f8db-40d7-9411-0f71b6ebc349\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:05.161174 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.161045    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73cc8345-f8db-40d7-9411-0f71b6ebc349-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-glhbx\" (UID: \"73cc8345-f8db-40d7-9411-0f71b6ebc349\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:05.161174 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.161091    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73cc8345-f8db-40d7-9411-0f71b6ebc349-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-glhbx\" (UID: \"73cc8345-f8db-40d7-9411-0f71b6ebc349\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:05.161174 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.161128    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73cc8345-f8db-40d7-9411-0f71b6ebc349-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-glhbx\" (UID: \"73cc8345-f8db-40d7-9411-0f71b6ebc349\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:05.161385 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.161250    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73cc8345-f8db-40d7-9411-0f71b6ebc349-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-glhbx\" (UID: \"73cc8345-f8db-40d7-9411-0f71b6ebc349\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:05.161385 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.161333    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f67mp\" (UniqueName: \"kubernetes.io/projected/73cc8345-f8db-40d7-9411-0f71b6ebc349-kube-api-access-f67mp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-glhbx\" (UID: \"73cc8345-f8db-40d7-9411-0f71b6ebc349\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:05.161915 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.161888    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73cc8345-f8db-40d7-9411-0f71b6ebc349-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-glhbx\" (UID: \"73cc8345-f8db-40d7-9411-0f71b6ebc349\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:05.162358 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.162299    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73cc8345-f8db-40d7-9411-0f71b6ebc349-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-glhbx\" (UID: \"73cc8345-f8db-40d7-9411-0f71b6ebc349\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:05.162634 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.162606    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73cc8345-f8db-40d7-9411-0f71b6ebc349-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-glhbx\" (UID: \"73cc8345-f8db-40d7-9411-0f71b6ebc349\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:05.165136 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.165104    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73cc8345-f8db-40d7-9411-0f71b6ebc349-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-glhbx\" (UID: \"73cc8345-f8db-40d7-9411-0f71b6ebc349\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:05.166223 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.166179    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73cc8345-f8db-40d7-9411-0f71b6ebc349-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-glhbx\" (UID: \"73cc8345-f8db-40d7-9411-0f71b6ebc349\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:05.168589 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.168564    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f67mp\" (UniqueName: \"kubernetes.io/projected/73cc8345-f8db-40d7-9411-0f71b6ebc349-kube-api-access-f67mp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-glhbx\" (UID: \"73cc8345-f8db-40d7-9411-0f71b6ebc349\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:05.370768 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.370725    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:05.641679 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:05.641654    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"]
Sep 07 21:13:05.643463 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:13:05.643434    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73cc8345_f8db_40d7_9411_0f71b6ebc349.slice/crio-a6144d464e56ee5a8b8656849344e945ddba590e51889fbef275e75016a50522 WatchSource:0}: Error finding container a6144d464e56ee5a8b8656849344e945ddba590e51889fbef275e75016a50522: Status 404 returned error can't find the container with id a6144d464e56ee5a8b8656849344e945ddba590e51889fbef275e75016a50522
Sep 07 21:13:06.518231 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:06.518184    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx" event={"ID":"73cc8345-f8db-40d7-9411-0f71b6ebc349","Type":"ContainerStarted","Data":"717ffe3924c87a2eace92e9f29f1f4b19b0838c6426f4f6d8761816435835ec8"}
Sep 07 21:13:06.518723 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:06.518293    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx" event={"ID":"73cc8345-f8db-40d7-9411-0f71b6ebc349","Type":"ContainerStarted","Data":"a6144d464e56ee5a8b8656849344e945ddba590e51889fbef275e75016a50522"}
Sep 07 21:13:06.545694 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:06.545641    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx" podStartSLOduration=1.358803477 podStartE2EDuration="1.545624417s" totalImagesPullingTime="186.82094ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:13:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:13:06.544358262 +0000 UTC m=+682.804175526" watchObservedRunningTime="2026-09-07 21:13:06.545624417 +0000 UTC m=+682.805441659"
Sep 07 21:13:12.655799 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.655716    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"]
Sep 07 21:13:12.659644 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.659621    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:12.661905 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.661879    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 07 21:13:12.668126 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.668093    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"]
Sep 07 21:13:12.726089 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.726044    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a228fe2f-5f72-4f10-8142-7c80edb731a9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf\" (UID: \"a228fe2f-5f72-4f10-8142-7c80edb731a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:12.726373 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.726104    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a228fe2f-5f72-4f10-8142-7c80edb731a9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf\" (UID: \"a228fe2f-5f72-4f10-8142-7c80edb731a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:12.726373 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.726194    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a228fe2f-5f72-4f10-8142-7c80edb731a9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf\" (UID: \"a228fe2f-5f72-4f10-8142-7c80edb731a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:12.726373 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.726262    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a228fe2f-5f72-4f10-8142-7c80edb731a9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf\" (UID: \"a228fe2f-5f72-4f10-8142-7c80edb731a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:12.726568 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.726416    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c82g\" (UniqueName: \"kubernetes.io/projected/a228fe2f-5f72-4f10-8142-7c80edb731a9-kube-api-access-8c82g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf\" (UID: \"a228fe2f-5f72-4f10-8142-7c80edb731a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:12.726568 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.726487    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a228fe2f-5f72-4f10-8142-7c80edb731a9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf\" (UID: \"a228fe2f-5f72-4f10-8142-7c80edb731a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:12.827413 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.827353    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a228fe2f-5f72-4f10-8142-7c80edb731a9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf\" (UID: \"a228fe2f-5f72-4f10-8142-7c80edb731a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:12.827693 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.827456    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a228fe2f-5f72-4f10-8142-7c80edb731a9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf\" (UID: \"a228fe2f-5f72-4f10-8142-7c80edb731a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:12.827693 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.827486    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a228fe2f-5f72-4f10-8142-7c80edb731a9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf\" (UID: \"a228fe2f-5f72-4f10-8142-7c80edb731a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:12.827693 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.827546    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a228fe2f-5f72-4f10-8142-7c80edb731a9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf\" (UID: \"a228fe2f-5f72-4f10-8142-7c80edb731a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:12.827693 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.827603    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a228fe2f-5f72-4f10-8142-7c80edb731a9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf\" (UID: \"a228fe2f-5f72-4f10-8142-7c80edb731a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:12.827693 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.827656    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c82g\" (UniqueName: \"kubernetes.io/projected/a228fe2f-5f72-4f10-8142-7c80edb731a9-kube-api-access-8c82g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf\" (UID: \"a228fe2f-5f72-4f10-8142-7c80edb731a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:12.829084 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.829057    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a228fe2f-5f72-4f10-8142-7c80edb731a9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf\" (UID: \"a228fe2f-5f72-4f10-8142-7c80edb731a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:12.829386 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.829359    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a228fe2f-5f72-4f10-8142-7c80edb731a9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf\" (UID: \"a228fe2f-5f72-4f10-8142-7c80edb731a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:12.829464 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.829379    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a228fe2f-5f72-4f10-8142-7c80edb731a9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf\" (UID: \"a228fe2f-5f72-4f10-8142-7c80edb731a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:12.831181 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.831156    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a228fe2f-5f72-4f10-8142-7c80edb731a9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf\" (UID: \"a228fe2f-5f72-4f10-8142-7c80edb731a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:12.831594 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.831571    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a228fe2f-5f72-4f10-8142-7c80edb731a9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf\" (UID: \"a228fe2f-5f72-4f10-8142-7c80edb731a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:12.840761 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.840734    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c82g\" (UniqueName: \"kubernetes.io/projected/a228fe2f-5f72-4f10-8142-7c80edb731a9-kube-api-access-8c82g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf\" (UID: \"a228fe2f-5f72-4f10-8142-7c80edb731a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:12.972340 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:12.972219    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:13.243208 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:13.243182    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"]
Sep 07 21:13:13.244906 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:13:13.244880    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda228fe2f_5f72_4f10_8142_7c80edb731a9.slice/crio-ed409f5a5cac9eba6b4e4134413252bb80c917cb5aca692b36263a102b8f3a0c WatchSource:0}: Error finding container ed409f5a5cac9eba6b4e4134413252bb80c917cb5aca692b36263a102b8f3a0c: Status 404 returned error can't find the container with id ed409f5a5cac9eba6b4e4134413252bb80c917cb5aca692b36263a102b8f3a0c
Sep 07 21:13:13.559428 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:13.559391    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf" event={"ID":"a228fe2f-5f72-4f10-8142-7c80edb731a9","Type":"ContainerStarted","Data":"43531abdccf8d701643fac0439ff07b0858726d2e3740826a28a6c78e3d95b4f"}
Sep 07 21:13:13.559584 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:13.559441    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf" event={"ID":"a228fe2f-5f72-4f10-8142-7c80edb731a9","Type":"ContainerStarted","Data":"ed409f5a5cac9eba6b4e4134413252bb80c917cb5aca692b36263a102b8f3a0c"}
Sep 07 21:13:13.579773 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:13.579729    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf" podStartSLOduration=1.392156043 podStartE2EDuration="1.579710415s" totalImagesPullingTime="187.554372ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:13:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:13:13.579457367 +0000 UTC m=+689.839274641" watchObservedRunningTime="2026-09-07 21:13:13.579710415 +0000 UTC m=+689.839527658"
Sep 07 21:13:15.371434 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:15.371397    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:15.371913 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:15.371464    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:15.384157 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:15.384134    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:15.582118 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:15.582089    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-glhbx"
Sep 07 21:13:22.972892 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:22.972848    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:22.973325 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:22.972916    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:22.985801 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:22.985768    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:13:23.625384 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:13:23.625355    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf"
Sep 07 21:15:16.163836 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.163796    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"]
Sep 07 21:15:16.167657 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.167631    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.170084 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.169956    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-06f0f6-openshift-default-dockercfg-rrlcx\""
Sep 07 21:15:16.178890 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.178862    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"]
Sep 07 21:15:16.257398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.257366    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-podinfo\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.257398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.257401    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istiod-ca-cert\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.257642 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.257483    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-data\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.257642 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.257512    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-credential-socket\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.257642 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.257614    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xbvh\" (UniqueName: \"kubernetes.io/projected/a5d798ec-b58a-4a01-b46d-016d7fa4162d-kube-api-access-6xbvh\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.257819 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.257661    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-workload-socket\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.257819 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.257686    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-envoy\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.257819 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.257714    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-token\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.257819 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.257742    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-workload-certs\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.359264 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.359226    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-podinfo\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.359264 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.359266    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istiod-ca-cert\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.359738 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.359338    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-data\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.359738 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.359364    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-credential-socket\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.359738 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.359410    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xbvh\" (UniqueName: \"kubernetes.io/projected/a5d798ec-b58a-4a01-b46d-016d7fa4162d-kube-api-access-6xbvh\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.359738 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.359439    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-workload-socket\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.359738 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.359465    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-envoy\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.359738 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.359491    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-token\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.359738 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.359573    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-workload-certs\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.360108 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.359790    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-data\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.360108 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.359886    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-workload-socket\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.360224 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.360156    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istiod-ca-cert\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.360369 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.360229    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-credential-socket\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.360369 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.360303    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-workload-certs\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.362157 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.362099    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-envoy\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.362157 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.362146    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-podinfo\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.366606 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.366586    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-token\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.366893 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.366872    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xbvh\" (UniqueName: \"kubernetes.io/projected/a5d798ec-b58a-4a01-b46d-016d7fa4162d-kube-api-access-6xbvh\") pod \"e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") " pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.482960 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.482862    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:16.764926 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.764898    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"]
Sep 07 21:15:16.766538 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:15:16.766512    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5d798ec_b58a_4a01_b46d_016d7fa4162d.slice/crio-9dbe4a562f251520660b59b4783695dc3eeb3f11f4c5bdf9ff6587e93f7e5336 WatchSource:0}: Error finding container 9dbe4a562f251520660b59b4783695dc3eeb3f11f4c5bdf9ff6587e93f7e5336: Status 404 returned error can't find the container with id 9dbe4a562f251520660b59b4783695dc3eeb3f11f4c5bdf9ff6587e93f7e5336
Sep 07 21:15:16.768678 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.768643    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:15:16.768758 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.768713    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:15:16.768758 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:16.768746    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:15:17.265339 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:17.265270    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp" event={"ID":"a5d798ec-b58a-4a01-b46d-016d7fa4162d","Type":"ContainerStarted","Data":"91d8328cee4fe25d62319627b2ec527b3701e7afe1b88b728cc886585f0f1deb"}
Sep 07 21:15:17.265339 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:17.265343    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp" event={"ID":"a5d798ec-b58a-4a01-b46d-016d7fa4162d","Type":"ContainerStarted","Data":"9dbe4a562f251520660b59b4783695dc3eeb3f11f4c5bdf9ff6587e93f7e5336"}
Sep 07 21:15:17.290790 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:17.290740    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp" podStartSLOduration=1.290723109 podStartE2EDuration="1.290723109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:15:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:15:17.289718346 +0000 UTC m=+813.549535618" watchObservedRunningTime="2026-09-07 21:15:17.290723109 +0000 UTC m=+813.550540352"
Sep 07 21:15:17.483898 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:17.483865    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:17.489050 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:17.489019    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:18.271909 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:18.271879    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:18.272872 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:18.272851    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:21.026633 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:21.026601    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd"]
Sep 07 21:15:21.030070 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:21.030054    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd"
Sep 07 21:15:21.035119 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:21.035094    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-06f0f6-dockercfg-pm4d9\""
Sep 07 21:15:21.035254 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:21.035129    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-06f0f6\""
Sep 07 21:15:21.041818 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:21.041796    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd"]
Sep 07 21:15:21.208415 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:21.208377    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8694d90-0977-46b2-a7c9-4d7aee779029-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd\" (UID: \"c8694d90-0977-46b2-a7c9-4d7aee779029\") " pod="openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd"
Sep 07 21:15:21.208602 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:21.208431    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2vtg\" (UniqueName: \"kubernetes.io/projected/c8694d90-0977-46b2-a7c9-4d7aee779029-kube-api-access-j2vtg\") pod \"payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd\" (UID: \"c8694d90-0977-46b2-a7c9-4d7aee779029\") " pod="openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd"
Sep 07 21:15:21.310131 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:21.310091    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8694d90-0977-46b2-a7c9-4d7aee779029-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd\" (UID: \"c8694d90-0977-46b2-a7c9-4d7aee779029\") " pod="openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd"
Sep 07 21:15:21.310131 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:21.310131    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2vtg\" (UniqueName: \"kubernetes.io/projected/c8694d90-0977-46b2-a7c9-4d7aee779029-kube-api-access-j2vtg\") pod \"payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd\" (UID: \"c8694d90-0977-46b2-a7c9-4d7aee779029\") " pod="openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd"
Sep 07 21:15:21.311087 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:21.311059    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8694d90-0977-46b2-a7c9-4d7aee779029-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd\" (UID: \"c8694d90-0977-46b2-a7c9-4d7aee779029\") " pod="openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd"
Sep 07 21:15:21.317986 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:21.317955    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2vtg\" (UniqueName: \"kubernetes.io/projected/c8694d90-0977-46b2-a7c9-4d7aee779029-kube-api-access-j2vtg\") pod \"payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd\" (UID: \"c8694d90-0977-46b2-a7c9-4d7aee779029\") " pod="openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd"
Sep 07 21:15:21.342081 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:21.342045    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd"
Sep 07 21:15:21.622070 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:21.622042    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd"]
Sep 07 21:15:21.624691 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:15:21.624659    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8694d90_0977_46b2_a7c9_4d7aee779029.slice/crio-3a484e50d35da731cd9349965a220822ca7b1fa0837f35648d2f0e8b5a5a60bd WatchSource:0}: Error finding container 3a484e50d35da731cd9349965a220822ca7b1fa0837f35648d2f0e8b5a5a60bd: Status 404 returned error can't find the container with id 3a484e50d35da731cd9349965a220822ca7b1fa0837f35648d2f0e8b5a5a60bd
Sep 07 21:15:22.296176 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:22.296082    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd" event={"ID":"c8694d90-0977-46b2-a7c9-4d7aee779029","Type":"ContainerStarted","Data":"76cd0a0649312c99d27f87f57bd00b69e5dca6c6400ce0d923334f5000d11bb8"}
Sep 07 21:15:22.296176 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:22.296136    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd" event={"ID":"c8694d90-0977-46b2-a7c9-4d7aee779029","Type":"ContainerStarted","Data":"3a484e50d35da731cd9349965a220822ca7b1fa0837f35648d2f0e8b5a5a60bd"}
Sep 07 21:15:22.296612 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:22.296292    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd"
Sep 07 21:15:22.326766 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:22.326708    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd" podStartSLOduration=1.326691671 podStartE2EDuration="1.326691671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:15:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:15:22.324426436 +0000 UTC m=+818.584243696" watchObservedRunningTime="2026-09-07 21:15:22.326691671 +0000 UTC m=+818.586508913"
Sep 07 21:15:24.070405 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.070355    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"]
Sep 07 21:15:24.074911 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.074891    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.077045 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.077022    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-28fa6ddd-openshift-default-dockercfg-n24qr\""
Sep 07 21:15:24.085326 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.085277    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"]
Sep 07 21:15:24.239648 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.239612    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-workload-socket\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.239648 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.239650    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b876072c-16e2-429b-b53e-95a47fe72263-istio-token\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.239913 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.239681    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-istio-data\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.239913 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.239777    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b876072c-16e2-429b-b53e-95a47fe72263-istiod-ca-cert\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.239913 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.239820    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-workload-certs\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.239913 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.239847    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4mlc\" (UniqueName: \"kubernetes.io/projected/b876072c-16e2-429b-b53e-95a47fe72263-kube-api-access-g4mlc\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.239913 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.239881    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b876072c-16e2-429b-b53e-95a47fe72263-istio-podinfo\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.240160 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.240018    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-credential-socket\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.240160 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.240047    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-istio-envoy\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.340831 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.340738    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-credential-socket\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.340831 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.340778    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-istio-envoy\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.340831 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.340813    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-workload-socket\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.341118 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.340836    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b876072c-16e2-429b-b53e-95a47fe72263-istio-token\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.341118 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.340875    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-istio-data\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.341118 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.340898    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b876072c-16e2-429b-b53e-95a47fe72263-istiod-ca-cert\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.341118 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.340917    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-workload-certs\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.341118 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.340939    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4mlc\" (UniqueName: \"kubernetes.io/projected/b876072c-16e2-429b-b53e-95a47fe72263-kube-api-access-g4mlc\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.341118 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.340970    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b876072c-16e2-429b-b53e-95a47fe72263-istio-podinfo\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.341435 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.341199    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-credential-socket\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.341497 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.341479    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-istio-data\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.341572 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.341549    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-workload-socket\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.341626 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.341575    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-workload-certs\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.341868 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.341849    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b876072c-16e2-429b-b53e-95a47fe72263-istiod-ca-cert\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.343681 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.343653    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-istio-envoy\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.343821 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.343804    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b876072c-16e2-429b-b53e-95a47fe72263-istio-podinfo\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.352482 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.352452    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b876072c-16e2-429b-b53e-95a47fe72263-istio-token\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.352600 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.352571    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4mlc\" (UniqueName: \"kubernetes.io/projected/b876072c-16e2-429b-b53e-95a47fe72263-kube-api-access-g4mlc\") pod \"e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") " pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.391285 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.391250    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:24.672511 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.672475    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"]
Sep 07 21:15:24.673931 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:15:24.673897    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb876072c_16e2_429b_b53e_95a47fe72263.slice/crio-0335a837bacb5f1bdf9bd10345c10e7ca9e7200f33dc4229ac49df83b2744fac WatchSource:0}: Error finding container 0335a837bacb5f1bdf9bd10345c10e7ca9e7200f33dc4229ac49df83b2744fac: Status 404 returned error can't find the container with id 0335a837bacb5f1bdf9bd10345c10e7ca9e7200f33dc4229ac49df83b2744fac
Sep 07 21:15:24.676212 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.676175    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:15:24.676324 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.676246    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:15:24.676324 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:24.676274    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:15:25.314919 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:25.314880    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s" event={"ID":"b876072c-16e2-429b-b53e-95a47fe72263","Type":"ContainerStarted","Data":"c5a8de0745dce2b800d6081b51c97dc27ba156cf17dcf1ff01cd4247ab276fd5"}
Sep 07 21:15:25.315342 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:25.314944    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s" event={"ID":"b876072c-16e2-429b-b53e-95a47fe72263","Type":"ContainerStarted","Data":"0335a837bacb5f1bdf9bd10345c10e7ca9e7200f33dc4229ac49df83b2744fac"}
Sep 07 21:15:25.335556 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:25.335494    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s" podStartSLOduration=1.335476507 podStartE2EDuration="1.335476507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:15:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:15:25.332942246 +0000 UTC m=+821.592759512" watchObservedRunningTime="2026-09-07 21:15:25.335476507 +0000 UTC m=+821.595293818"
Sep 07 21:15:25.392213 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:25.392178    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:25.397474 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:25.397448    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:26.320972 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:26.320944    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:26.321971 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:26.321948    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:28.477957 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:28.477921    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl"]
Sep 07 21:15:28.481863 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:28.481842    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl"
Sep 07 21:15:28.483989 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:28.483957    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-28fa6ddd\""
Sep 07 21:15:28.483989 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:28.483984    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-28fa6ddd-dockercfg-hntrg\""
Sep 07 21:15:28.490445 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:28.490130    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl"]
Sep 07 21:15:28.681218 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:28.681174    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxxhp\" (UniqueName: \"kubernetes.io/projected/2d42407d-dc56-46da-b0c2-c7bf5013d740-kube-api-access-sxxhp\") pod \"payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl\" (UID: \"2d42407d-dc56-46da-b0c2-c7bf5013d740\") " pod="openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl"
Sep 07 21:15:28.681455 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:28.681371    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d42407d-dc56-46da-b0c2-c7bf5013d740-plugins-config-volume\") pod \"payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl\" (UID: \"2d42407d-dc56-46da-b0c2-c7bf5013d740\") " pod="openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl"
Sep 07 21:15:28.782270 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:28.782165    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d42407d-dc56-46da-b0c2-c7bf5013d740-plugins-config-volume\") pod \"payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl\" (UID: \"2d42407d-dc56-46da-b0c2-c7bf5013d740\") " pod="openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl"
Sep 07 21:15:28.782270 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:28.782231    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxxhp\" (UniqueName: \"kubernetes.io/projected/2d42407d-dc56-46da-b0c2-c7bf5013d740-kube-api-access-sxxhp\") pod \"payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl\" (UID: \"2d42407d-dc56-46da-b0c2-c7bf5013d740\") " pod="openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl"
Sep 07 21:15:28.783170 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:28.783143    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d42407d-dc56-46da-b0c2-c7bf5013d740-plugins-config-volume\") pod \"payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl\" (UID: \"2d42407d-dc56-46da-b0c2-c7bf5013d740\") " pod="openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl"
Sep 07 21:15:28.789878 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:28.789846    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxxhp\" (UniqueName: \"kubernetes.io/projected/2d42407d-dc56-46da-b0c2-c7bf5013d740-kube-api-access-sxxhp\") pod \"payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl\" (UID: \"2d42407d-dc56-46da-b0c2-c7bf5013d740\") " pod="openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl"
Sep 07 21:15:28.794511 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:28.794486    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl"
Sep 07 21:15:29.076627 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:29.076597    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl"]
Sep 07 21:15:29.078177 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:15:29.078149    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d42407d_dc56_46da_b0c2_c7bf5013d740.slice/crio-6526cdb3f3129a281e16f15579f6fbdaee15f3d94c28f623c917f0d3e39df9d9 WatchSource:0}: Error finding container 6526cdb3f3129a281e16f15579f6fbdaee15f3d94c28f623c917f0d3e39df9d9: Status 404 returned error can't find the container with id 6526cdb3f3129a281e16f15579f6fbdaee15f3d94c28f623c917f0d3e39df9d9
Sep 07 21:15:29.340046 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:29.339957    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl" event={"ID":"2d42407d-dc56-46da-b0c2-c7bf5013d740","Type":"ContainerStarted","Data":"1027e3834159abe7aa2e936230d5e04c3c9c29264e4d9d7538a3e1658bc357cc"}
Sep 07 21:15:29.340046 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:29.340013    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl" event={"ID":"2d42407d-dc56-46da-b0c2-c7bf5013d740","Type":"ContainerStarted","Data":"6526cdb3f3129a281e16f15579f6fbdaee15f3d94c28f623c917f0d3e39df9d9"}
Sep 07 21:15:29.340273 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:29.340105    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl"
Sep 07 21:15:29.356854 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:29.356805    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl" podStartSLOduration=1.356786449 podStartE2EDuration="1.356786449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:15:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:15:29.354982144 +0000 UTC m=+825.614799399" watchObservedRunningTime="2026-09-07 21:15:29.356786449 +0000 UTC m=+825.616603691"
Sep 07 21:15:33.303826 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:33.303795    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd"
Sep 07 21:15:35.649578 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:35.649543    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m"]
Sep 07 21:15:35.653259 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:35.653241    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m"
Sep 07 21:15:35.656956 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:35.656931    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-9e1e8d-dockercfg-8qvz4\""
Sep 07 21:15:35.657113 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:35.657094    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-9e1e8d\""
Sep 07 21:15:35.666919 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:35.666891    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m"]
Sep 07 21:15:35.767641 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:35.767595    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh9km\" (UniqueName: \"kubernetes.io/projected/b68d7058-4444-46d5-a509-e6f286666d14-kube-api-access-kh9km\") pod \"payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m\" (UID: \"b68d7058-4444-46d5-a509-e6f286666d14\") " pod="openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m"
Sep 07 21:15:35.767845 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:35.767815    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b68d7058-4444-46d5-a509-e6f286666d14-plugins-config-volume\") pod \"payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m\" (UID: \"b68d7058-4444-46d5-a509-e6f286666d14\") " pod="openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m"
Sep 07 21:15:35.868896 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:35.868848    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b68d7058-4444-46d5-a509-e6f286666d14-plugins-config-volume\") pod \"payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m\" (UID: \"b68d7058-4444-46d5-a509-e6f286666d14\") " pod="openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m"
Sep 07 21:15:35.869086 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:35.868931    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh9km\" (UniqueName: \"kubernetes.io/projected/b68d7058-4444-46d5-a509-e6f286666d14-kube-api-access-kh9km\") pod \"payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m\" (UID: \"b68d7058-4444-46d5-a509-e6f286666d14\") " pod="openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m"
Sep 07 21:15:35.869755 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:35.869727    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b68d7058-4444-46d5-a509-e6f286666d14-plugins-config-volume\") pod \"payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m\" (UID: \"b68d7058-4444-46d5-a509-e6f286666d14\") " pod="openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m"
Sep 07 21:15:35.877917 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:35.877849    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh9km\" (UniqueName: \"kubernetes.io/projected/b68d7058-4444-46d5-a509-e6f286666d14-kube-api-access-kh9km\") pod \"payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m\" (UID: \"b68d7058-4444-46d5-a509-e6f286666d14\") " pod="openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m"
Sep 07 21:15:35.967625 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:35.967522    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m"
Sep 07 21:15:36.250877 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:36.250851    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m"]
Sep 07 21:15:36.393425 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:36.393382    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m" event={"ID":"b68d7058-4444-46d5-a509-e6f286666d14","Type":"ContainerStarted","Data":"cdc0c6948b922567b02a5dd9d1b2e3deccb7babe534accad65d93c3b7df651c5"}
Sep 07 21:15:36.393624 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:36.393455    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m" event={"ID":"b68d7058-4444-46d5-a509-e6f286666d14","Type":"ContainerStarted","Data":"d48e75c566a7a537c373f3da014914695b50e910772a5f8ecc3c930f74554d3e"}
Sep 07 21:15:36.393713 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:36.393682    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m"
Sep 07 21:15:36.411230 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:36.411159    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m" podStartSLOduration=1.411138078 podStartE2EDuration="1.411138078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:15:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:15:36.410368039 +0000 UTC m=+832.670185278" watchObservedRunningTime="2026-09-07 21:15:36.411138078 +0000 UTC m=+832.670955323"
Sep 07 21:15:39.415181 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:39.415151    2558 generic.go:356] "Generic (PLEG): container finished" podID="a5d798ec-b58a-4a01-b46d-016d7fa4162d" containerID="91d8328cee4fe25d62319627b2ec527b3701e7afe1b88b728cc886585f0f1deb" exitCode=0
Sep 07 21:15:39.415629 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:39.415224    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp" event={"ID":"a5d798ec-b58a-4a01-b46d-016d7fa4162d","Type":"ContainerDied","Data":"91d8328cee4fe25d62319627b2ec527b3701e7afe1b88b728cc886585f0f1deb"}
Sep 07 21:15:39.415677 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:39.415631    2558 scope.go:117] "RemoveContainer" containerID="91d8328cee4fe25d62319627b2ec527b3701e7afe1b88b728cc886585f0f1deb"
Sep 07 21:15:39.416670 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:39.416642    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:15:39.416734 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:39.416714    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:15:39.416777 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:39.416742    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:15:40.351591 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:40.351549    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl"
Sep 07 21:15:40.425054 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:40.425021    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp" event={"ID":"a5d798ec-b58a-4a01-b46d-016d7fa4162d","Type":"ContainerStarted","Data":"590ce0f3cc2bf038ae0c54591cab6b422c22e49ccad3ec22b0c0fb03773978c8"}
Sep 07 21:15:40.485333 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:40.484721    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:40.485333 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:40.485142    2558 patch_prober.go:28] interesting pod/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 07 21:15:40.485333 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:40.485234    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp" podUID="a5d798ec-b58a-4a01-b46d-016d7fa4162d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 07 21:15:41.484334 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:41.483330    2558 patch_prober.go:28] interesting pod/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 07 21:15:41.484334 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:41.483393    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp" podUID="a5d798ec-b58a-4a01-b46d-016d7fa4162d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 07 21:15:42.484101 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:42.484065    2558 patch_prober.go:28] interesting pod/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 07 21:15:42.484292 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:42.484135    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp" podUID="a5d798ec-b58a-4a01-b46d-016d7fa4162d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 07 21:15:43.484160 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:43.484118    2558 patch_prober.go:28] interesting pod/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 07 21:15:43.484568 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:43.484206    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp" podUID="a5d798ec-b58a-4a01-b46d-016d7fa4162d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 07 21:15:44.483707 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:44.483670    2558 patch_prober.go:28] interesting pod/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 07 21:15:44.483901 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:44.483726    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp" podUID="a5d798ec-b58a-4a01-b46d-016d7fa4162d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 07 21:15:45.484148 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:45.484099    2558 patch_prober.go:28] interesting pod/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 07 21:15:45.484659 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:45.484178    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp" podUID="a5d798ec-b58a-4a01-b46d-016d7fa4162d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 07 21:15:46.482048 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:46.481962    2558 generic.go:356] "Generic (PLEG): container finished" podID="b876072c-16e2-429b-b53e-95a47fe72263" containerID="c5a8de0745dce2b800d6081b51c97dc27ba156cf17dcf1ff01cd4247ab276fd5" exitCode=0
Sep 07 21:15:46.482048 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:46.482035    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s" event={"ID":"b876072c-16e2-429b-b53e-95a47fe72263","Type":"ContainerDied","Data":"c5a8de0745dce2b800d6081b51c97dc27ba156cf17dcf1ff01cd4247ab276fd5"}
Sep 07 21:15:46.482491 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:46.482476    2558 scope.go:117] "RemoveContainer" containerID="c5a8de0745dce2b800d6081b51c97dc27ba156cf17dcf1ff01cd4247ab276fd5"
Sep 07 21:15:46.483591 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:46.483554    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:15:46.483700 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:46.483625    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:15:46.483700 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:46.483681    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:15:46.487715 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:46.487691    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:46.488141 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:46.488124    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:46.488771 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:46.488753    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:15:47.402289 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:47.402253    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m"
Sep 07 21:15:47.490326 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:47.490278    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s" event={"ID":"b876072c-16e2-429b-b53e-95a47fe72263","Type":"ContainerStarted","Data":"670013fc6107900df3ce00b5f0924e23a7bcda8dd56afa7b91f357036f56467a"}
Sep 07 21:15:48.392482 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:48.392447    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:48.392670 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:48.392649    2558 patch_prober.go:28] interesting pod/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 07 21:15:48.392726 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:48.392706    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s" podUID="b876072c-16e2-429b-b53e-95a47fe72263" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 07 21:15:49.392033 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:49.391993    2558 patch_prober.go:28] interesting pod/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 07 21:15:49.392525 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:49.392068    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s" podUID="b876072c-16e2-429b-b53e-95a47fe72263" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 07 21:15:50.392599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:50.392566    2558 patch_prober.go:28] interesting pod/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 07 21:15:50.393026 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:50.392623    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s" podUID="b876072c-16e2-429b-b53e-95a47fe72263" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 07 21:15:51.031700 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:51.031661    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"]
Sep 07 21:15:51.053404 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:51.053372    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"]
Sep 07 21:15:51.053722 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:51.053705    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"
Sep 07 21:15:51.058348 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:51.058323    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-3102b2-serving-cert\""
Sep 07 21:15:51.069862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:51.069720    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db6fc534-3ed7-4433-8789-b25d1cbe4e94-maas-api-tls\") pod \"maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq\" (UID: \"db6fc534-3ed7-4433-8789-b25d1cbe4e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"
Sep 07 21:15:51.069862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:51.069836    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db6fc534-3ed7-4433-8789-b25d1cbe4e94-metrics-certs\") pod \"maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq\" (UID: \"db6fc534-3ed7-4433-8789-b25d1cbe4e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"
Sep 07 21:15:51.070076 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:51.069872    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nlds\" (UniqueName: \"kubernetes.io/projected/db6fc534-3ed7-4433-8789-b25d1cbe4e94-kube-api-access-6nlds\") pod \"maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq\" (UID: \"db6fc534-3ed7-4433-8789-b25d1cbe4e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"
Sep 07 21:15:51.070076 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:51.069942    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db6fc534-3ed7-4433-8789-b25d1cbe4e94-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq\" (UID: \"db6fc534-3ed7-4433-8789-b25d1cbe4e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"
Sep 07 21:15:51.172338 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:51.171881    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db6fc534-3ed7-4433-8789-b25d1cbe4e94-maas-api-tls\") pod \"maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq\" (UID: \"db6fc534-3ed7-4433-8789-b25d1cbe4e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"
Sep 07 21:15:51.172338 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:51.171965    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db6fc534-3ed7-4433-8789-b25d1cbe4e94-metrics-certs\") pod \"maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq\" (UID: \"db6fc534-3ed7-4433-8789-b25d1cbe4e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"
Sep 07 21:15:51.172338 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:51.171998    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nlds\" (UniqueName: \"kubernetes.io/projected/db6fc534-3ed7-4433-8789-b25d1cbe4e94-kube-api-access-6nlds\") pod \"maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq\" (UID: \"db6fc534-3ed7-4433-8789-b25d1cbe4e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"
Sep 07 21:15:51.172338 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:51.172081    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db6fc534-3ed7-4433-8789-b25d1cbe4e94-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq\" (UID: \"db6fc534-3ed7-4433-8789-b25d1cbe4e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"
Sep 07 21:15:51.172895 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:15:51.172856    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-serving-cert: secret "maas-api-e2e-inf-b-3102b2-serving-cert" not found
Sep 07 21:15:51.173003 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:15:51.172938    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db6fc534-3ed7-4433-8789-b25d1cbe4e94-maas-api-tls podName:db6fc534-3ed7-4433-8789-b25d1cbe4e94 nodeName:}" failed. No retries permitted until 2026-09-07 21:15:51.672912743 +0000 UTC m=+847.932729978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/db6fc534-3ed7-4433-8789-b25d1cbe4e94-maas-api-tls") pod "maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq" (UID: "db6fc534-3ed7-4433-8789-b25d1cbe4e94") : secret "maas-api-e2e-inf-b-3102b2-serving-cert" not found
Sep 07 21:15:51.173340 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:51.173247    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db6fc534-3ed7-4433-8789-b25d1cbe4e94-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq\" (UID: \"db6fc534-3ed7-4433-8789-b25d1cbe4e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"
Sep 07 21:15:51.175728 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:51.175706    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db6fc534-3ed7-4433-8789-b25d1cbe4e94-metrics-certs\") pod \"maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq\" (UID: \"db6fc534-3ed7-4433-8789-b25d1cbe4e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"
Sep 07 21:15:51.183690 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:51.183657    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nlds\" (UniqueName: \"kubernetes.io/projected/db6fc534-3ed7-4433-8789-b25d1cbe4e94-kube-api-access-6nlds\") pod \"maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq\" (UID: \"db6fc534-3ed7-4433-8789-b25d1cbe4e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"
Sep 07 21:15:51.392417 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:51.392381    2558 patch_prober.go:28] interesting pod/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 07 21:15:51.392579 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:51.392442    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s" podUID="b876072c-16e2-429b-b53e-95a47fe72263" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 07 21:15:51.676796 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:51.676690    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db6fc534-3ed7-4433-8789-b25d1cbe4e94-maas-api-tls\") pod \"maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq\" (UID: \"db6fc534-3ed7-4433-8789-b25d1cbe4e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"
Sep 07 21:15:51.679850 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:51.679820    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db6fc534-3ed7-4433-8789-b25d1cbe4e94-maas-api-tls\") pod \"maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq\" (UID: \"db6fc534-3ed7-4433-8789-b25d1cbe4e94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"
Sep 07 21:15:51.681620 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:51.681599    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"
Sep 07 21:15:51.995159 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:51.995134    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"]
Sep 07 21:15:51.996627 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:15:51.996590    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb6fc534_3ed7_4433_8789_b25d1cbe4e94.slice/crio-efbb34fef59333689ad2c1bb91785da7c9895591bdffdca0f36dfb83208a57c3 WatchSource:0}: Error finding container efbb34fef59333689ad2c1bb91785da7c9895591bdffdca0f36dfb83208a57c3: Status 404 returned error can't find the container with id efbb34fef59333689ad2c1bb91785da7c9895591bdffdca0f36dfb83208a57c3
Sep 07 21:15:52.392500 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:52.392472    2558 patch_prober.go:28] interesting pod/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 07 21:15:52.392647 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:52.392525    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s" podUID="b876072c-16e2-429b-b53e-95a47fe72263" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 07 21:15:52.521959 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:52.521924    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq" event={"ID":"db6fc534-3ed7-4433-8789-b25d1cbe4e94","Type":"ContainerStarted","Data":"b7cabee95d3968bed6ece0c64122d3fe290d64dc050cef3dbe58f0be63d73cd4"}
Sep 07 21:15:52.522133 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:52.521976    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq" event={"ID":"db6fc534-3ed7-4433-8789-b25d1cbe4e94","Type":"ContainerStarted","Data":"efbb34fef59333689ad2c1bb91785da7c9895591bdffdca0f36dfb83208a57c3"}
Sep 07 21:15:52.522133 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:52.522072    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"
Sep 07 21:15:52.542880 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:52.542811    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq" podStartSLOduration=1.202080365 podStartE2EDuration="1.542788668s" totalImagesPullingTime="340.708303ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:15:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:15:52.539583423 +0000 UTC m=+848.799400692" watchObservedRunningTime="2026-09-07 21:15:52.542788668 +0000 UTC m=+848.802605912"
Sep 07 21:15:53.521416 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:53.521376    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:53.522000 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:53.521972    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:53.523712 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:53.523686    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:15:58.535405 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:15:58.535370    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"
Sep 07 21:16:08.622821 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:08.622785    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl"]
Sep 07 21:16:08.623295 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:08.623064    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl" podUID="2d42407d-dc56-46da-b0c2-c7bf5013d740" containerName="payload-processing" containerID="cri-o://1027e3834159abe7aa2e936230d5e04c3c9c29264e4d9d7538a3e1658bc357cc" gracePeriod=30
Sep 07 21:16:08.899126 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:08.899091    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl"
Sep 07 21:16:08.912374 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:08.912341    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"]
Sep 07 21:16:08.912628 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:08.912591    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s" podUID="b876072c-16e2-429b-b53e-95a47fe72263" containerName="istio-proxy" containerID="cri-o://670013fc6107900df3ce00b5f0924e23a7bcda8dd56afa7b91f357036f56467a" gracePeriod=30
Sep 07 21:16:08.938599 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:08.938571    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d42407d-dc56-46da-b0c2-c7bf5013d740-plugins-config-volume\") pod \"2d42407d-dc56-46da-b0c2-c7bf5013d740\" (UID: \"2d42407d-dc56-46da-b0c2-c7bf5013d740\") "
Sep 07 21:16:08.938767 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:08.938618    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxxhp\" (UniqueName: \"kubernetes.io/projected/2d42407d-dc56-46da-b0c2-c7bf5013d740-kube-api-access-sxxhp\") pod \"2d42407d-dc56-46da-b0c2-c7bf5013d740\" (UID: \"2d42407d-dc56-46da-b0c2-c7bf5013d740\") "
Sep 07 21:16:08.939031 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:08.939003    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d42407d-dc56-46da-b0c2-c7bf5013d740-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2d42407d-dc56-46da-b0c2-c7bf5013d740" (UID: "2d42407d-dc56-46da-b0c2-c7bf5013d740"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:16:08.941422 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:08.941388    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d42407d-dc56-46da-b0c2-c7bf5013d740-kube-api-access-sxxhp" (OuterVolumeSpecName: "kube-api-access-sxxhp") pod "2d42407d-dc56-46da-b0c2-c7bf5013d740" (UID: "2d42407d-dc56-46da-b0c2-c7bf5013d740"). InnerVolumeSpecName "kube-api-access-sxxhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:16:09.039755 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:09.039709    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxxhp\" (UniqueName: \"kubernetes.io/projected/2d42407d-dc56-46da-b0c2-c7bf5013d740-kube-api-access-sxxhp\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:16:09.039755 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:09.039743    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d42407d-dc56-46da-b0c2-c7bf5013d740-plugins-config-volume\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:16:09.626608 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:09.626572    2558 generic.go:356] "Generic (PLEG): container finished" podID="2d42407d-dc56-46da-b0c2-c7bf5013d740" containerID="1027e3834159abe7aa2e936230d5e04c3c9c29264e4d9d7538a3e1658bc357cc" exitCode=0
Sep 07 21:16:09.627131 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:09.626619    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl"
Sep 07 21:16:09.627131 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:09.626632    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl" event={"ID":"2d42407d-dc56-46da-b0c2-c7bf5013d740","Type":"ContainerDied","Data":"1027e3834159abe7aa2e936230d5e04c3c9c29264e4d9d7538a3e1658bc357cc"}
Sep 07 21:16:09.627131 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:09.626687    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl" event={"ID":"2d42407d-dc56-46da-b0c2-c7bf5013d740","Type":"ContainerDied","Data":"6526cdb3f3129a281e16f15579f6fbdaee15f3d94c28f623c917f0d3e39df9d9"}
Sep 07 21:16:09.627131 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:09.626723    2558 scope.go:117] "RemoveContainer" containerID="1027e3834159abe7aa2e936230d5e04c3c9c29264e4d9d7538a3e1658bc357cc"
Sep 07 21:16:09.636821 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:09.636799    2558 scope.go:117] "RemoveContainer" containerID="1027e3834159abe7aa2e936230d5e04c3c9c29264e4d9d7538a3e1658bc357cc"
Sep 07 21:16:09.637095 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:16:09.637076    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1027e3834159abe7aa2e936230d5e04c3c9c29264e4d9d7538a3e1658bc357cc\": container with ID starting with 1027e3834159abe7aa2e936230d5e04c3c9c29264e4d9d7538a3e1658bc357cc not found: ID does not exist" containerID="1027e3834159abe7aa2e936230d5e04c3c9c29264e4d9d7538a3e1658bc357cc"
Sep 07 21:16:09.637157 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:09.637108    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1027e3834159abe7aa2e936230d5e04c3c9c29264e4d9d7538a3e1658bc357cc"} err="failed to get container status \"1027e3834159abe7aa2e936230d5e04c3c9c29264e4d9d7538a3e1658bc357cc\": rpc error: code = NotFound desc = could not find container \"1027e3834159abe7aa2e936230d5e04c3c9c29264e4d9d7538a3e1658bc357cc\": container with ID starting with 1027e3834159abe7aa2e936230d5e04c3c9c29264e4d9d7538a3e1658bc357cc not found: ID does not exist"
Sep 07 21:16:09.652851 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:09.652825    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl"]
Sep 07 21:16:09.655357 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:09.655336    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl"]
Sep 07 21:16:10.309878 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:10.309839    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d42407d-dc56-46da-b0c2-c7bf5013d740" path="/var/lib/kubelet/pods/2d42407d-dc56-46da-b0c2-c7bf5013d740/volumes"
Sep 07 21:16:12.812344 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:12.812299    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"]
Sep 07 21:16:12.812730 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:12.812717    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d42407d-dc56-46da-b0c2-c7bf5013d740" containerName="payload-processing"
Sep 07 21:16:12.812730 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:12.812731    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d42407d-dc56-46da-b0c2-c7bf5013d740" containerName="payload-processing"
Sep 07 21:16:12.812843 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:12.812809    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d42407d-dc56-46da-b0c2-c7bf5013d740" containerName="payload-processing"
Sep 07 21:16:12.816036 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:12.816015    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"
Sep 07 21:16:12.818025 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:12.818003    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-f86b6ac3-serving-cert\""
Sep 07 21:16:12.825789 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:12.825761    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"]
Sep 07 21:16:12.880824 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:12.880790    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2956b8fe-cd32-472b-9eb9-597eb9349d07-openshift-service-ca\") pod \"maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr\" (UID: \"2956b8fe-cd32-472b-9eb9-597eb9349d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"
Sep 07 21:16:12.881018 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:12.880835    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2956b8fe-cd32-472b-9eb9-597eb9349d07-metrics-certs\") pod \"maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr\" (UID: \"2956b8fe-cd32-472b-9eb9-597eb9349d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"
Sep 07 21:16:12.881018 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:12.880877    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bn9x\" (UniqueName: \"kubernetes.io/projected/2956b8fe-cd32-472b-9eb9-597eb9349d07-kube-api-access-8bn9x\") pod \"maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr\" (UID: \"2956b8fe-cd32-472b-9eb9-597eb9349d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"
Sep 07 21:16:12.881018 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:12.880949    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2956b8fe-cd32-472b-9eb9-597eb9349d07-maas-api-tls\") pod \"maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr\" (UID: \"2956b8fe-cd32-472b-9eb9-597eb9349d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"
Sep 07 21:16:12.981662 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:12.981618    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bn9x\" (UniqueName: \"kubernetes.io/projected/2956b8fe-cd32-472b-9eb9-597eb9349d07-kube-api-access-8bn9x\") pod \"maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr\" (UID: \"2956b8fe-cd32-472b-9eb9-597eb9349d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"
Sep 07 21:16:12.981857 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:12.981710    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2956b8fe-cd32-472b-9eb9-597eb9349d07-maas-api-tls\") pod \"maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr\" (UID: \"2956b8fe-cd32-472b-9eb9-597eb9349d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"
Sep 07 21:16:12.981857 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:12.981792    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2956b8fe-cd32-472b-9eb9-597eb9349d07-openshift-service-ca\") pod \"maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr\" (UID: \"2956b8fe-cd32-472b-9eb9-597eb9349d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"
Sep 07 21:16:12.981857 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:12.981828    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2956b8fe-cd32-472b-9eb9-597eb9349d07-metrics-certs\") pod \"maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr\" (UID: \"2956b8fe-cd32-472b-9eb9-597eb9349d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"
Sep 07 21:16:12.982025 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:16:12.981878    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-serving-cert: secret "maas-api-e2e-migrate-f86b6ac3-serving-cert" not found
Sep 07 21:16:12.982025 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:16:12.981957    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2956b8fe-cd32-472b-9eb9-597eb9349d07-maas-api-tls podName:2956b8fe-cd32-472b-9eb9-597eb9349d07 nodeName:}" failed. No retries permitted until 2026-09-07 21:16:13.481937089 +0000 UTC m=+869.741754315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2956b8fe-cd32-472b-9eb9-597eb9349d07-maas-api-tls") pod "maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr" (UID: "2956b8fe-cd32-472b-9eb9-597eb9349d07") : secret "maas-api-e2e-migrate-f86b6ac3-serving-cert" not found
Sep 07 21:16:12.982514 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:12.982486    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2956b8fe-cd32-472b-9eb9-597eb9349d07-openshift-service-ca\") pod \"maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr\" (UID: \"2956b8fe-cd32-472b-9eb9-597eb9349d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"
Sep 07 21:16:12.984401 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:12.984370    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2956b8fe-cd32-472b-9eb9-597eb9349d07-metrics-certs\") pod \"maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr\" (UID: \"2956b8fe-cd32-472b-9eb9-597eb9349d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"
Sep 07 21:16:12.993687 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:12.993658    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bn9x\" (UniqueName: \"kubernetes.io/projected/2956b8fe-cd32-472b-9eb9-597eb9349d07-kube-api-access-8bn9x\") pod \"maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr\" (UID: \"2956b8fe-cd32-472b-9eb9-597eb9349d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"
Sep 07 21:16:13.486702 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:13.486662    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2956b8fe-cd32-472b-9eb9-597eb9349d07-maas-api-tls\") pod \"maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr\" (UID: \"2956b8fe-cd32-472b-9eb9-597eb9349d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"
Sep 07 21:16:13.501828 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:13.499971    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2956b8fe-cd32-472b-9eb9-597eb9349d07-maas-api-tls\") pod \"maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr\" (UID: \"2956b8fe-cd32-472b-9eb9-597eb9349d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"
Sep 07 21:16:13.730693 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:13.730657    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"
Sep 07 21:16:14.005435 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.005409    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"]
Sep 07 21:16:14.006882 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:16:14.006859    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2956b8fe_cd32_472b_9eb9_597eb9349d07.slice/crio-4b33f526a8f1c1504e39078998e35753207e7300dbcc98449c89c326216b8096 WatchSource:0}: Error finding container 4b33f526a8f1c1504e39078998e35753207e7300dbcc98449c89c326216b8096: Status 404 returned error can't find the container with id 4b33f526a8f1c1504e39078998e35753207e7300dbcc98449c89c326216b8096
Sep 07 21:16:14.173829 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.173808    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:16:14.295369 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.295254    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-istio-envoy\") pod \"b876072c-16e2-429b-b53e-95a47fe72263\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") "
Sep 07 21:16:14.295369 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.295297    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4mlc\" (UniqueName: \"kubernetes.io/projected/b876072c-16e2-429b-b53e-95a47fe72263-kube-api-access-g4mlc\") pod \"b876072c-16e2-429b-b53e-95a47fe72263\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") "
Sep 07 21:16:14.295369 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.295333    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-credential-socket\") pod \"b876072c-16e2-429b-b53e-95a47fe72263\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") "
Sep 07 21:16:14.295649 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.295372    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b876072c-16e2-429b-b53e-95a47fe72263-istio-podinfo\") pod \"b876072c-16e2-429b-b53e-95a47fe72263\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") "
Sep 07 21:16:14.295649 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.295400    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b876072c-16e2-429b-b53e-95a47fe72263-istio-token\") pod \"b876072c-16e2-429b-b53e-95a47fe72263\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") "
Sep 07 21:16:14.295649 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.295434    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b876072c-16e2-429b-b53e-95a47fe72263-istiod-ca-cert\") pod \"b876072c-16e2-429b-b53e-95a47fe72263\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") "
Sep 07 21:16:14.295649 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.295468    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-workload-socket\") pod \"b876072c-16e2-429b-b53e-95a47fe72263\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") "
Sep 07 21:16:14.295649 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.295541    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-workload-certs\") pod \"b876072c-16e2-429b-b53e-95a47fe72263\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") "
Sep 07 21:16:14.295649 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.295586    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-istio-data\") pod \"b876072c-16e2-429b-b53e-95a47fe72263\" (UID: \"b876072c-16e2-429b-b53e-95a47fe72263\") "
Sep 07 21:16:14.295948 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.295846    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b876072c-16e2-429b-b53e-95a47fe72263" (UID: "b876072c-16e2-429b-b53e-95a47fe72263"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:16:14.296059 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.296038    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-istio-data" (OuterVolumeSpecName: "istio-data") pod "b876072c-16e2-429b-b53e-95a47fe72263" (UID: "b876072c-16e2-429b-b53e-95a47fe72263"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:16:14.296059 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.296053    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b876072c-16e2-429b-b53e-95a47fe72263" (UID: "b876072c-16e2-429b-b53e-95a47fe72263"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:16:14.296176 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.296089    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b876072c-16e2-429b-b53e-95a47fe72263-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b876072c-16e2-429b-b53e-95a47fe72263" (UID: "b876072c-16e2-429b-b53e-95a47fe72263"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:16:14.296424 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.296392    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b876072c-16e2-429b-b53e-95a47fe72263" (UID: "b876072c-16e2-429b-b53e-95a47fe72263"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:16:14.297812 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.297782    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b876072c-16e2-429b-b53e-95a47fe72263-istio-token" (OuterVolumeSpecName: "istio-token") pod "b876072c-16e2-429b-b53e-95a47fe72263" (UID: "b876072c-16e2-429b-b53e-95a47fe72263"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:16:14.297916 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.297813    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b876072c-16e2-429b-b53e-95a47fe72263" (UID: "b876072c-16e2-429b-b53e-95a47fe72263"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:16:14.297916 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.297826    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b876072c-16e2-429b-b53e-95a47fe72263-kube-api-access-g4mlc" (OuterVolumeSpecName: "kube-api-access-g4mlc") pod "b876072c-16e2-429b-b53e-95a47fe72263" (UID: "b876072c-16e2-429b-b53e-95a47fe72263"). InnerVolumeSpecName "kube-api-access-g4mlc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:16:14.298167 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.298152    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b876072c-16e2-429b-b53e-95a47fe72263-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b876072c-16e2-429b-b53e-95a47fe72263" (UID: "b876072c-16e2-429b-b53e-95a47fe72263"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 21:16:14.396698 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.396666    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-istio-data\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:16:14.396832 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.396701    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-istio-envoy\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:16:14.396832 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.396717    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4mlc\" (UniqueName: \"kubernetes.io/projected/b876072c-16e2-429b-b53e-95a47fe72263-kube-api-access-g4mlc\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:16:14.396832 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.396730    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-credential-socket\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:16:14.396832 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.396742    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b876072c-16e2-429b-b53e-95a47fe72263-istio-podinfo\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:16:14.396832 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.396754    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b876072c-16e2-429b-b53e-95a47fe72263-istio-token\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:16:14.396832 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.396767    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b876072c-16e2-429b-b53e-95a47fe72263-istiod-ca-cert\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:16:14.396832 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.396779    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-workload-socket\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:16:14.396832 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.396790    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b876072c-16e2-429b-b53e-95a47fe72263-workload-certs\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:16:14.657359 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.657320    2558 generic.go:356] "Generic (PLEG): container finished" podID="b876072c-16e2-429b-b53e-95a47fe72263" containerID="670013fc6107900df3ce00b5f0924e23a7bcda8dd56afa7b91f357036f56467a" exitCode=0
Sep 07 21:16:14.657553 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.657372    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"
Sep 07 21:16:14.657553 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.657402    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s" event={"ID":"b876072c-16e2-429b-b53e-95a47fe72263","Type":"ContainerDied","Data":"670013fc6107900df3ce00b5f0924e23a7bcda8dd56afa7b91f357036f56467a"}
Sep 07 21:16:14.657553 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.657468    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s" event={"ID":"b876072c-16e2-429b-b53e-95a47fe72263","Type":"ContainerDied","Data":"0335a837bacb5f1bdf9bd10345c10e7ca9e7200f33dc4229ac49df83b2744fac"}
Sep 07 21:16:14.657553 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.657500    2558 scope.go:117] "RemoveContainer" containerID="670013fc6107900df3ce00b5f0924e23a7bcda8dd56afa7b91f357036f56467a"
Sep 07 21:16:14.659674 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.659591    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr" event={"ID":"2956b8fe-cd32-472b-9eb9-597eb9349d07","Type":"ContainerStarted","Data":"07ddcb47130fe90ec671523dc8aa082eb7942ba4862078643c921b7a12304c3b"}
Sep 07 21:16:14.659674 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.659638    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr" event={"ID":"2956b8fe-cd32-472b-9eb9-597eb9349d07","Type":"ContainerStarted","Data":"4b33f526a8f1c1504e39078998e35753207e7300dbcc98449c89c326216b8096"}
Sep 07 21:16:14.659852 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.659717    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"
Sep 07 21:16:14.667604 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.667586    2558 scope.go:117] "RemoveContainer" containerID="c5a8de0745dce2b800d6081b51c97dc27ba156cf17dcf1ff01cd4247ab276fd5"
Sep 07 21:16:14.674110 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.674086    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"]
Sep 07 21:16:14.677052 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.677022    2558 scope.go:117] "RemoveContainer" containerID="670013fc6107900df3ce00b5f0924e23a7bcda8dd56afa7b91f357036f56467a"
Sep 07 21:16:14.677382 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:16:14.677363    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"670013fc6107900df3ce00b5f0924e23a7bcda8dd56afa7b91f357036f56467a\": container with ID starting with 670013fc6107900df3ce00b5f0924e23a7bcda8dd56afa7b91f357036f56467a not found: ID does not exist" containerID="670013fc6107900df3ce00b5f0924e23a7bcda8dd56afa7b91f357036f56467a"
Sep 07 21:16:14.677492 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.677394    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"670013fc6107900df3ce00b5f0924e23a7bcda8dd56afa7b91f357036f56467a"} err="failed to get container status \"670013fc6107900df3ce00b5f0924e23a7bcda8dd56afa7b91f357036f56467a\": rpc error: code = NotFound desc = could not find container \"670013fc6107900df3ce00b5f0924e23a7bcda8dd56afa7b91f357036f56467a\": container with ID starting with 670013fc6107900df3ce00b5f0924e23a7bcda8dd56afa7b91f357036f56467a not found: ID does not exist"
Sep 07 21:16:14.677492 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.677420    2558 scope.go:117] "RemoveContainer" containerID="c5a8de0745dce2b800d6081b51c97dc27ba156cf17dcf1ff01cd4247ab276fd5"
Sep 07 21:16:14.677699 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:16:14.677679    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5a8de0745dce2b800d6081b51c97dc27ba156cf17dcf1ff01cd4247ab276fd5\": container with ID starting with c5a8de0745dce2b800d6081b51c97dc27ba156cf17dcf1ff01cd4247ab276fd5 not found: ID does not exist" containerID="c5a8de0745dce2b800d6081b51c97dc27ba156cf17dcf1ff01cd4247ab276fd5"
Sep 07 21:16:14.677748 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.677705    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a8de0745dce2b800d6081b51c97dc27ba156cf17dcf1ff01cd4247ab276fd5"} err="failed to get container status \"c5a8de0745dce2b800d6081b51c97dc27ba156cf17dcf1ff01cd4247ab276fd5\": rpc error: code = NotFound desc = could not find container \"c5a8de0745dce2b800d6081b51c97dc27ba156cf17dcf1ff01cd4247ab276fd5\": container with ID starting with c5a8de0745dce2b800d6081b51c97dc27ba156cf17dcf1ff01cd4247ab276fd5 not found: ID does not exist"
Sep 07 21:16:14.677915 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.677899    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s"]
Sep 07 21:16:14.694660 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:14.694617    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr" podStartSLOduration=2.382318063 podStartE2EDuration="2.69460441s" totalImagesPullingTime="312.286347ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:16:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:16:14.693366153 +0000 UTC m=+870.953183420" watchObservedRunningTime="2026-09-07 21:16:14.69460441 +0000 UTC m=+870.954421653"
Sep 07 21:16:16.314937 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:16.314901    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b876072c-16e2-429b-b53e-95a47fe72263" path="/var/lib/kubelet/pods/b876072c-16e2-429b-b53e-95a47fe72263/volumes"
Sep 07 21:16:20.672444 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:20.672414    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"
Sep 07 21:16:43.953549 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:43.952638    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"]
Sep 07 21:16:43.954285 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:43.953821    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr" podUID="2956b8fe-cd32-472b-9eb9-597eb9349d07" containerName="maas-api" containerID="cri-o://07ddcb47130fe90ec671523dc8aa082eb7942ba4862078643c921b7a12304c3b" gracePeriod=30
Sep 07 21:16:44.200817 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.200790    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"
Sep 07 21:16:44.242586 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.242507    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-kv96r_d804af86-d937-4ea6-afb8-760911a10437/console-operator/1.log"
Sep 07 21:16:44.243477 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.243456    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-kv96r_d804af86-d937-4ea6-afb8-760911a10437/console-operator/1.log"
Sep 07 21:16:44.275006 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.274977    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2956b8fe-cd32-472b-9eb9-597eb9349d07-metrics-certs\") pod \"2956b8fe-cd32-472b-9eb9-597eb9349d07\" (UID: \"2956b8fe-cd32-472b-9eb9-597eb9349d07\") "
Sep 07 21:16:44.275254 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.275211    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2956b8fe-cd32-472b-9eb9-597eb9349d07-openshift-service-ca\") pod \"2956b8fe-cd32-472b-9eb9-597eb9349d07\" (UID: \"2956b8fe-cd32-472b-9eb9-597eb9349d07\") "
Sep 07 21:16:44.275376 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.275277    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bn9x\" (UniqueName: \"kubernetes.io/projected/2956b8fe-cd32-472b-9eb9-597eb9349d07-kube-api-access-8bn9x\") pod \"2956b8fe-cd32-472b-9eb9-597eb9349d07\" (UID: \"2956b8fe-cd32-472b-9eb9-597eb9349d07\") "
Sep 07 21:16:44.275376 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.275301    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2956b8fe-cd32-472b-9eb9-597eb9349d07-maas-api-tls\") pod \"2956b8fe-cd32-472b-9eb9-597eb9349d07\" (UID: \"2956b8fe-cd32-472b-9eb9-597eb9349d07\") "
Sep 07 21:16:44.275753 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.275706    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2956b8fe-cd32-472b-9eb9-597eb9349d07-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2956b8fe-cd32-472b-9eb9-597eb9349d07" (UID: "2956b8fe-cd32-472b-9eb9-597eb9349d07"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:16:44.279270 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.279240    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2956b8fe-cd32-472b-9eb9-597eb9349d07-kube-api-access-8bn9x" (OuterVolumeSpecName: "kube-api-access-8bn9x") pod "2956b8fe-cd32-472b-9eb9-597eb9349d07" (UID: "2956b8fe-cd32-472b-9eb9-597eb9349d07"). InnerVolumeSpecName "kube-api-access-8bn9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:16:44.280271 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.280244    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2956b8fe-cd32-472b-9eb9-597eb9349d07-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2956b8fe-cd32-472b-9eb9-597eb9349d07" (UID: "2956b8fe-cd32-472b-9eb9-597eb9349d07"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:16:44.281967 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.281941    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2956b8fe-cd32-472b-9eb9-597eb9349d07-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2956b8fe-cd32-472b-9eb9-597eb9349d07" (UID: "2956b8fe-cd32-472b-9eb9-597eb9349d07"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:16:44.376383 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.376348    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2956b8fe-cd32-472b-9eb9-597eb9349d07-metrics-certs\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:16:44.376383 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.376377    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2956b8fe-cd32-472b-9eb9-597eb9349d07-openshift-service-ca\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:16:44.376383 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.376388    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bn9x\" (UniqueName: \"kubernetes.io/projected/2956b8fe-cd32-472b-9eb9-597eb9349d07-kube-api-access-8bn9x\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:16:44.376608 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.376401    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2956b8fe-cd32-472b-9eb9-597eb9349d07-maas-api-tls\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:16:44.838739 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.838702    2558 generic.go:356] "Generic (PLEG): container finished" podID="2956b8fe-cd32-472b-9eb9-597eb9349d07" containerID="07ddcb47130fe90ec671523dc8aa082eb7942ba4862078643c921b7a12304c3b" exitCode=0
Sep 07 21:16:44.838921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.838747    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"
Sep 07 21:16:44.838921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.838784    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr" event={"ID":"2956b8fe-cd32-472b-9eb9-597eb9349d07","Type":"ContainerDied","Data":"07ddcb47130fe90ec671523dc8aa082eb7942ba4862078643c921b7a12304c3b"}
Sep 07 21:16:44.838921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.838837    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr" event={"ID":"2956b8fe-cd32-472b-9eb9-597eb9349d07","Type":"ContainerDied","Data":"4b33f526a8f1c1504e39078998e35753207e7300dbcc98449c89c326216b8096"}
Sep 07 21:16:44.838921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.838870    2558 scope.go:117] "RemoveContainer" containerID="07ddcb47130fe90ec671523dc8aa082eb7942ba4862078643c921b7a12304c3b"
Sep 07 21:16:44.848552 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.848533    2558 scope.go:117] "RemoveContainer" containerID="07ddcb47130fe90ec671523dc8aa082eb7942ba4862078643c921b7a12304c3b"
Sep 07 21:16:44.848849 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:16:44.848830    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07ddcb47130fe90ec671523dc8aa082eb7942ba4862078643c921b7a12304c3b\": container with ID starting with 07ddcb47130fe90ec671523dc8aa082eb7942ba4862078643c921b7a12304c3b not found: ID does not exist" containerID="07ddcb47130fe90ec671523dc8aa082eb7942ba4862078643c921b7a12304c3b"
Sep 07 21:16:44.848890 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.848860    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07ddcb47130fe90ec671523dc8aa082eb7942ba4862078643c921b7a12304c3b"} err="failed to get container status \"07ddcb47130fe90ec671523dc8aa082eb7942ba4862078643c921b7a12304c3b\": rpc error: code = NotFound desc = could not find container \"07ddcb47130fe90ec671523dc8aa082eb7942ba4862078643c921b7a12304c3b\": container with ID starting with 07ddcb47130fe90ec671523dc8aa082eb7942ba4862078643c921b7a12304c3b not found: ID does not exist"
Sep 07 21:16:44.854713 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.854684    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"]
Sep 07 21:16:44.858483 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:44.858460    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f86b6ac3-5f47b8dc88-tfwdr"]
Sep 07 21:16:46.310704 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:46.310666    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2956b8fe-cd32-472b-9eb9-597eb9349d07" path="/var/lib/kubelet/pods/2956b8fe-cd32-472b-9eb9-597eb9349d07/volumes"
Sep 07 21:16:48.689889 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.689845    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"]
Sep 07 21:16:48.690499 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.690475    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b876072c-16e2-429b-b53e-95a47fe72263" containerName="istio-proxy"
Sep 07 21:16:48.690499 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.690497    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b876072c-16e2-429b-b53e-95a47fe72263" containerName="istio-proxy"
Sep 07 21:16:48.690706 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.690513    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2956b8fe-cd32-472b-9eb9-597eb9349d07" containerName="maas-api"
Sep 07 21:16:48.690706 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.690522    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2956b8fe-cd32-472b-9eb9-597eb9349d07" containerName="maas-api"
Sep 07 21:16:48.690706 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.690544    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b876072c-16e2-429b-b53e-95a47fe72263" containerName="istio-proxy"
Sep 07 21:16:48.690706 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.690552    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b876072c-16e2-429b-b53e-95a47fe72263" containerName="istio-proxy"
Sep 07 21:16:48.690706 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.690639    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b876072c-16e2-429b-b53e-95a47fe72263" containerName="istio-proxy"
Sep 07 21:16:48.690706 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.690651    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2956b8fe-cd32-472b-9eb9-597eb9349d07" containerName="maas-api"
Sep 07 21:16:48.694391 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.694369    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"
Sep 07 21:16:48.696777 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.696754    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b910426f-serving-cert\""
Sep 07 21:16:48.702371 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.702347    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"]
Sep 07 21:16:48.721447 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.721411    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrtqd\" (UniqueName: \"kubernetes.io/projected/64ae3637-6ef8-4434-92f3-8e2c40db1635-kube-api-access-rrtqd\") pod \"maas-api-e2e-ait-b910426f-5987cb6476-ldvjx\" (UID: \"64ae3637-6ef8-4434-92f3-8e2c40db1635\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"
Sep 07 21:16:48.721613 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.721474    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64ae3637-6ef8-4434-92f3-8e2c40db1635-maas-api-tls\") pod \"maas-api-e2e-ait-b910426f-5987cb6476-ldvjx\" (UID: \"64ae3637-6ef8-4434-92f3-8e2c40db1635\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"
Sep 07 21:16:48.721613 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.721523    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64ae3637-6ef8-4434-92f3-8e2c40db1635-openshift-service-ca\") pod \"maas-api-e2e-ait-b910426f-5987cb6476-ldvjx\" (UID: \"64ae3637-6ef8-4434-92f3-8e2c40db1635\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"
Sep 07 21:16:48.721613 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.721555    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64ae3637-6ef8-4434-92f3-8e2c40db1635-metrics-certs\") pod \"maas-api-e2e-ait-b910426f-5987cb6476-ldvjx\" (UID: \"64ae3637-6ef8-4434-92f3-8e2c40db1635\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"
Sep 07 21:16:48.822845 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.822811    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64ae3637-6ef8-4434-92f3-8e2c40db1635-openshift-service-ca\") pod \"maas-api-e2e-ait-b910426f-5987cb6476-ldvjx\" (UID: \"64ae3637-6ef8-4434-92f3-8e2c40db1635\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"
Sep 07 21:16:48.822845 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.822853    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64ae3637-6ef8-4434-92f3-8e2c40db1635-metrics-certs\") pod \"maas-api-e2e-ait-b910426f-5987cb6476-ldvjx\" (UID: \"64ae3637-6ef8-4434-92f3-8e2c40db1635\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"
Sep 07 21:16:48.823089 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.822938    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrtqd\" (UniqueName: \"kubernetes.io/projected/64ae3637-6ef8-4434-92f3-8e2c40db1635-kube-api-access-rrtqd\") pod \"maas-api-e2e-ait-b910426f-5987cb6476-ldvjx\" (UID: \"64ae3637-6ef8-4434-92f3-8e2c40db1635\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"
Sep 07 21:16:48.823089 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.822987    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64ae3637-6ef8-4434-92f3-8e2c40db1635-maas-api-tls\") pod \"maas-api-e2e-ait-b910426f-5987cb6476-ldvjx\" (UID: \"64ae3637-6ef8-4434-92f3-8e2c40db1635\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"
Sep 07 21:16:48.823206 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:16:48.823094    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-serving-cert: secret "maas-api-e2e-ait-b910426f-serving-cert" not found
Sep 07 21:16:48.823206 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:16:48.823164    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64ae3637-6ef8-4434-92f3-8e2c40db1635-maas-api-tls podName:64ae3637-6ef8-4434-92f3-8e2c40db1635 nodeName:}" failed. No retries permitted until 2026-09-07 21:16:49.323143466 +0000 UTC m=+905.582960700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/64ae3637-6ef8-4434-92f3-8e2c40db1635-maas-api-tls") pod "maas-api-e2e-ait-b910426f-5987cb6476-ldvjx" (UID: "64ae3637-6ef8-4434-92f3-8e2c40db1635") : secret "maas-api-e2e-ait-b910426f-serving-cert" not found
Sep 07 21:16:48.823523 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.823502    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64ae3637-6ef8-4434-92f3-8e2c40db1635-openshift-service-ca\") pod \"maas-api-e2e-ait-b910426f-5987cb6476-ldvjx\" (UID: \"64ae3637-6ef8-4434-92f3-8e2c40db1635\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"
Sep 07 21:16:48.825495 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.825476    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64ae3637-6ef8-4434-92f3-8e2c40db1635-metrics-certs\") pod \"maas-api-e2e-ait-b910426f-5987cb6476-ldvjx\" (UID: \"64ae3637-6ef8-4434-92f3-8e2c40db1635\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"
Sep 07 21:16:48.831320 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:48.831287    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrtqd\" (UniqueName: \"kubernetes.io/projected/64ae3637-6ef8-4434-92f3-8e2c40db1635-kube-api-access-rrtqd\") pod \"maas-api-e2e-ait-b910426f-5987cb6476-ldvjx\" (UID: \"64ae3637-6ef8-4434-92f3-8e2c40db1635\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"
Sep 07 21:16:49.290345 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:49.290297    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r"]
Sep 07 21:16:49.290817 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:49.290802    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b876072c-16e2-429b-b53e-95a47fe72263" containerName="istio-proxy"
Sep 07 21:16:49.294173 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:49.294156    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r"
Sep 07 21:16:49.298234 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:49.298212    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-b910426f-dockercfg-km6zf\""
Sep 07 21:16:49.298633 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:49.298583    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-b910426f\""
Sep 07 21:16:49.308433 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:49.308406    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r"]
Sep 07 21:16:49.328479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:49.328446    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9633055-758a-474e-bab7-f8f639350a7c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r\" (UID: \"f9633055-758a-474e-bab7-f8f639350a7c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r"
Sep 07 21:16:49.328606 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:49.328546    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64ae3637-6ef8-4434-92f3-8e2c40db1635-maas-api-tls\") pod \"maas-api-e2e-ait-b910426f-5987cb6476-ldvjx\" (UID: \"64ae3637-6ef8-4434-92f3-8e2c40db1635\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"
Sep 07 21:16:49.328672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:49.328655    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jkdp\" (UniqueName: \"kubernetes.io/projected/f9633055-758a-474e-bab7-f8f639350a7c-kube-api-access-8jkdp\") pod \"payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r\" (UID: \"f9633055-758a-474e-bab7-f8f639350a7c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r"
Sep 07 21:16:49.330907 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:49.330883    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64ae3637-6ef8-4434-92f3-8e2c40db1635-maas-api-tls\") pod \"maas-api-e2e-ait-b910426f-5987cb6476-ldvjx\" (UID: \"64ae3637-6ef8-4434-92f3-8e2c40db1635\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"
Sep 07 21:16:49.429962 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:49.429924    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jkdp\" (UniqueName: \"kubernetes.io/projected/f9633055-758a-474e-bab7-f8f639350a7c-kube-api-access-8jkdp\") pod \"payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r\" (UID: \"f9633055-758a-474e-bab7-f8f639350a7c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r"
Sep 07 21:16:49.430155 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:49.430017    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9633055-758a-474e-bab7-f8f639350a7c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r\" (UID: \"f9633055-758a-474e-bab7-f8f639350a7c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r"
Sep 07 21:16:49.430787 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:49.430769    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9633055-758a-474e-bab7-f8f639350a7c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r\" (UID: \"f9633055-758a-474e-bab7-f8f639350a7c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r"
Sep 07 21:16:49.437614 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:49.437587    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jkdp\" (UniqueName: \"kubernetes.io/projected/f9633055-758a-474e-bab7-f8f639350a7c-kube-api-access-8jkdp\") pod \"payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r\" (UID: \"f9633055-758a-474e-bab7-f8f639350a7c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r"
Sep 07 21:16:49.604896 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:49.604865    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r"
Sep 07 21:16:49.609252 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:49.609228    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"
Sep 07 21:16:49.884329 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:49.884288    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r"]
Sep 07 21:16:49.886197 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:16:49.886155    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9633055_758a_474e_bab7_f8f639350a7c.slice/crio-cc2f32158dc1cf995d95d6dd435ca0486890ce07fbb7b99fd1003d9170e72c31 WatchSource:0}: Error finding container cc2f32158dc1cf995d95d6dd435ca0486890ce07fbb7b99fd1003d9170e72c31: Status 404 returned error can't find the container with id cc2f32158dc1cf995d95d6dd435ca0486890ce07fbb7b99fd1003d9170e72c31
Sep 07 21:16:49.904948 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:49.904918    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"]
Sep 07 21:16:49.906449 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:16:49.906417    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64ae3637_6ef8_4434_92f3_8e2c40db1635.slice/crio-9dbf8c042175b3133fa2fbf00216304a855db7bae23d843d5c5013fdb1c06610 WatchSource:0}: Error finding container 9dbf8c042175b3133fa2fbf00216304a855db7bae23d843d5c5013fdb1c06610: Status 404 returned error can't find the container with id 9dbf8c042175b3133fa2fbf00216304a855db7bae23d843d5c5013fdb1c06610
Sep 07 21:16:50.881708 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:50.881667    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r" event={"ID":"f9633055-758a-474e-bab7-f8f639350a7c","Type":"ContainerStarted","Data":"2481e29e6a6b8d499826c90da5f15f7e82cd7e93d6a576aee55d6f15c7407c91"}
Sep 07 21:16:50.881987 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:50.881738    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r" event={"ID":"f9633055-758a-474e-bab7-f8f639350a7c","Type":"ContainerStarted","Data":"cc2f32158dc1cf995d95d6dd435ca0486890ce07fbb7b99fd1003d9170e72c31"}
Sep 07 21:16:50.881987 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:50.881768    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r"
Sep 07 21:16:50.883595 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:50.883569    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx" event={"ID":"64ae3637-6ef8-4434-92f3-8e2c40db1635","Type":"ContainerStarted","Data":"ee7443c3ed8bf4f8fea2b284ef8672d0bab8d0d03dff53730a29204898dd1ffa"}
Sep 07 21:16:50.883698 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:50.883616    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx" event={"ID":"64ae3637-6ef8-4434-92f3-8e2c40db1635","Type":"ContainerStarted","Data":"9dbf8c042175b3133fa2fbf00216304a855db7bae23d843d5c5013fdb1c06610"}
Sep 07 21:16:50.883698 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:50.883654    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"
Sep 07 21:16:50.898823 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:50.898767    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r" podStartSLOduration=1.898749807 podStartE2EDuration="1.898749807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:16:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:16:50.896034354 +0000 UTC m=+907.155851615" watchObservedRunningTime="2026-09-07 21:16:50.898749807 +0000 UTC m=+907.158567050"
Sep 07 21:16:50.913659 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:50.913611    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx" podStartSLOduration=2.4697049509999998 podStartE2EDuration="2.913594638s" totalImagesPullingTime="443.889687ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:16:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:16:50.910712886 +0000 UTC m=+907.170530154" watchObservedRunningTime="2026-09-07 21:16:50.913594638 +0000 UTC m=+907.173411881"
Sep 07 21:16:56.895740 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:16:56.895709    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"
Sep 07 21:17:01.892157 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:01.892125    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r"
Sep 07 21:17:19.248543 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.248509    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"]
Sep 07 21:17:19.249020 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.248823    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx" podUID="64ae3637-6ef8-4434-92f3-8e2c40db1635" containerName="maas-api" containerID="cri-o://ee7443c3ed8bf4f8fea2b284ef8672d0bab8d0d03dff53730a29204898dd1ffa" gracePeriod=30
Sep 07 21:17:19.310102 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.310063    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r"]
Sep 07 21:17:19.310322 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.310281    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r" podUID="f9633055-758a-474e-bab7-f8f639350a7c" containerName="payload-pre-processing" containerID="cri-o://2481e29e6a6b8d499826c90da5f15f7e82cd7e93d6a576aee55d6f15c7407c91" gracePeriod=30
Sep 07 21:17:19.565986 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.565939    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"
Sep 07 21:17:19.594853 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.594829    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r"
Sep 07 21:17:19.639469 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.639434    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jkdp\" (UniqueName: \"kubernetes.io/projected/f9633055-758a-474e-bab7-f8f639350a7c-kube-api-access-8jkdp\") pod \"f9633055-758a-474e-bab7-f8f639350a7c\" (UID: \"f9633055-758a-474e-bab7-f8f639350a7c\") "
Sep 07 21:17:19.639651 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.639488    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64ae3637-6ef8-4434-92f3-8e2c40db1635-maas-api-tls\") pod \"64ae3637-6ef8-4434-92f3-8e2c40db1635\" (UID: \"64ae3637-6ef8-4434-92f3-8e2c40db1635\") "
Sep 07 21:17:19.639651 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.639510    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64ae3637-6ef8-4434-92f3-8e2c40db1635-metrics-certs\") pod \"64ae3637-6ef8-4434-92f3-8e2c40db1635\" (UID: \"64ae3637-6ef8-4434-92f3-8e2c40db1635\") "
Sep 07 21:17:19.639651 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.639610    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9633055-758a-474e-bab7-f8f639350a7c-plugins-config-volume\") pod \"f9633055-758a-474e-bab7-f8f639350a7c\" (UID: \"f9633055-758a-474e-bab7-f8f639350a7c\") "
Sep 07 21:17:19.639837 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.639658    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64ae3637-6ef8-4434-92f3-8e2c40db1635-openshift-service-ca\") pod \"64ae3637-6ef8-4434-92f3-8e2c40db1635\" (UID: \"64ae3637-6ef8-4434-92f3-8e2c40db1635\") "
Sep 07 21:17:19.640068 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.640039    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9633055-758a-474e-bab7-f8f639350a7c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f9633055-758a-474e-bab7-f8f639350a7c" (UID: "f9633055-758a-474e-bab7-f8f639350a7c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:17:19.640166 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.640098    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64ae3637-6ef8-4434-92f3-8e2c40db1635-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "64ae3637-6ef8-4434-92f3-8e2c40db1635" (UID: "64ae3637-6ef8-4434-92f3-8e2c40db1635"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:17:19.641700 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.641671    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64ae3637-6ef8-4434-92f3-8e2c40db1635-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "64ae3637-6ef8-4434-92f3-8e2c40db1635" (UID: "64ae3637-6ef8-4434-92f3-8e2c40db1635"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:17:19.641792 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.641711    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64ae3637-6ef8-4434-92f3-8e2c40db1635-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "64ae3637-6ef8-4434-92f3-8e2c40db1635" (UID: "64ae3637-6ef8-4434-92f3-8e2c40db1635"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:17:19.641792 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.641728    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9633055-758a-474e-bab7-f8f639350a7c-kube-api-access-8jkdp" (OuterVolumeSpecName: "kube-api-access-8jkdp") pod "f9633055-758a-474e-bab7-f8f639350a7c" (UID: "f9633055-758a-474e-bab7-f8f639350a7c"). InnerVolumeSpecName "kube-api-access-8jkdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:17:19.740330 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.740284    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrtqd\" (UniqueName: \"kubernetes.io/projected/64ae3637-6ef8-4434-92f3-8e2c40db1635-kube-api-access-rrtqd\") pod \"64ae3637-6ef8-4434-92f3-8e2c40db1635\" (UID: \"64ae3637-6ef8-4434-92f3-8e2c40db1635\") "
Sep 07 21:17:19.740624 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.740605    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64ae3637-6ef8-4434-92f3-8e2c40db1635-maas-api-tls\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:17:19.740667 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.740631    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64ae3637-6ef8-4434-92f3-8e2c40db1635-metrics-certs\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:17:19.740667 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.740644    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9633055-758a-474e-bab7-f8f639350a7c-plugins-config-volume\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:17:19.740667 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.740657    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64ae3637-6ef8-4434-92f3-8e2c40db1635-openshift-service-ca\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:17:19.740765 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.740669    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jkdp\" (UniqueName: \"kubernetes.io/projected/f9633055-758a-474e-bab7-f8f639350a7c-kube-api-access-8jkdp\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:17:19.742348 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.742329    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64ae3637-6ef8-4434-92f3-8e2c40db1635-kube-api-access-rrtqd" (OuterVolumeSpecName: "kube-api-access-rrtqd") pod "64ae3637-6ef8-4434-92f3-8e2c40db1635" (UID: "64ae3637-6ef8-4434-92f3-8e2c40db1635"). InnerVolumeSpecName "kube-api-access-rrtqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:17:19.841223 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:19.841173    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrtqd\" (UniqueName: \"kubernetes.io/projected/64ae3637-6ef8-4434-92f3-8e2c40db1635-kube-api-access-rrtqd\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:17:20.064692 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:20.064660    2558 generic.go:356] "Generic (PLEG): container finished" podID="f9633055-758a-474e-bab7-f8f639350a7c" containerID="2481e29e6a6b8d499826c90da5f15f7e82cd7e93d6a576aee55d6f15c7407c91" exitCode=0
Sep 07 21:17:20.064890 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:20.064708    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r"
Sep 07 21:17:20.064890 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:20.064749    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r" event={"ID":"f9633055-758a-474e-bab7-f8f639350a7c","Type":"ContainerDied","Data":"2481e29e6a6b8d499826c90da5f15f7e82cd7e93d6a576aee55d6f15c7407c91"}
Sep 07 21:17:20.064890 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:20.064800    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r" event={"ID":"f9633055-758a-474e-bab7-f8f639350a7c","Type":"ContainerDied","Data":"cc2f32158dc1cf995d95d6dd435ca0486890ce07fbb7b99fd1003d9170e72c31"}
Sep 07 21:17:20.064890 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:20.064824    2558 scope.go:117] "RemoveContainer" containerID="2481e29e6a6b8d499826c90da5f15f7e82cd7e93d6a576aee55d6f15c7407c91"
Sep 07 21:17:20.066146 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:20.066125    2558 generic.go:356] "Generic (PLEG): container finished" podID="64ae3637-6ef8-4434-92f3-8e2c40db1635" containerID="ee7443c3ed8bf4f8fea2b284ef8672d0bab8d0d03dff53730a29204898dd1ffa" exitCode=0
Sep 07 21:17:20.066254 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:20.066202    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx" event={"ID":"64ae3637-6ef8-4434-92f3-8e2c40db1635","Type":"ContainerDied","Data":"ee7443c3ed8bf4f8fea2b284ef8672d0bab8d0d03dff53730a29204898dd1ffa"}
Sep 07 21:17:20.066254 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:20.066220    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"
Sep 07 21:17:20.066254 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:20.066233    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx" event={"ID":"64ae3637-6ef8-4434-92f3-8e2c40db1635","Type":"ContainerDied","Data":"9dbf8c042175b3133fa2fbf00216304a855db7bae23d843d5c5013fdb1c06610"}
Sep 07 21:17:20.074550 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:20.074532    2558 scope.go:117] "RemoveContainer" containerID="2481e29e6a6b8d499826c90da5f15f7e82cd7e93d6a576aee55d6f15c7407c91"
Sep 07 21:17:20.074830 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:17:20.074808    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2481e29e6a6b8d499826c90da5f15f7e82cd7e93d6a576aee55d6f15c7407c91\": container with ID starting with 2481e29e6a6b8d499826c90da5f15f7e82cd7e93d6a576aee55d6f15c7407c91 not found: ID does not exist" containerID="2481e29e6a6b8d499826c90da5f15f7e82cd7e93d6a576aee55d6f15c7407c91"
Sep 07 21:17:20.074933 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:20.074844    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2481e29e6a6b8d499826c90da5f15f7e82cd7e93d6a576aee55d6f15c7407c91"} err="failed to get container status \"2481e29e6a6b8d499826c90da5f15f7e82cd7e93d6a576aee55d6f15c7407c91\": rpc error: code = NotFound desc = could not find container \"2481e29e6a6b8d499826c90da5f15f7e82cd7e93d6a576aee55d6f15c7407c91\": container with ID starting with 2481e29e6a6b8d499826c90da5f15f7e82cd7e93d6a576aee55d6f15c7407c91 not found: ID does not exist"
Sep 07 21:17:20.074933 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:20.074866    2558 scope.go:117] "RemoveContainer" containerID="ee7443c3ed8bf4f8fea2b284ef8672d0bab8d0d03dff53730a29204898dd1ffa"
Sep 07 21:17:20.083174 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:20.083158    2558 scope.go:117] "RemoveContainer" containerID="ee7443c3ed8bf4f8fea2b284ef8672d0bab8d0d03dff53730a29204898dd1ffa"
Sep 07 21:17:20.083448 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:17:20.083431    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee7443c3ed8bf4f8fea2b284ef8672d0bab8d0d03dff53730a29204898dd1ffa\": container with ID starting with ee7443c3ed8bf4f8fea2b284ef8672d0bab8d0d03dff53730a29204898dd1ffa not found: ID does not exist" containerID="ee7443c3ed8bf4f8fea2b284ef8672d0bab8d0d03dff53730a29204898dd1ffa"
Sep 07 21:17:20.083502 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:20.083453    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee7443c3ed8bf4f8fea2b284ef8672d0bab8d0d03dff53730a29204898dd1ffa"} err="failed to get container status \"ee7443c3ed8bf4f8fea2b284ef8672d0bab8d0d03dff53730a29204898dd1ffa\": rpc error: code = NotFound desc = could not find container \"ee7443c3ed8bf4f8fea2b284ef8672d0bab8d0d03dff53730a29204898dd1ffa\": container with ID starting with ee7443c3ed8bf4f8fea2b284ef8672d0bab8d0d03dff53730a29204898dd1ffa not found: ID does not exist"
Sep 07 21:17:20.089064 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:20.089043    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r"]
Sep 07 21:17:20.092446 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:20.092400    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r"]
Sep 07 21:17:20.102653 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:20.102634    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"]
Sep 07 21:17:20.106004 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:20.105984    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b910426f-5987cb6476-ldvjx"]
Sep 07 21:17:20.309909 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:20.309875    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64ae3637-6ef8-4434-92f3-8e2c40db1635" path="/var/lib/kubelet/pods/64ae3637-6ef8-4434-92f3-8e2c40db1635/volumes"
Sep 07 21:17:20.310267 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:20.310244    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9633055-758a-474e-bab7-f8f639350a7c" path="/var/lib/kubelet/pods/f9633055-758a-474e-bab7-f8f639350a7c/volumes"
Sep 07 21:17:21.233841 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.233806    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"]
Sep 07 21:17:21.234339 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.234320    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9633055-758a-474e-bab7-f8f639350a7c" containerName="payload-pre-processing"
Sep 07 21:17:21.234339 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.234338    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9633055-758a-474e-bab7-f8f639350a7c" containerName="payload-pre-processing"
Sep 07 21:17:21.234471 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.234355    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64ae3637-6ef8-4434-92f3-8e2c40db1635" containerName="maas-api"
Sep 07 21:17:21.234471 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.234361    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="64ae3637-6ef8-4434-92f3-8e2c40db1635" containerName="maas-api"
Sep 07 21:17:21.234471 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.234422    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="64ae3637-6ef8-4434-92f3-8e2c40db1635" containerName="maas-api"
Sep 07 21:17:21.234471 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.234431    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9633055-758a-474e-bab7-f8f639350a7c" containerName="payload-pre-processing"
Sep 07 21:17:21.238978 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.238958    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.241140 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.241121    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-38b04325-openshift-default-dockercfg-qn6x4\""
Sep 07 21:17:21.250775 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.250752    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"]
Sep 07 21:17:21.251569 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.251544    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmsw2\" (UniqueName: \"kubernetes.io/projected/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-kube-api-access-cmsw2\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.251678 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.251598    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-workload-socket\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.251743 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.251721    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-podinfo\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.251814 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.251795    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istiod-ca-cert\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.251877 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.251837    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-data\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.251938 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.251880    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-workload-certs\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.251938 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.251930    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-envoy\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.252036 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.251966    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-credential-socket\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.252036 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.251991    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-token\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.353121 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.353087    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istiod-ca-cert\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.353620 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.353139    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-data\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.353620 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.353175    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-workload-certs\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.353620 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.353227    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-envoy\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.353620 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.353257    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-credential-socket\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.353620 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.353284    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-token\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.353620 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.353347    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmsw2\" (UniqueName: \"kubernetes.io/projected/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-kube-api-access-cmsw2\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.353620 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.353400    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-workload-socket\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.353620 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.353533    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-podinfo\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.354067 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.353762    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-workload-certs\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.354067 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.353879    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-credential-socket\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.354067 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.353940    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-workload-socket\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.354067 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.353971    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istiod-ca-cert\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.354389 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.354363    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-data\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.355900 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.355879    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-envoy\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.356086 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.356065    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-podinfo\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.361912 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.361890    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-token\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.362014 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.361995    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmsw2\" (UniqueName: \"kubernetes.io/projected/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-kube-api-access-cmsw2\") pod \"e2e-derive-38b04325-openshift-default-58856786bd-r7qr5\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") " pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.552775 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.552748    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:21.833044 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.833015    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"]
Sep 07 21:17:21.834836 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:17:21.834809    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1cff8f6_34c9_47f7_af15_4eaa8ec12795.slice/crio-e68dd5bd2d5b0371bd43f603925c880d94d7b914e75a54887d2fb8ce4542e3da WatchSource:0}: Error finding container e68dd5bd2d5b0371bd43f603925c880d94d7b914e75a54887d2fb8ce4542e3da: Status 404 returned error can't find the container with id e68dd5bd2d5b0371bd43f603925c880d94d7b914e75a54887d2fb8ce4542e3da
Sep 07 21:17:21.837569 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.837532    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:17:21.837656 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.837606    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:17:21.837656 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:21.837642    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:17:22.086629 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:22.086530    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5" event={"ID":"b1cff8f6-34c9-47f7-af15-4eaa8ec12795","Type":"ContainerStarted","Data":"72fc2961411f72bffcfb5b1caf061bab694babc91d4790e45b6b79461dabcc8f"}
Sep 07 21:17:22.086800 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:22.086644    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5" event={"ID":"b1cff8f6-34c9-47f7-af15-4eaa8ec12795","Type":"ContainerStarted","Data":"e68dd5bd2d5b0371bd43f603925c880d94d7b914e75a54887d2fb8ce4542e3da"}
Sep 07 21:17:22.105420 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:22.105370    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5" podStartSLOduration=1.105353767 podStartE2EDuration="1.105353767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:17:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:17:22.102621941 +0000 UTC m=+938.362439185" watchObservedRunningTime="2026-09-07 21:17:22.105353767 +0000 UTC m=+938.365171010"
Sep 07 21:17:22.316043 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:22.316002    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m"]
Sep 07 21:17:22.316500 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:22.316470    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m" podUID="b68d7058-4444-46d5-a509-e6f286666d14" containerName="payload-processing" containerID="cri-o://cdc0c6948b922567b02a5dd9d1b2e3deccb7babe534accad65d93c3b7df651c5" gracePeriod=30
Sep 07 21:17:22.553895 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:22.553864    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:22.559134 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:22.559111    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:22.609026 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:22.609001    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m"
Sep 07 21:17:22.665486 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:22.665405    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b68d7058-4444-46d5-a509-e6f286666d14-plugins-config-volume\") pod \"b68d7058-4444-46d5-a509-e6f286666d14\" (UID: \"b68d7058-4444-46d5-a509-e6f286666d14\") "
Sep 07 21:17:22.665486 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:22.665437    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kh9km\" (UniqueName: \"kubernetes.io/projected/b68d7058-4444-46d5-a509-e6f286666d14-kube-api-access-kh9km\") pod \"b68d7058-4444-46d5-a509-e6f286666d14\" (UID: \"b68d7058-4444-46d5-a509-e6f286666d14\") "
Sep 07 21:17:22.665756 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:22.665734    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b68d7058-4444-46d5-a509-e6f286666d14-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b68d7058-4444-46d5-a509-e6f286666d14" (UID: "b68d7058-4444-46d5-a509-e6f286666d14"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:17:22.667512 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:22.667488    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b68d7058-4444-46d5-a509-e6f286666d14-kube-api-access-kh9km" (OuterVolumeSpecName: "kube-api-access-kh9km") pod "b68d7058-4444-46d5-a509-e6f286666d14" (UID: "b68d7058-4444-46d5-a509-e6f286666d14"). InnerVolumeSpecName "kube-api-access-kh9km". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:17:22.766470 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:22.766427    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b68d7058-4444-46d5-a509-e6f286666d14-plugins-config-volume\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:17:22.766470 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:22.766467    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh9km\" (UniqueName: \"kubernetes.io/projected/b68d7058-4444-46d5-a509-e6f286666d14-kube-api-access-kh9km\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:17:23.094155 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:23.094120    2558 generic.go:356] "Generic (PLEG): container finished" podID="b68d7058-4444-46d5-a509-e6f286666d14" containerID="cdc0c6948b922567b02a5dd9d1b2e3deccb7babe534accad65d93c3b7df651c5" exitCode=0
Sep 07 21:17:23.094393 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:23.094176    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m"
Sep 07 21:17:23.094393 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:23.094214    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m" event={"ID":"b68d7058-4444-46d5-a509-e6f286666d14","Type":"ContainerDied","Data":"cdc0c6948b922567b02a5dd9d1b2e3deccb7babe534accad65d93c3b7df651c5"}
Sep 07 21:17:23.094393 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:23.094273    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m" event={"ID":"b68d7058-4444-46d5-a509-e6f286666d14","Type":"ContainerDied","Data":"d48e75c566a7a537c373f3da014914695b50e910772a5f8ecc3c930f74554d3e"}
Sep 07 21:17:23.094393 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:23.094296    2558 scope.go:117] "RemoveContainer" containerID="cdc0c6948b922567b02a5dd9d1b2e3deccb7babe534accad65d93c3b7df651c5"
Sep 07 21:17:23.094917 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:23.094873    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:23.095724 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:23.095693    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:23.103917 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:23.103902    2558 scope.go:117] "RemoveContainer" containerID="cdc0c6948b922567b02a5dd9d1b2e3deccb7babe534accad65d93c3b7df651c5"
Sep 07 21:17:23.104170 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:17:23.104152    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdc0c6948b922567b02a5dd9d1b2e3deccb7babe534accad65d93c3b7df651c5\": container with ID starting with cdc0c6948b922567b02a5dd9d1b2e3deccb7babe534accad65d93c3b7df651c5 not found: ID does not exist" containerID="cdc0c6948b922567b02a5dd9d1b2e3deccb7babe534accad65d93c3b7df651c5"
Sep 07 21:17:23.104220 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:23.104179    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdc0c6948b922567b02a5dd9d1b2e3deccb7babe534accad65d93c3b7df651c5"} err="failed to get container status \"cdc0c6948b922567b02a5dd9d1b2e3deccb7babe534accad65d93c3b7df651c5\": rpc error: code = NotFound desc = could not find container \"cdc0c6948b922567b02a5dd9d1b2e3deccb7babe534accad65d93c3b7df651c5\": container with ID starting with cdc0c6948b922567b02a5dd9d1b2e3deccb7babe534accad65d93c3b7df651c5 not found: ID does not exist"
Sep 07 21:17:23.132461 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:23.132425    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m"]
Sep 07 21:17:23.136728 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:23.136699    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m"]
Sep 07 21:17:24.310638 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:24.310601    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b68d7058-4444-46d5-a509-e6f286666d14" path="/var/lib/kubelet/pods/b68d7058-4444-46d5-a509-e6f286666d14/volumes"
Sep 07 21:17:24.801710 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:24.801636    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"]
Sep 07 21:17:24.802272 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:24.802256    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b68d7058-4444-46d5-a509-e6f286666d14" containerName="payload-processing"
Sep 07 21:17:24.802351 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:24.802276    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b68d7058-4444-46d5-a509-e6f286666d14" containerName="payload-processing"
Sep 07 21:17:24.802426 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:24.802406    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b68d7058-4444-46d5-a509-e6f286666d14" containerName="payload-processing"
Sep 07 21:17:24.807352 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:24.807330    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"
Sep 07 21:17:24.809437 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:24.809411    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-38b04325-serving-cert\""
Sep 07 21:17:24.817403 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:24.817376    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"]
Sep 07 21:17:24.883601 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:24.883568    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddbba6ab-8896-4a09-8b22-e757a5905094-openshift-service-ca\") pod \"maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f\" (UID: \"ddbba6ab-8896-4a09-8b22-e757a5905094\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"
Sep 07 21:17:24.883791 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:24.883626    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddbba6ab-8896-4a09-8b22-e757a5905094-metrics-certs\") pod \"maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f\" (UID: \"ddbba6ab-8896-4a09-8b22-e757a5905094\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"
Sep 07 21:17:24.883791 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:24.883714    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddbba6ab-8896-4a09-8b22-e757a5905094-maas-api-tls\") pod \"maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f\" (UID: \"ddbba6ab-8896-4a09-8b22-e757a5905094\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"
Sep 07 21:17:24.883791 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:24.883771    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9knjd\" (UniqueName: \"kubernetes.io/projected/ddbba6ab-8896-4a09-8b22-e757a5905094-kube-api-access-9knjd\") pod \"maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f\" (UID: \"ddbba6ab-8896-4a09-8b22-e757a5905094\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"
Sep 07 21:17:24.985136 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:24.985095    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddbba6ab-8896-4a09-8b22-e757a5905094-metrics-certs\") pod \"maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f\" (UID: \"ddbba6ab-8896-4a09-8b22-e757a5905094\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"
Sep 07 21:17:24.985399 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:24.985148    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddbba6ab-8896-4a09-8b22-e757a5905094-maas-api-tls\") pod \"maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f\" (UID: \"ddbba6ab-8896-4a09-8b22-e757a5905094\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"
Sep 07 21:17:24.985399 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:24.985200    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9knjd\" (UniqueName: \"kubernetes.io/projected/ddbba6ab-8896-4a09-8b22-e757a5905094-kube-api-access-9knjd\") pod \"maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f\" (UID: \"ddbba6ab-8896-4a09-8b22-e757a5905094\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"
Sep 07 21:17:24.985399 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:24.985282    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddbba6ab-8896-4a09-8b22-e757a5905094-openshift-service-ca\") pod \"maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f\" (UID: \"ddbba6ab-8896-4a09-8b22-e757a5905094\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"
Sep 07 21:17:24.985399 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:17:24.985369    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-serving-cert: secret "maas-api-e2e-derive-38b04325-serving-cert" not found
Sep 07 21:17:24.985636 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:17:24.985446    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddbba6ab-8896-4a09-8b22-e757a5905094-maas-api-tls podName:ddbba6ab-8896-4a09-8b22-e757a5905094 nodeName:}" failed. No retries permitted until 2026-09-07 21:17:25.485425249 +0000 UTC m=+941.745242485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ddbba6ab-8896-4a09-8b22-e757a5905094-maas-api-tls") pod "maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f" (UID: "ddbba6ab-8896-4a09-8b22-e757a5905094") : secret "maas-api-e2e-derive-38b04325-serving-cert" not found
Sep 07 21:17:24.985974 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:24.985954    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddbba6ab-8896-4a09-8b22-e757a5905094-openshift-service-ca\") pod \"maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f\" (UID: \"ddbba6ab-8896-4a09-8b22-e757a5905094\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"
Sep 07 21:17:24.987726 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:24.987703    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddbba6ab-8896-4a09-8b22-e757a5905094-metrics-certs\") pod \"maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f\" (UID: \"ddbba6ab-8896-4a09-8b22-e757a5905094\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"
Sep 07 21:17:25.003921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:25.003887    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9knjd\" (UniqueName: \"kubernetes.io/projected/ddbba6ab-8896-4a09-8b22-e757a5905094-kube-api-access-9knjd\") pod \"maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f\" (UID: \"ddbba6ab-8896-4a09-8b22-e757a5905094\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"
Sep 07 21:17:25.490552 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:25.490510    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddbba6ab-8896-4a09-8b22-e757a5905094-maas-api-tls\") pod \"maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f\" (UID: \"ddbba6ab-8896-4a09-8b22-e757a5905094\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"
Sep 07 21:17:25.493526 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:25.493497    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddbba6ab-8896-4a09-8b22-e757a5905094-maas-api-tls\") pod \"maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f\" (UID: \"ddbba6ab-8896-4a09-8b22-e757a5905094\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"
Sep 07 21:17:25.545186 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:25.545144    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6"]
Sep 07 21:17:25.548934 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:25.548915    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6"
Sep 07 21:17:25.550992 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:25.550964    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-38b04325-dockercfg-bwnc6\""
Sep 07 21:17:25.551097 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:25.550967    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-38b04325\""
Sep 07 21:17:25.561792 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:25.561768    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6"]
Sep 07 21:17:25.598460 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:25.598423    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce927fb4-7712-4f22-a504-8025ce062e06-plugins-config-volume\") pod \"payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6\" (UID: \"ce927fb4-7712-4f22-a504-8025ce062e06\") " pod="openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6"
Sep 07 21:17:25.598633 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:25.598504    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd5bn\" (UniqueName: \"kubernetes.io/projected/ce927fb4-7712-4f22-a504-8025ce062e06-kube-api-access-bd5bn\") pod \"payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6\" (UID: \"ce927fb4-7712-4f22-a504-8025ce062e06\") " pod="openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6"
Sep 07 21:17:25.699160 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:25.699115    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd5bn\" (UniqueName: \"kubernetes.io/projected/ce927fb4-7712-4f22-a504-8025ce062e06-kube-api-access-bd5bn\") pod \"payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6\" (UID: \"ce927fb4-7712-4f22-a504-8025ce062e06\") " pod="openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6"
Sep 07 21:17:25.699379 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:25.699268    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce927fb4-7712-4f22-a504-8025ce062e06-plugins-config-volume\") pod \"payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6\" (UID: \"ce927fb4-7712-4f22-a504-8025ce062e06\") " pod="openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6"
Sep 07 21:17:25.700195 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:25.700168    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce927fb4-7712-4f22-a504-8025ce062e06-plugins-config-volume\") pod \"payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6\" (UID: \"ce927fb4-7712-4f22-a504-8025ce062e06\") " pod="openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6"
Sep 07 21:17:25.707666 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:25.707636    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd5bn\" (UniqueName: \"kubernetes.io/projected/ce927fb4-7712-4f22-a504-8025ce062e06-kube-api-access-bd5bn\") pod \"payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6\" (UID: \"ce927fb4-7712-4f22-a504-8025ce062e06\") " pod="openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6"
Sep 07 21:17:25.720452 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:25.720408    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"
Sep 07 21:17:25.863128 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:25.861610    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6"
Sep 07 21:17:26.009407 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:26.009382    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"]
Sep 07 21:17:26.011420 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:17:26.011397    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddbba6ab_8896_4a09_8b22_e757a5905094.slice/crio-7db57cdfa9c8b62c48557f373390a19a4e424cf4c04b0cf0e79715394c8d82bd WatchSource:0}: Error finding container 7db57cdfa9c8b62c48557f373390a19a4e424cf4c04b0cf0e79715394c8d82bd: Status 404 returned error can't find the container with id 7db57cdfa9c8b62c48557f373390a19a4e424cf4c04b0cf0e79715394c8d82bd
Sep 07 21:17:26.013432 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:26.013414    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 21:17:26.115005 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:26.114959    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f" event={"ID":"ddbba6ab-8896-4a09-8b22-e757a5905094","Type":"ContainerStarted","Data":"7db57cdfa9c8b62c48557f373390a19a4e424cf4c04b0cf0e79715394c8d82bd"}
Sep 07 21:17:26.143874 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:26.143847    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6"]
Sep 07 21:17:26.145867 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:17:26.145839    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce927fb4_7712_4f22_a504_8025ce062e06.slice/crio-81f41d2f2fbc433f926bd0be3626e33f60e23ce35f4d9dca0451b4e729441548 WatchSource:0}: Error finding container 81f41d2f2fbc433f926bd0be3626e33f60e23ce35f4d9dca0451b4e729441548: Status 404 returned error can't find the container with id 81f41d2f2fbc433f926bd0be3626e33f60e23ce35f4d9dca0451b4e729441548
Sep 07 21:17:27.123613 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:27.123574    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f" event={"ID":"ddbba6ab-8896-4a09-8b22-e757a5905094","Type":"ContainerStarted","Data":"949595550b165f41cd3289e47785a007e3cee69678d0369f9e224de8a1ed9ba9"}
Sep 07 21:17:27.124093 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:27.123641    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"
Sep 07 21:17:27.125341 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:27.125293    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6" event={"ID":"ce927fb4-7712-4f22-a504-8025ce062e06","Type":"ContainerStarted","Data":"d92dd1f82fbfdde6b17c1f580247c8f94f85c6e05449b7aa0a80ed80c538196c"}
Sep 07 21:17:27.125447 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:27.125365    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6" event={"ID":"ce927fb4-7712-4f22-a504-8025ce062e06","Type":"ContainerStarted","Data":"81f41d2f2fbc433f926bd0be3626e33f60e23ce35f4d9dca0451b4e729441548"}
Sep 07 21:17:27.125447 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:27.125397    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6"
Sep 07 21:17:27.140494 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:27.140448    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f" podStartSLOduration=2.554087686 podStartE2EDuration="3.140433499s" totalImagesPullingTime="586.345813ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:17:27.138118906 +0000 UTC m=+943.397936170" watchObservedRunningTime="2026-09-07 21:17:27.140433499 +0000 UTC m=+943.400250741"
Sep 07 21:17:27.154809 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:27.154759    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6" podStartSLOduration=2.154741704 podStartE2EDuration="2.154741704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:17:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:17:27.15333567 +0000 UTC m=+943.413152938" watchObservedRunningTime="2026-09-07 21:17:27.154741704 +0000 UTC m=+943.414558948"
Sep 07 21:17:33.136631 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:33.136598    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"
Sep 07 21:17:38.134534 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:38.134498    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6"
Sep 07 21:17:44.236390 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:44.236356    2558 generic.go:356] "Generic (PLEG): container finished" podID="b1cff8f6-34c9-47f7-af15-4eaa8ec12795" containerID="72fc2961411f72bffcfb5b1caf061bab694babc91d4790e45b6b79461dabcc8f" exitCode=0
Sep 07 21:17:44.236810 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:44.236434    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5" event={"ID":"b1cff8f6-34c9-47f7-af15-4eaa8ec12795","Type":"ContainerDied","Data":"72fc2961411f72bffcfb5b1caf061bab694babc91d4790e45b6b79461dabcc8f"}
Sep 07 21:17:44.236871 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:44.236856    2558 scope.go:117] "RemoveContainer" containerID="72fc2961411f72bffcfb5b1caf061bab694babc91d4790e45b6b79461dabcc8f"
Sep 07 21:17:44.237951 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:44.237923    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:17:44.238005 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:44.237990    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:17:44.238039 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:44.238026    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:17:45.252519 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:45.252480    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5" event={"ID":"b1cff8f6-34c9-47f7-af15-4eaa8ec12795","Type":"ContainerStarted","Data":"0872cf1abae363006e05c7b7d635a6245a79e1ede60bb109b5b6efd30b41ae89"}
Sep 07 21:17:45.553667 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:45.553622    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:45.554098 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:45.554065    2558 patch_prober.go:28] interesting pod/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 07 21:17:45.554198 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:45.554128    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5" podUID="b1cff8f6-34c9-47f7-af15-4eaa8ec12795" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 07 21:17:46.554163 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:46.553685    2558 patch_prober.go:28] interesting pod/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 07 21:17:46.554163 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:46.553756    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5" podUID="b1cff8f6-34c9-47f7-af15-4eaa8ec12795" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 07 21:17:47.553563 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:47.553520    2558 patch_prober.go:28] interesting pod/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 07 21:17:47.553861 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:47.553833    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5" podUID="b1cff8f6-34c9-47f7-af15-4eaa8ec12795" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 07 21:17:48.554675 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:48.554181    2558 patch_prober.go:28] interesting pod/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 07 21:17:48.554675 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:48.554267    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5" podUID="b1cff8f6-34c9-47f7-af15-4eaa8ec12795" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 07 21:17:49.554022 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:49.553979    2558 patch_prober.go:28] interesting pod/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 07 21:17:49.554340 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:49.554292    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5" podUID="b1cff8f6-34c9-47f7-af15-4eaa8ec12795" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 07 21:17:50.705976 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:50.705940    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:50.706487 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:50.706435    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:50.707507 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:50.707479    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:17:55.295588 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.295549    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"]
Sep 07 21:17:55.296056 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.295815    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f" podUID="ddbba6ab-8896-4a09-8b22-e757a5905094" containerName="maas-api" containerID="cri-o://949595550b165f41cd3289e47785a007e3cee69678d0369f9e224de8a1ed9ba9" gracePeriod=30
Sep 07 21:17:55.346585 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.346553    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6"]
Sep 07 21:17:55.346832 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.346805    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6" podUID="ce927fb4-7712-4f22-a504-8025ce062e06" containerName="payload-processing" containerID="cri-o://d92dd1f82fbfdde6b17c1f580247c8f94f85c6e05449b7aa0a80ed80c538196c" gracePeriod=30
Sep 07 21:17:55.604079 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.604008    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"
Sep 07 21:17:55.638342 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.638119    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"]
Sep 07 21:17:55.638515 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.638369    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5" podUID="b1cff8f6-34c9-47f7-af15-4eaa8ec12795" containerName="istio-proxy" containerID="cri-o://0872cf1abae363006e05c7b7d635a6245a79e1ede60bb109b5b6efd30b41ae89" gracePeriod=30
Sep 07 21:17:55.664435 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.664412    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6"
Sep 07 21:17:55.732640 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.732608    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9knjd\" (UniqueName: \"kubernetes.io/projected/ddbba6ab-8896-4a09-8b22-e757a5905094-kube-api-access-9knjd\") pod \"ddbba6ab-8896-4a09-8b22-e757a5905094\" (UID: \"ddbba6ab-8896-4a09-8b22-e757a5905094\") "
Sep 07 21:17:55.732785 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.732655    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddbba6ab-8896-4a09-8b22-e757a5905094-openshift-service-ca\") pod \"ddbba6ab-8896-4a09-8b22-e757a5905094\" (UID: \"ddbba6ab-8896-4a09-8b22-e757a5905094\") "
Sep 07 21:17:55.732785 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.732684    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddbba6ab-8896-4a09-8b22-e757a5905094-metrics-certs\") pod \"ddbba6ab-8896-4a09-8b22-e757a5905094\" (UID: \"ddbba6ab-8896-4a09-8b22-e757a5905094\") "
Sep 07 21:17:55.732785 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.732735    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddbba6ab-8896-4a09-8b22-e757a5905094-maas-api-tls\") pod \"ddbba6ab-8896-4a09-8b22-e757a5905094\" (UID: \"ddbba6ab-8896-4a09-8b22-e757a5905094\") "
Sep 07 21:17:55.733226 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.733185    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddbba6ab-8896-4a09-8b22-e757a5905094-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ddbba6ab-8896-4a09-8b22-e757a5905094" (UID: "ddbba6ab-8896-4a09-8b22-e757a5905094"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:17:55.735344 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.735289    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddbba6ab-8896-4a09-8b22-e757a5905094-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ddbba6ab-8896-4a09-8b22-e757a5905094" (UID: "ddbba6ab-8896-4a09-8b22-e757a5905094"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:17:55.735457 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.735363    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddbba6ab-8896-4a09-8b22-e757a5905094-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ddbba6ab-8896-4a09-8b22-e757a5905094" (UID: "ddbba6ab-8896-4a09-8b22-e757a5905094"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:17:55.735938 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.735915    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddbba6ab-8896-4a09-8b22-e757a5905094-kube-api-access-9knjd" (OuterVolumeSpecName: "kube-api-access-9knjd") pod "ddbba6ab-8896-4a09-8b22-e757a5905094" (UID: "ddbba6ab-8896-4a09-8b22-e757a5905094"). InnerVolumeSpecName "kube-api-access-9knjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:17:55.834345 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.834196    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bd5bn\" (UniqueName: \"kubernetes.io/projected/ce927fb4-7712-4f22-a504-8025ce062e06-kube-api-access-bd5bn\") pod \"ce927fb4-7712-4f22-a504-8025ce062e06\" (UID: \"ce927fb4-7712-4f22-a504-8025ce062e06\") "
Sep 07 21:17:55.834345 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.834265    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce927fb4-7712-4f22-a504-8025ce062e06-plugins-config-volume\") pod \"ce927fb4-7712-4f22-a504-8025ce062e06\" (UID: \"ce927fb4-7712-4f22-a504-8025ce062e06\") "
Sep 07 21:17:55.834603 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.834539    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddbba6ab-8896-4a09-8b22-e757a5905094-maas-api-tls\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:17:55.834603 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.834551    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9knjd\" (UniqueName: \"kubernetes.io/projected/ddbba6ab-8896-4a09-8b22-e757a5905094-kube-api-access-9knjd\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:17:55.834603 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.834562    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddbba6ab-8896-4a09-8b22-e757a5905094-openshift-service-ca\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:17:55.834603 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.834570    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddbba6ab-8896-4a09-8b22-e757a5905094-metrics-certs\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:17:55.834772 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.834646    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce927fb4-7712-4f22-a504-8025ce062e06-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ce927fb4-7712-4f22-a504-8025ce062e06" (UID: "ce927fb4-7712-4f22-a504-8025ce062e06"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:17:55.836354 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.836330    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce927fb4-7712-4f22-a504-8025ce062e06-kube-api-access-bd5bn" (OuterVolumeSpecName: "kube-api-access-bd5bn") pod "ce927fb4-7712-4f22-a504-8025ce062e06" (UID: "ce927fb4-7712-4f22-a504-8025ce062e06"). InnerVolumeSpecName "kube-api-access-bd5bn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:17:55.935571 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.935541    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bd5bn\" (UniqueName: \"kubernetes.io/projected/ce927fb4-7712-4f22-a504-8025ce062e06-kube-api-access-bd5bn\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:17:55.935571 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:55.935567    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce927fb4-7712-4f22-a504-8025ce062e06-plugins-config-volume\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:17:56.327646 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:56.327611    2558 generic.go:356] "Generic (PLEG): container finished" podID="ddbba6ab-8896-4a09-8b22-e757a5905094" containerID="949595550b165f41cd3289e47785a007e3cee69678d0369f9e224de8a1ed9ba9" exitCode=0
Sep 07 21:17:56.328000 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:56.327653    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"
Sep 07 21:17:56.328000 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:56.327695    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f" event={"ID":"ddbba6ab-8896-4a09-8b22-e757a5905094","Type":"ContainerDied","Data":"949595550b165f41cd3289e47785a007e3cee69678d0369f9e224de8a1ed9ba9"}
Sep 07 21:17:56.328000 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:56.327759    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f" event={"ID":"ddbba6ab-8896-4a09-8b22-e757a5905094","Type":"ContainerDied","Data":"7db57cdfa9c8b62c48557f373390a19a4e424cf4c04b0cf0e79715394c8d82bd"}
Sep 07 21:17:56.328000 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:56.327793    2558 scope.go:117] "RemoveContainer" containerID="949595550b165f41cd3289e47785a007e3cee69678d0369f9e224de8a1ed9ba9"
Sep 07 21:17:56.329363 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:56.329338    2558 generic.go:356] "Generic (PLEG): container finished" podID="ce927fb4-7712-4f22-a504-8025ce062e06" containerID="d92dd1f82fbfdde6b17c1f580247c8f94f85c6e05449b7aa0a80ed80c538196c" exitCode=0
Sep 07 21:17:56.329449 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:56.329401    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6"
Sep 07 21:17:56.329512 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:56.329404    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6" event={"ID":"ce927fb4-7712-4f22-a504-8025ce062e06","Type":"ContainerDied","Data":"d92dd1f82fbfdde6b17c1f580247c8f94f85c6e05449b7aa0a80ed80c538196c"}
Sep 07 21:17:56.329564 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:56.329519    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6" event={"ID":"ce927fb4-7712-4f22-a504-8025ce062e06","Type":"ContainerDied","Data":"81f41d2f2fbc433f926bd0be3626e33f60e23ce35f4d9dca0451b4e729441548"}
Sep 07 21:17:56.341890 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:56.341858    2558 scope.go:117] "RemoveContainer" containerID="949595550b165f41cd3289e47785a007e3cee69678d0369f9e224de8a1ed9ba9"
Sep 07 21:17:56.342254 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:17:56.342233    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"949595550b165f41cd3289e47785a007e3cee69678d0369f9e224de8a1ed9ba9\": container with ID starting with 949595550b165f41cd3289e47785a007e3cee69678d0369f9e224de8a1ed9ba9 not found: ID does not exist" containerID="949595550b165f41cd3289e47785a007e3cee69678d0369f9e224de8a1ed9ba9"
Sep 07 21:17:56.342339 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:56.342262    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"949595550b165f41cd3289e47785a007e3cee69678d0369f9e224de8a1ed9ba9"} err="failed to get container status \"949595550b165f41cd3289e47785a007e3cee69678d0369f9e224de8a1ed9ba9\": rpc error: code = NotFound desc = could not find container \"949595550b165f41cd3289e47785a007e3cee69678d0369f9e224de8a1ed9ba9\": container with ID starting with 949595550b165f41cd3289e47785a007e3cee69678d0369f9e224de8a1ed9ba9 not found: ID does not exist"
Sep 07 21:17:56.342339 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:56.342281    2558 scope.go:117] "RemoveContainer" containerID="d92dd1f82fbfdde6b17c1f580247c8f94f85c6e05449b7aa0a80ed80c538196c"
Sep 07 21:17:56.349653 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:56.349623    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6"]
Sep 07 21:17:56.351548 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:56.351525    2558 scope.go:117] "RemoveContainer" containerID="d92dd1f82fbfdde6b17c1f580247c8f94f85c6e05449b7aa0a80ed80c538196c"
Sep 07 21:17:56.351855 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:17:56.351837    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d92dd1f82fbfdde6b17c1f580247c8f94f85c6e05449b7aa0a80ed80c538196c\": container with ID starting with d92dd1f82fbfdde6b17c1f580247c8f94f85c6e05449b7aa0a80ed80c538196c not found: ID does not exist" containerID="d92dd1f82fbfdde6b17c1f580247c8f94f85c6e05449b7aa0a80ed80c538196c"
Sep 07 21:17:56.351925 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:56.351861    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d92dd1f82fbfdde6b17c1f580247c8f94f85c6e05449b7aa0a80ed80c538196c"} err="failed to get container status \"d92dd1f82fbfdde6b17c1f580247c8f94f85c6e05449b7aa0a80ed80c538196c\": rpc error: code = NotFound desc = could not find container \"d92dd1f82fbfdde6b17c1f580247c8f94f85c6e05449b7aa0a80ed80c538196c\": container with ID starting with d92dd1f82fbfdde6b17c1f580247c8f94f85c6e05449b7aa0a80ed80c538196c not found: ID does not exist"
Sep 07 21:17:56.356045 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:56.356025    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6"]
Sep 07 21:17:56.366102 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:56.366080    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"]
Sep 07 21:17:56.370796 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:56.370775    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-38b04325-8564c5fcc4-8mz4f"]
Sep 07 21:17:58.308819 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:58.308785    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce927fb4-7712-4f22-a504-8025ce062e06" path="/var/lib/kubelet/pods/ce927fb4-7712-4f22-a504-8025ce062e06/volumes"
Sep 07 21:17:58.309218 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:17:58.309204    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddbba6ab-8896-4a09-8b22-e757a5905094" path="/var/lib/kubelet/pods/ddbba6ab-8896-4a09-8b22-e757a5905094/volumes"
Sep 07 21:18:00.897772 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:00.897750    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:18:00.982592 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:00.982488    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-token\") pod \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") "
Sep 07 21:18:00.982592 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:00.982580    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istiod-ca-cert\") pod \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") "
Sep 07 21:18:00.982838 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:00.982611    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-envoy\") pod \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") "
Sep 07 21:18:00.982838 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:00.982651    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-podinfo\") pod \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") "
Sep 07 21:18:00.982838 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:00.982676    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmsw2\" (UniqueName: \"kubernetes.io/projected/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-kube-api-access-cmsw2\") pod \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") "
Sep 07 21:18:00.982838 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:00.982706    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-data\") pod \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") "
Sep 07 21:18:00.982838 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:00.982747    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-credential-socket\") pod \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") "
Sep 07 21:18:00.982838 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:00.982804    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-workload-socket\") pod \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") "
Sep 07 21:18:00.983159 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:00.982839    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-workload-certs\") pod \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\" (UID: \"b1cff8f6-34c9-47f7-af15-4eaa8ec12795\") "
Sep 07 21:18:00.983159 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:00.983041    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b1cff8f6-34c9-47f7-af15-4eaa8ec12795" (UID: "b1cff8f6-34c9-47f7-af15-4eaa8ec12795"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:18:00.983259 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:00.983195    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b1cff8f6-34c9-47f7-af15-4eaa8ec12795" (UID: "b1cff8f6-34c9-47f7-af15-4eaa8ec12795"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:18:00.983259 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:00.983217    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istiod-ca-cert\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:18:00.983509 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:00.983477    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-data" (OuterVolumeSpecName: "istio-data") pod "b1cff8f6-34c9-47f7-af15-4eaa8ec12795" (UID: "b1cff8f6-34c9-47f7-af15-4eaa8ec12795"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:18:00.983509 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:00.983488    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b1cff8f6-34c9-47f7-af15-4eaa8ec12795" (UID: "b1cff8f6-34c9-47f7-af15-4eaa8ec12795"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:18:00.983663 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:00.983539    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b1cff8f6-34c9-47f7-af15-4eaa8ec12795" (UID: "b1cff8f6-34c9-47f7-af15-4eaa8ec12795"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:18:00.984974 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:00.984947    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b1cff8f6-34c9-47f7-af15-4eaa8ec12795" (UID: "b1cff8f6-34c9-47f7-af15-4eaa8ec12795"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:18:00.985073 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:00.985018    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-kube-api-access-cmsw2" (OuterVolumeSpecName: "kube-api-access-cmsw2") pod "b1cff8f6-34c9-47f7-af15-4eaa8ec12795" (UID: "b1cff8f6-34c9-47f7-af15-4eaa8ec12795"). InnerVolumeSpecName "kube-api-access-cmsw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:18:00.985250 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:00.985233    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-token" (OuterVolumeSpecName: "istio-token") pod "b1cff8f6-34c9-47f7-af15-4eaa8ec12795" (UID: "b1cff8f6-34c9-47f7-af15-4eaa8ec12795"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:18:00.985348 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:00.985236    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b1cff8f6-34c9-47f7-af15-4eaa8ec12795" (UID: "b1cff8f6-34c9-47f7-af15-4eaa8ec12795"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 21:18:01.084113 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:01.084081    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-workload-socket\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:18:01.084113 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:01.084110    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-workload-certs\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:18:01.084113 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:01.084121    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-token\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:18:01.084389 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:01.084128    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-envoy\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:18:01.084389 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:01.084136    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-podinfo\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:18:01.084389 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:01.084145    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmsw2\" (UniqueName: \"kubernetes.io/projected/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-kube-api-access-cmsw2\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:18:01.084389 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:01.084153    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-istio-data\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:18:01.084389 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:01.084161    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1cff8f6-34c9-47f7-af15-4eaa8ec12795-credential-socket\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:18:01.363042 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:01.363007    2558 generic.go:356] "Generic (PLEG): container finished" podID="b1cff8f6-34c9-47f7-af15-4eaa8ec12795" containerID="0872cf1abae363006e05c7b7d635a6245a79e1ede60bb109b5b6efd30b41ae89" exitCode=0
Sep 07 21:18:01.363198 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:01.363055    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"
Sep 07 21:18:01.363198 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:01.363057    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5" event={"ID":"b1cff8f6-34c9-47f7-af15-4eaa8ec12795","Type":"ContainerDied","Data":"0872cf1abae363006e05c7b7d635a6245a79e1ede60bb109b5b6efd30b41ae89"}
Sep 07 21:18:01.363198 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:01.363188    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5" event={"ID":"b1cff8f6-34c9-47f7-af15-4eaa8ec12795","Type":"ContainerDied","Data":"e68dd5bd2d5b0371bd43f603925c880d94d7b914e75a54887d2fb8ce4542e3da"}
Sep 07 21:18:01.363390 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:01.363220    2558 scope.go:117] "RemoveContainer" containerID="0872cf1abae363006e05c7b7d635a6245a79e1ede60bb109b5b6efd30b41ae89"
Sep 07 21:18:01.372970 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:01.372953    2558 scope.go:117] "RemoveContainer" containerID="72fc2961411f72bffcfb5b1caf061bab694babc91d4790e45b6b79461dabcc8f"
Sep 07 21:18:01.382150 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:01.382112    2558 scope.go:117] "RemoveContainer" containerID="0872cf1abae363006e05c7b7d635a6245a79e1ede60bb109b5b6efd30b41ae89"
Sep 07 21:18:01.382547 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:18:01.382522    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0872cf1abae363006e05c7b7d635a6245a79e1ede60bb109b5b6efd30b41ae89\": container with ID starting with 0872cf1abae363006e05c7b7d635a6245a79e1ede60bb109b5b6efd30b41ae89 not found: ID does not exist" containerID="0872cf1abae363006e05c7b7d635a6245a79e1ede60bb109b5b6efd30b41ae89"
Sep 07 21:18:01.382640 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:01.382560    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0872cf1abae363006e05c7b7d635a6245a79e1ede60bb109b5b6efd30b41ae89"} err="failed to get container status \"0872cf1abae363006e05c7b7d635a6245a79e1ede60bb109b5b6efd30b41ae89\": rpc error: code = NotFound desc = could not find container \"0872cf1abae363006e05c7b7d635a6245a79e1ede60bb109b5b6efd30b41ae89\": container with ID starting with 0872cf1abae363006e05c7b7d635a6245a79e1ede60bb109b5b6efd30b41ae89 not found: ID does not exist"
Sep 07 21:18:01.382640 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:01.382585    2558 scope.go:117] "RemoveContainer" containerID="72fc2961411f72bffcfb5b1caf061bab694babc91d4790e45b6b79461dabcc8f"
Sep 07 21:18:01.382879 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:18:01.382861    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72fc2961411f72bffcfb5b1caf061bab694babc91d4790e45b6b79461dabcc8f\": container with ID starting with 72fc2961411f72bffcfb5b1caf061bab694babc91d4790e45b6b79461dabcc8f not found: ID does not exist" containerID="72fc2961411f72bffcfb5b1caf061bab694babc91d4790e45b6b79461dabcc8f"
Sep 07 21:18:01.382919 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:01.382885    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72fc2961411f72bffcfb5b1caf061bab694babc91d4790e45b6b79461dabcc8f"} err="failed to get container status \"72fc2961411f72bffcfb5b1caf061bab694babc91d4790e45b6b79461dabcc8f\": rpc error: code = NotFound desc = could not find container \"72fc2961411f72bffcfb5b1caf061bab694babc91d4790e45b6b79461dabcc8f\": container with ID starting with 72fc2961411f72bffcfb5b1caf061bab694babc91d4790e45b6b79461dabcc8f not found: ID does not exist"
Sep 07 21:18:01.384700 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:01.384678    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"]
Sep 07 21:18:01.388008 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:01.387986    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5"]
Sep 07 21:18:02.314747 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:18:02.314712    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1cff8f6-34c9-47f7-af15-4eaa8ec12795" path="/var/lib/kubelet/pods/b1cff8f6-34c9-47f7-af15-4eaa8ec12795/volumes"
Sep 07 21:19:34.459662 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.459630    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"]
Sep 07 21:19:34.460062 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.460023    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1cff8f6-34c9-47f7-af15-4eaa8ec12795" containerName="istio-proxy"
Sep 07 21:19:34.460062 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.460034    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1cff8f6-34c9-47f7-af15-4eaa8ec12795" containerName="istio-proxy"
Sep 07 21:19:34.460062 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.460042    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1cff8f6-34c9-47f7-af15-4eaa8ec12795" containerName="istio-proxy"
Sep 07 21:19:34.460062 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.460047    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1cff8f6-34c9-47f7-af15-4eaa8ec12795" containerName="istio-proxy"
Sep 07 21:19:34.460062 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.460055    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddbba6ab-8896-4a09-8b22-e757a5905094" containerName="maas-api"
Sep 07 21:19:34.460062 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.460061    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddbba6ab-8896-4a09-8b22-e757a5905094" containerName="maas-api"
Sep 07 21:19:34.460250 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.460089    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce927fb4-7712-4f22-a504-8025ce062e06" containerName="payload-processing"
Sep 07 21:19:34.460250 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.460095    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce927fb4-7712-4f22-a504-8025ce062e06" containerName="payload-processing"
Sep 07 21:19:34.460250 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.460155    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1cff8f6-34c9-47f7-af15-4eaa8ec12795" containerName="istio-proxy"
Sep 07 21:19:34.460250 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.460162    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1cff8f6-34c9-47f7-af15-4eaa8ec12795" containerName="istio-proxy"
Sep 07 21:19:34.460250 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.460170    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce927fb4-7712-4f22-a504-8025ce062e06" containerName="payload-processing"
Sep 07 21:19:34.460250 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.460175    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddbba6ab-8896-4a09-8b22-e757a5905094" containerName="maas-api"
Sep 07 21:19:34.463171 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.463155    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"
Sep 07 21:19:34.466041 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.466018    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-f838f49c-serving-cert\""
Sep 07 21:19:34.488198 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.488169    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"]
Sep 07 21:19:34.566908 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.566876    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-maas-api-tls\") pod \"maas-api-e2e-mt-f838f49c-74c6f46d74-6887g\" (UID: \"23cfd3ce-e4fc-42e9-99e2-253f13f7627a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"
Sep 07 21:19:34.566908 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.566918    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-metrics-certs\") pod \"maas-api-e2e-mt-f838f49c-74c6f46d74-6887g\" (UID: \"23cfd3ce-e4fc-42e9-99e2-253f13f7627a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"
Sep 07 21:19:34.567152 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.567069    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9w9q\" (UniqueName: \"kubernetes.io/projected/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-kube-api-access-t9w9q\") pod \"maas-api-e2e-mt-f838f49c-74c6f46d74-6887g\" (UID: \"23cfd3ce-e4fc-42e9-99e2-253f13f7627a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"
Sep 07 21:19:34.567152 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.567139    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-openshift-service-ca\") pod \"maas-api-e2e-mt-f838f49c-74c6f46d74-6887g\" (UID: \"23cfd3ce-e4fc-42e9-99e2-253f13f7627a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"
Sep 07 21:19:34.667921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.667883    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-maas-api-tls\") pod \"maas-api-e2e-mt-f838f49c-74c6f46d74-6887g\" (UID: \"23cfd3ce-e4fc-42e9-99e2-253f13f7627a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"
Sep 07 21:19:34.667921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.667924    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-metrics-certs\") pod \"maas-api-e2e-mt-f838f49c-74c6f46d74-6887g\" (UID: \"23cfd3ce-e4fc-42e9-99e2-253f13f7627a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"
Sep 07 21:19:34.668182 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.667990    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9w9q\" (UniqueName: \"kubernetes.io/projected/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-kube-api-access-t9w9q\") pod \"maas-api-e2e-mt-f838f49c-74c6f46d74-6887g\" (UID: \"23cfd3ce-e4fc-42e9-99e2-253f13f7627a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"
Sep 07 21:19:34.668182 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.668044    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-openshift-service-ca\") pod \"maas-api-e2e-mt-f838f49c-74c6f46d74-6887g\" (UID: \"23cfd3ce-e4fc-42e9-99e2-253f13f7627a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"
Sep 07 21:19:34.668767 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.668742    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-openshift-service-ca\") pod \"maas-api-e2e-mt-f838f49c-74c6f46d74-6887g\" (UID: \"23cfd3ce-e4fc-42e9-99e2-253f13f7627a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"
Sep 07 21:19:34.671075 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.671049    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-maas-api-tls\") pod \"maas-api-e2e-mt-f838f49c-74c6f46d74-6887g\" (UID: \"23cfd3ce-e4fc-42e9-99e2-253f13f7627a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"
Sep 07 21:19:34.671178 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.671131    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-metrics-certs\") pod \"maas-api-e2e-mt-f838f49c-74c6f46d74-6887g\" (UID: \"23cfd3ce-e4fc-42e9-99e2-253f13f7627a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"
Sep 07 21:19:34.676062 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.676037    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9w9q\" (UniqueName: \"kubernetes.io/projected/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-kube-api-access-t9w9q\") pod \"maas-api-e2e-mt-f838f49c-74c6f46d74-6887g\" (UID: \"23cfd3ce-e4fc-42e9-99e2-253f13f7627a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"
Sep 07 21:19:34.774044 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:34.773959    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"
Sep 07 21:19:35.053137 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:35.053096    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"]
Sep 07 21:19:35.054631 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:19:35.054600    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23cfd3ce_e4fc_42e9_99e2_253f13f7627a.slice/crio-b9bba748d49af7f9d6804f9ead5d0beaa273a1684d133a7f92dd5f888385fdd9 WatchSource:0}: Error finding container b9bba748d49af7f9d6804f9ead5d0beaa273a1684d133a7f92dd5f888385fdd9: Status 404 returned error can't find the container with id b9bba748d49af7f9d6804f9ead5d0beaa273a1684d133a7f92dd5f888385fdd9
Sep 07 21:19:35.111269 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:35.111238    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm"]
Sep 07 21:19:35.115835 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:35.115813    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm"
Sep 07 21:19:35.117887 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:35.117867    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-f838f49c\""
Sep 07 21:19:35.117986 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:35.117926    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-f838f49c-dockercfg-jr9r6\""
Sep 07 21:19:35.124589 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:35.124567    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm"]
Sep 07 21:19:35.173432 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:35.173389    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/942a92f6-035a-46a0-a33f-d51e97365bfa-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm\" (UID: \"942a92f6-035a-46a0-a33f-d51e97365bfa\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm"
Sep 07 21:19:35.173627 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:35.173592    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zxq4\" (UniqueName: \"kubernetes.io/projected/942a92f6-035a-46a0-a33f-d51e97365bfa-kube-api-access-8zxq4\") pod \"payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm\" (UID: \"942a92f6-035a-46a0-a33f-d51e97365bfa\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm"
Sep 07 21:19:35.274285 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:35.274241    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zxq4\" (UniqueName: \"kubernetes.io/projected/942a92f6-035a-46a0-a33f-d51e97365bfa-kube-api-access-8zxq4\") pod \"payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm\" (UID: \"942a92f6-035a-46a0-a33f-d51e97365bfa\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm"
Sep 07 21:19:35.274476 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:35.274297    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/942a92f6-035a-46a0-a33f-d51e97365bfa-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm\" (UID: \"942a92f6-035a-46a0-a33f-d51e97365bfa\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm"
Sep 07 21:19:35.275293 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:35.275266    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/942a92f6-035a-46a0-a33f-d51e97365bfa-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm\" (UID: \"942a92f6-035a-46a0-a33f-d51e97365bfa\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm"
Sep 07 21:19:35.281656 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:35.281634    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zxq4\" (UniqueName: \"kubernetes.io/projected/942a92f6-035a-46a0-a33f-d51e97365bfa-kube-api-access-8zxq4\") pod \"payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm\" (UID: \"942a92f6-035a-46a0-a33f-d51e97365bfa\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm"
Sep 07 21:19:35.428262 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:35.428234    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm"
Sep 07 21:19:35.701104 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:35.701073    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm"]
Sep 07 21:19:35.703803 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:19:35.703773    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod942a92f6_035a_46a0_a33f_d51e97365bfa.slice/crio-36caffb560aa42b206ba32d71ce19eb15b642901ac62b8c1006e7b854b409293 WatchSource:0}: Error finding container 36caffb560aa42b206ba32d71ce19eb15b642901ac62b8c1006e7b854b409293: Status 404 returned error can't find the container with id 36caffb560aa42b206ba32d71ce19eb15b642901ac62b8c1006e7b854b409293
Sep 07 21:19:35.921792 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:35.921744    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm" event={"ID":"942a92f6-035a-46a0-a33f-d51e97365bfa","Type":"ContainerStarted","Data":"3c1c21b8f045dfd434ba1d766cec3e11251b5ba0b6253b2668e048eb7de716b6"}
Sep 07 21:19:35.921995 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:35.921811    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm" event={"ID":"942a92f6-035a-46a0-a33f-d51e97365bfa","Type":"ContainerStarted","Data":"36caffb560aa42b206ba32d71ce19eb15b642901ac62b8c1006e7b854b409293"}
Sep 07 21:19:35.921995 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:35.921894    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm"
Sep 07 21:19:35.923471 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:35.923441    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g" event={"ID":"23cfd3ce-e4fc-42e9-99e2-253f13f7627a","Type":"ContainerStarted","Data":"a58699e2ac58850dd97ca57c171ec4be4f09f595149017fdd652647dddd0e338"}
Sep 07 21:19:35.923620 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:35.923488    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g" event={"ID":"23cfd3ce-e4fc-42e9-99e2-253f13f7627a","Type":"ContainerStarted","Data":"b9bba748d49af7f9d6804f9ead5d0beaa273a1684d133a7f92dd5f888385fdd9"}
Sep 07 21:19:35.923620 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:35.923537    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"
Sep 07 21:19:35.938611 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:35.938561    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm" podStartSLOduration=0.93854568 podStartE2EDuration="938.54568ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:19:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:19:35.935892883 +0000 UTC m=+1072.195710151" watchObservedRunningTime="2026-09-07 21:19:35.93854568 +0000 UTC m=+1072.198362923"
Sep 07 21:19:35.954366 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:35.954266    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g" podStartSLOduration=1.533548126 podStartE2EDuration="1.95425002s" totalImagesPullingTime="420.701894ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:19:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:19:35.9514447 +0000 UTC m=+1072.211261969" watchObservedRunningTime="2026-09-07 21:19:35.95425002 +0000 UTC m=+1072.214067262"
Sep 07 21:19:41.935099 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:41.935019    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"
Sep 07 21:19:46.932170 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:19:46.932131    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm"
Sep 07 21:20:02.703603 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:02.703568    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd"]
Sep 07 21:20:02.704201 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:02.703818    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd" podUID="c8694d90-0977-46b2-a7c9-4d7aee779029" containerName="payload-processing" containerID="cri-o://76cd0a0649312c99d27f87f57bd00b69e5dca6c6400ce0d923334f5000d11bb8" gracePeriod=30
Sep 07 21:20:02.960969 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:02.960900    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd"
Sep 07 21:20:03.043675 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:03.043642    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2vtg\" (UniqueName: \"kubernetes.io/projected/c8694d90-0977-46b2-a7c9-4d7aee779029-kube-api-access-j2vtg\") pod \"c8694d90-0977-46b2-a7c9-4d7aee779029\" (UID: \"c8694d90-0977-46b2-a7c9-4d7aee779029\") "
Sep 07 21:20:03.043854 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:03.043710    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8694d90-0977-46b2-a7c9-4d7aee779029-plugins-config-volume\") pod \"c8694d90-0977-46b2-a7c9-4d7aee779029\" (UID: \"c8694d90-0977-46b2-a7c9-4d7aee779029\") "
Sep 07 21:20:03.044179 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:03.044150    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8694d90-0977-46b2-a7c9-4d7aee779029-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c8694d90-0977-46b2-a7c9-4d7aee779029" (UID: "c8694d90-0977-46b2-a7c9-4d7aee779029"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:20:03.045740 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:03.045713    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8694d90-0977-46b2-a7c9-4d7aee779029-kube-api-access-j2vtg" (OuterVolumeSpecName: "kube-api-access-j2vtg") pod "c8694d90-0977-46b2-a7c9-4d7aee779029" (UID: "c8694d90-0977-46b2-a7c9-4d7aee779029"). InnerVolumeSpecName "kube-api-access-j2vtg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:20:03.083068 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:03.083035    2558 generic.go:356] "Generic (PLEG): container finished" podID="c8694d90-0977-46b2-a7c9-4d7aee779029" containerID="76cd0a0649312c99d27f87f57bd00b69e5dca6c6400ce0d923334f5000d11bb8" exitCode=0
Sep 07 21:20:03.083256 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:03.083077    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd"
Sep 07 21:20:03.083256 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:03.083113    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd" event={"ID":"c8694d90-0977-46b2-a7c9-4d7aee779029","Type":"ContainerDied","Data":"76cd0a0649312c99d27f87f57bd00b69e5dca6c6400ce0d923334f5000d11bb8"}
Sep 07 21:20:03.083256 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:03.083168    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd" event={"ID":"c8694d90-0977-46b2-a7c9-4d7aee779029","Type":"ContainerDied","Data":"3a484e50d35da731cd9349965a220822ca7b1fa0837f35648d2f0e8b5a5a60bd"}
Sep 07 21:20:03.083256 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:03.083190    2558 scope.go:117] "RemoveContainer" containerID="76cd0a0649312c99d27f87f57bd00b69e5dca6c6400ce0d923334f5000d11bb8"
Sep 07 21:20:03.093442 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:03.093423    2558 scope.go:117] "RemoveContainer" containerID="76cd0a0649312c99d27f87f57bd00b69e5dca6c6400ce0d923334f5000d11bb8"
Sep 07 21:20:03.093754 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:20:03.093736    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76cd0a0649312c99d27f87f57bd00b69e5dca6c6400ce0d923334f5000d11bb8\": container with ID starting with 76cd0a0649312c99d27f87f57bd00b69e5dca6c6400ce0d923334f5000d11bb8 not found: ID does not exist" containerID="76cd0a0649312c99d27f87f57bd00b69e5dca6c6400ce0d923334f5000d11bb8"
Sep 07 21:20:03.093798 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:03.093766    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76cd0a0649312c99d27f87f57bd00b69e5dca6c6400ce0d923334f5000d11bb8"} err="failed to get container status \"76cd0a0649312c99d27f87f57bd00b69e5dca6c6400ce0d923334f5000d11bb8\": rpc error: code = NotFound desc = could not find container \"76cd0a0649312c99d27f87f57bd00b69e5dca6c6400ce0d923334f5000d11bb8\": container with ID starting with 76cd0a0649312c99d27f87f57bd00b69e5dca6c6400ce0d923334f5000d11bb8 not found: ID does not exist"
Sep 07 21:20:03.108656 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:03.108621    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd"]
Sep 07 21:20:03.113537 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:03.113501    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd"]
Sep 07 21:20:03.145108 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:03.145067    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2vtg\" (UniqueName: \"kubernetes.io/projected/c8694d90-0977-46b2-a7c9-4d7aee779029-kube-api-access-j2vtg\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:20:03.145108 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:03.145102    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8694d90-0977-46b2-a7c9-4d7aee779029-plugins-config-volume\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:20:04.309949 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:04.309902    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8694d90-0977-46b2-a7c9-4d7aee779029" path="/var/lib/kubelet/pods/c8694d90-0977-46b2-a7c9-4d7aee779029/volumes"
Sep 07 21:20:09.134692 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:09.134659    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"]
Sep 07 21:20:09.135192 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:09.134910    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp" podUID="a5d798ec-b58a-4a01-b46d-016d7fa4162d" containerName="istio-proxy" containerID="cri-o://590ce0f3cc2bf038ae0c54591cab6b422c22e49ccad3ec22b0c0fb03773978c8" gracePeriod=30
Sep 07 21:20:14.384074 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.384047    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:20:14.458660 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.458559    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-credential-socket\") pod \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") "
Sep 07 21:20:14.458660 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.458619    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-workload-certs\") pod \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") "
Sep 07 21:20:14.458660 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.458642    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-workload-socket\") pod \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") "
Sep 07 21:20:14.458660 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.458669    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-envoy\") pod \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") "
Sep 07 21:20:14.459000 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.458692    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-data\") pod \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") "
Sep 07 21:20:14.459000 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.458711    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istiod-ca-cert\") pod \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") "
Sep 07 21:20:14.459000 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.458746    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-token\") pod \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") "
Sep 07 21:20:14.459000 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.458788    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xbvh\" (UniqueName: \"kubernetes.io/projected/a5d798ec-b58a-4a01-b46d-016d7fa4162d-kube-api-access-6xbvh\") pod \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") "
Sep 07 21:20:14.459000 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.458825    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-podinfo\") pod \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\" (UID: \"a5d798ec-b58a-4a01-b46d-016d7fa4162d\") "
Sep 07 21:20:14.459000 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.458905    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a5d798ec-b58a-4a01-b46d-016d7fa4162d" (UID: "a5d798ec-b58a-4a01-b46d-016d7fa4162d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:20:14.459000 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.458977    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a5d798ec-b58a-4a01-b46d-016d7fa4162d" (UID: "a5d798ec-b58a-4a01-b46d-016d7fa4162d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:20:14.459463 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.459075    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a5d798ec-b58a-4a01-b46d-016d7fa4162d" (UID: "a5d798ec-b58a-4a01-b46d-016d7fa4162d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:20:14.459463 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.459195    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-data" (OuterVolumeSpecName: "istio-data") pod "a5d798ec-b58a-4a01-b46d-016d7fa4162d" (UID: "a5d798ec-b58a-4a01-b46d-016d7fa4162d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:20:14.459463 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.459198    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a5d798ec-b58a-4a01-b46d-016d7fa4162d" (UID: "a5d798ec-b58a-4a01-b46d-016d7fa4162d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:20:14.459463 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.459294    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-credential-socket\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:20:14.459463 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.459338    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-workload-certs\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:20:14.459463 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.459357    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-workload-socket\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:20:14.459463 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.459370    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-data\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:20:14.459463 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.459384    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istiod-ca-cert\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:20:14.460981 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.460956    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a5d798ec-b58a-4a01-b46d-016d7fa4162d" (UID: "a5d798ec-b58a-4a01-b46d-016d7fa4162d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:20:14.461109 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.461068    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-token" (OuterVolumeSpecName: "istio-token") pod "a5d798ec-b58a-4a01-b46d-016d7fa4162d" (UID: "a5d798ec-b58a-4a01-b46d-016d7fa4162d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:20:14.461339 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.461322    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a5d798ec-b58a-4a01-b46d-016d7fa4162d" (UID: "a5d798ec-b58a-4a01-b46d-016d7fa4162d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 21:20:14.461460 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.461446    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5d798ec-b58a-4a01-b46d-016d7fa4162d-kube-api-access-6xbvh" (OuterVolumeSpecName: "kube-api-access-6xbvh") pod "a5d798ec-b58a-4a01-b46d-016d7fa4162d" (UID: "a5d798ec-b58a-4a01-b46d-016d7fa4162d"). InnerVolumeSpecName "kube-api-access-6xbvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:20:14.560761 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.560720    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-envoy\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:20:14.560761 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.560757    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-token\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:20:14.560761 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.560766    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xbvh\" (UniqueName: \"kubernetes.io/projected/a5d798ec-b58a-4a01-b46d-016d7fa4162d-kube-api-access-6xbvh\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:20:14.560761 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:14.560775    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5d798ec-b58a-4a01-b46d-016d7fa4162d-istio-podinfo\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:20:15.154441 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:15.154405    2558 generic.go:356] "Generic (PLEG): container finished" podID="a5d798ec-b58a-4a01-b46d-016d7fa4162d" containerID="590ce0f3cc2bf038ae0c54591cab6b422c22e49ccad3ec22b0c0fb03773978c8" exitCode=0
Sep 07 21:20:15.154619 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:15.154456    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"
Sep 07 21:20:15.154619 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:15.154482    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp" event={"ID":"a5d798ec-b58a-4a01-b46d-016d7fa4162d","Type":"ContainerDied","Data":"590ce0f3cc2bf038ae0c54591cab6b422c22e49ccad3ec22b0c0fb03773978c8"}
Sep 07 21:20:15.154619 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:15.154537    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp" event={"ID":"a5d798ec-b58a-4a01-b46d-016d7fa4162d","Type":"ContainerDied","Data":"9dbe4a562f251520660b59b4783695dc3eeb3f11f4c5bdf9ff6587e93f7e5336"}
Sep 07 21:20:15.154619 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:15.154560    2558 scope.go:117] "RemoveContainer" containerID="590ce0f3cc2bf038ae0c54591cab6b422c22e49ccad3ec22b0c0fb03773978c8"
Sep 07 21:20:15.164513 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:15.164497    2558 scope.go:117] "RemoveContainer" containerID="91d8328cee4fe25d62319627b2ec527b3701e7afe1b88b728cc886585f0f1deb"
Sep 07 21:20:15.173397 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:15.173377    2558 scope.go:117] "RemoveContainer" containerID="590ce0f3cc2bf038ae0c54591cab6b422c22e49ccad3ec22b0c0fb03773978c8"
Sep 07 21:20:15.173654 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:20:15.173635    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"590ce0f3cc2bf038ae0c54591cab6b422c22e49ccad3ec22b0c0fb03773978c8\": container with ID starting with 590ce0f3cc2bf038ae0c54591cab6b422c22e49ccad3ec22b0c0fb03773978c8 not found: ID does not exist" containerID="590ce0f3cc2bf038ae0c54591cab6b422c22e49ccad3ec22b0c0fb03773978c8"
Sep 07 21:20:15.173707 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:15.173663    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"590ce0f3cc2bf038ae0c54591cab6b422c22e49ccad3ec22b0c0fb03773978c8"} err="failed to get container status \"590ce0f3cc2bf038ae0c54591cab6b422c22e49ccad3ec22b0c0fb03773978c8\": rpc error: code = NotFound desc = could not find container \"590ce0f3cc2bf038ae0c54591cab6b422c22e49ccad3ec22b0c0fb03773978c8\": container with ID starting with 590ce0f3cc2bf038ae0c54591cab6b422c22e49ccad3ec22b0c0fb03773978c8 not found: ID does not exist"
Sep 07 21:20:15.173707 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:15.173680    2558 scope.go:117] "RemoveContainer" containerID="91d8328cee4fe25d62319627b2ec527b3701e7afe1b88b728cc886585f0f1deb"
Sep 07 21:20:15.173964 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:20:15.173948    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91d8328cee4fe25d62319627b2ec527b3701e7afe1b88b728cc886585f0f1deb\": container with ID starting with 91d8328cee4fe25d62319627b2ec527b3701e7afe1b88b728cc886585f0f1deb not found: ID does not exist" containerID="91d8328cee4fe25d62319627b2ec527b3701e7afe1b88b728cc886585f0f1deb"
Sep 07 21:20:15.174014 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:15.173968    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91d8328cee4fe25d62319627b2ec527b3701e7afe1b88b728cc886585f0f1deb"} err="failed to get container status \"91d8328cee4fe25d62319627b2ec527b3701e7afe1b88b728cc886585f0f1deb\": rpc error: code = NotFound desc = could not find container \"91d8328cee4fe25d62319627b2ec527b3701e7afe1b88b728cc886585f0f1deb\": container with ID starting with 91d8328cee4fe25d62319627b2ec527b3701e7afe1b88b728cc886585f0f1deb not found: ID does not exist"
Sep 07 21:20:15.175780 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:15.175761    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"]
Sep 07 21:20:15.179358 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:15.179337    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp"]
Sep 07 21:20:15.853997 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:15.853965    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"]
Sep 07 21:20:15.862761 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:15.862716    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g" podUID="23cfd3ce-e4fc-42e9-99e2-253f13f7627a" containerName="maas-api" containerID="cri-o://a58699e2ac58850dd97ca57c171ec4be4f09f595149017fdd652647dddd0e338" gracePeriod=30
Sep 07 21:20:15.922336 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:15.922273    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm"]
Sep 07 21:20:15.922608 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:15.922582    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm" podUID="942a92f6-035a-46a0-a33f-d51e97365bfa" containerName="payload-pre-processing" containerID="cri-o://3c1c21b8f045dfd434ba1d766cec3e11251b5ba0b6253b2668e048eb7de716b6" gracePeriod=30
Sep 07 21:20:16.170547 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.170212    2558 generic.go:356] "Generic (PLEG): container finished" podID="942a92f6-035a-46a0-a33f-d51e97365bfa" containerID="3c1c21b8f045dfd434ba1d766cec3e11251b5ba0b6253b2668e048eb7de716b6" exitCode=0
Sep 07 21:20:16.170547 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.170365    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm" event={"ID":"942a92f6-035a-46a0-a33f-d51e97365bfa","Type":"ContainerDied","Data":"3c1c21b8f045dfd434ba1d766cec3e11251b5ba0b6253b2668e048eb7de716b6"}
Sep 07 21:20:16.172285 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.172083    2558 generic.go:356] "Generic (PLEG): container finished" podID="23cfd3ce-e4fc-42e9-99e2-253f13f7627a" containerID="a58699e2ac58850dd97ca57c171ec4be4f09f595149017fdd652647dddd0e338" exitCode=0
Sep 07 21:20:16.172285 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.172163    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g" event={"ID":"23cfd3ce-e4fc-42e9-99e2-253f13f7627a","Type":"ContainerDied","Data":"a58699e2ac58850dd97ca57c171ec4be4f09f595149017fdd652647dddd0e338"}
Sep 07 21:20:16.172285 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.172225    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g" event={"ID":"23cfd3ce-e4fc-42e9-99e2-253f13f7627a","Type":"ContainerDied","Data":"b9bba748d49af7f9d6804f9ead5d0beaa273a1684d133a7f92dd5f888385fdd9"}
Sep 07 21:20:16.172285 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.172252    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9bba748d49af7f9d6804f9ead5d0beaa273a1684d133a7f92dd5f888385fdd9"
Sep 07 21:20:16.172637 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.172477    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"
Sep 07 21:20:16.211681 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.211654    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm"
Sep 07 21:20:16.275914 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.275879    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-maas-api-tls\") pod \"23cfd3ce-e4fc-42e9-99e2-253f13f7627a\" (UID: \"23cfd3ce-e4fc-42e9-99e2-253f13f7627a\") "
Sep 07 21:20:16.275914 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.275920    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9w9q\" (UniqueName: \"kubernetes.io/projected/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-kube-api-access-t9w9q\") pod \"23cfd3ce-e4fc-42e9-99e2-253f13f7627a\" (UID: \"23cfd3ce-e4fc-42e9-99e2-253f13f7627a\") "
Sep 07 21:20:16.276158 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.275946    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-openshift-service-ca\") pod \"23cfd3ce-e4fc-42e9-99e2-253f13f7627a\" (UID: \"23cfd3ce-e4fc-42e9-99e2-253f13f7627a\") "
Sep 07 21:20:16.276158 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.275965    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-metrics-certs\") pod \"23cfd3ce-e4fc-42e9-99e2-253f13f7627a\" (UID: \"23cfd3ce-e4fc-42e9-99e2-253f13f7627a\") "
Sep 07 21:20:16.276158 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.275999    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/942a92f6-035a-46a0-a33f-d51e97365bfa-plugins-config-volume\") pod \"942a92f6-035a-46a0-a33f-d51e97365bfa\" (UID: \"942a92f6-035a-46a0-a33f-d51e97365bfa\") "
Sep 07 21:20:16.276158 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.276022    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zxq4\" (UniqueName: \"kubernetes.io/projected/942a92f6-035a-46a0-a33f-d51e97365bfa-kube-api-access-8zxq4\") pod \"942a92f6-035a-46a0-a33f-d51e97365bfa\" (UID: \"942a92f6-035a-46a0-a33f-d51e97365bfa\") "
Sep 07 21:20:16.276410 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.276329    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "23cfd3ce-e4fc-42e9-99e2-253f13f7627a" (UID: "23cfd3ce-e4fc-42e9-99e2-253f13f7627a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:20:16.276549 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.276524    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-openshift-service-ca\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:20:16.276653 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.276577    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/942a92f6-035a-46a0-a33f-d51e97365bfa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "942a92f6-035a-46a0-a33f-d51e97365bfa" (UID: "942a92f6-035a-46a0-a33f-d51e97365bfa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:20:16.278179 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.278149    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "23cfd3ce-e4fc-42e9-99e2-253f13f7627a" (UID: "23cfd3ce-e4fc-42e9-99e2-253f13f7627a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:20:16.278280 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.278190    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "23cfd3ce-e4fc-42e9-99e2-253f13f7627a" (UID: "23cfd3ce-e4fc-42e9-99e2-253f13f7627a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:20:16.278280 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.278216    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/942a92f6-035a-46a0-a33f-d51e97365bfa-kube-api-access-8zxq4" (OuterVolumeSpecName: "kube-api-access-8zxq4") pod "942a92f6-035a-46a0-a33f-d51e97365bfa" (UID: "942a92f6-035a-46a0-a33f-d51e97365bfa"). InnerVolumeSpecName "kube-api-access-8zxq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:20:16.278455 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.278437    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-kube-api-access-t9w9q" (OuterVolumeSpecName: "kube-api-access-t9w9q") pod "23cfd3ce-e4fc-42e9-99e2-253f13f7627a" (UID: "23cfd3ce-e4fc-42e9-99e2-253f13f7627a"). InnerVolumeSpecName "kube-api-access-t9w9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:20:16.308911 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.308882    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5d798ec-b58a-4a01-b46d-016d7fa4162d" path="/var/lib/kubelet/pods/a5d798ec-b58a-4a01-b46d-016d7fa4162d/volumes"
Sep 07 21:20:16.378001 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.377965    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9w9q\" (UniqueName: \"kubernetes.io/projected/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-kube-api-access-t9w9q\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:20:16.378001 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.377994    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-metrics-certs\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:20:16.378001 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.378008    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/942a92f6-035a-46a0-a33f-d51e97365bfa-plugins-config-volume\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:20:16.378215 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.378020    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zxq4\" (UniqueName: \"kubernetes.io/projected/942a92f6-035a-46a0-a33f-d51e97365bfa-kube-api-access-8zxq4\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:20:16.378215 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:16.378033    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23cfd3ce-e4fc-42e9-99e2-253f13f7627a-maas-api-tls\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:20:17.180542 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:17.180461    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm"
Sep 07 21:20:17.180542 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:17.180503    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm" event={"ID":"942a92f6-035a-46a0-a33f-d51e97365bfa","Type":"ContainerDied","Data":"36caffb560aa42b206ba32d71ce19eb15b642901ac62b8c1006e7b854b409293"}
Sep 07 21:20:17.181063 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:17.180566    2558 scope.go:117] "RemoveContainer" containerID="3c1c21b8f045dfd434ba1d766cec3e11251b5ba0b6253b2668e048eb7de716b6"
Sep 07 21:20:17.181063 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:17.180751    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"
Sep 07 21:20:17.200205 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:17.200162    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"]
Sep 07 21:20:17.203108 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:17.203086    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f838f49c-74c6f46d74-6887g"]
Sep 07 21:20:17.212827 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:17.212806    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm"]
Sep 07 21:20:17.218717 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:17.218697    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm"]
Sep 07 21:20:18.308876 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:18.308842    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23cfd3ce-e4fc-42e9-99e2-253f13f7627a" path="/var/lib/kubelet/pods/23cfd3ce-e4fc-42e9-99e2-253f13f7627a/volumes"
Sep 07 21:20:18.309262 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:18.309182    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="942a92f6-035a-46a0-a33f-d51e97365bfa" path="/var/lib/kubelet/pods/942a92f6-035a-46a0-a33f-d51e97365bfa/volumes"
Sep 07 21:20:20.155491 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:20.155456    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"]
Sep 07 21:20:20.155952 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:20.155751    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq" podUID="db6fc534-3ed7-4433-8789-b25d1cbe4e94" containerName="maas-api" containerID="cri-o://b7cabee95d3968bed6ece0c64122d3fe290d64dc050cef3dbe58f0be63d73cd4" gracePeriod=30
Sep 07 21:20:20.416475 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:20.416406    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"
Sep 07 21:20:20.517622 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:20.517578    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db6fc534-3ed7-4433-8789-b25d1cbe4e94-openshift-service-ca\") pod \"db6fc534-3ed7-4433-8789-b25d1cbe4e94\" (UID: \"db6fc534-3ed7-4433-8789-b25d1cbe4e94\") "
Sep 07 21:20:20.517622 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:20.517625    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db6fc534-3ed7-4433-8789-b25d1cbe4e94-metrics-certs\") pod \"db6fc534-3ed7-4433-8789-b25d1cbe4e94\" (UID: \"db6fc534-3ed7-4433-8789-b25d1cbe4e94\") "
Sep 07 21:20:20.517888 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:20.517661    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nlds\" (UniqueName: \"kubernetes.io/projected/db6fc534-3ed7-4433-8789-b25d1cbe4e94-kube-api-access-6nlds\") pod \"db6fc534-3ed7-4433-8789-b25d1cbe4e94\" (UID: \"db6fc534-3ed7-4433-8789-b25d1cbe4e94\") "
Sep 07 21:20:20.517888 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:20.517828    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db6fc534-3ed7-4433-8789-b25d1cbe4e94-maas-api-tls\") pod \"db6fc534-3ed7-4433-8789-b25d1cbe4e94\" (UID: \"db6fc534-3ed7-4433-8789-b25d1cbe4e94\") "
Sep 07 21:20:20.518072 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:20.518045    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db6fc534-3ed7-4433-8789-b25d1cbe4e94-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "db6fc534-3ed7-4433-8789-b25d1cbe4e94" (UID: "db6fc534-3ed7-4433-8789-b25d1cbe4e94"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:20:20.519912 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:20.519884    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db6fc534-3ed7-4433-8789-b25d1cbe4e94-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "db6fc534-3ed7-4433-8789-b25d1cbe4e94" (UID: "db6fc534-3ed7-4433-8789-b25d1cbe4e94"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:20:20.519912 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:20.519896    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db6fc534-3ed7-4433-8789-b25d1cbe4e94-kube-api-access-6nlds" (OuterVolumeSpecName: "kube-api-access-6nlds") pod "db6fc534-3ed7-4433-8789-b25d1cbe4e94" (UID: "db6fc534-3ed7-4433-8789-b25d1cbe4e94"). InnerVolumeSpecName "kube-api-access-6nlds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:20:20.520048 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:20.519897    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db6fc534-3ed7-4433-8789-b25d1cbe4e94-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "db6fc534-3ed7-4433-8789-b25d1cbe4e94" (UID: "db6fc534-3ed7-4433-8789-b25d1cbe4e94"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:20:20.619536 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:20.619496    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nlds\" (UniqueName: \"kubernetes.io/projected/db6fc534-3ed7-4433-8789-b25d1cbe4e94-kube-api-access-6nlds\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:20:20.619536 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:20.619531    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db6fc534-3ed7-4433-8789-b25d1cbe4e94-maas-api-tls\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:20:20.619536 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:20.619541    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db6fc534-3ed7-4433-8789-b25d1cbe4e94-openshift-service-ca\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:20:20.619777 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:20.619551    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db6fc534-3ed7-4433-8789-b25d1cbe4e94-metrics-certs\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:20:21.204865 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:21.204831    2558 generic.go:356] "Generic (PLEG): container finished" podID="db6fc534-3ed7-4433-8789-b25d1cbe4e94" containerID="b7cabee95d3968bed6ece0c64122d3fe290d64dc050cef3dbe58f0be63d73cd4" exitCode=0
Sep 07 21:20:21.205353 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:21.204883    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"
Sep 07 21:20:21.205353 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:21.204913    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq" event={"ID":"db6fc534-3ed7-4433-8789-b25d1cbe4e94","Type":"ContainerDied","Data":"b7cabee95d3968bed6ece0c64122d3fe290d64dc050cef3dbe58f0be63d73cd4"}
Sep 07 21:20:21.205353 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:21.204966    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq" event={"ID":"db6fc534-3ed7-4433-8789-b25d1cbe4e94","Type":"ContainerDied","Data":"efbb34fef59333689ad2c1bb91785da7c9895591bdffdca0f36dfb83208a57c3"}
Sep 07 21:20:21.205353 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:21.204989    2558 scope.go:117] "RemoveContainer" containerID="b7cabee95d3968bed6ece0c64122d3fe290d64dc050cef3dbe58f0be63d73cd4"
Sep 07 21:20:21.215109 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:21.215093    2558 scope.go:117] "RemoveContainer" containerID="b7cabee95d3968bed6ece0c64122d3fe290d64dc050cef3dbe58f0be63d73cd4"
Sep 07 21:20:21.215416 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:20:21.215396    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7cabee95d3968bed6ece0c64122d3fe290d64dc050cef3dbe58f0be63d73cd4\": container with ID starting with b7cabee95d3968bed6ece0c64122d3fe290d64dc050cef3dbe58f0be63d73cd4 not found: ID does not exist" containerID="b7cabee95d3968bed6ece0c64122d3fe290d64dc050cef3dbe58f0be63d73cd4"
Sep 07 21:20:21.215465 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:21.215426    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7cabee95d3968bed6ece0c64122d3fe290d64dc050cef3dbe58f0be63d73cd4"} err="failed to get container status \"b7cabee95d3968bed6ece0c64122d3fe290d64dc050cef3dbe58f0be63d73cd4\": rpc error: code = NotFound desc = could not find container \"b7cabee95d3968bed6ece0c64122d3fe290d64dc050cef3dbe58f0be63d73cd4\": container with ID starting with b7cabee95d3968bed6ece0c64122d3fe290d64dc050cef3dbe58f0be63d73cd4 not found: ID does not exist"
Sep 07 21:20:21.226801 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:21.226774    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"]
Sep 07 21:20:21.229755 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:21.229735    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3102b2-56d558565d-rjvxq"]
Sep 07 21:20:22.308437 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:22.308409    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db6fc534-3ed7-4433-8789-b25d1cbe4e94" path="/var/lib/kubelet/pods/db6fc534-3ed7-4433-8789-b25d1cbe4e94/volumes"
Sep 07 21:20:27.559483 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.559449    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"]
Sep 07 21:20:27.559927 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.559910    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5d798ec-b58a-4a01-b46d-016d7fa4162d" containerName="istio-proxy"
Sep 07 21:20:27.559987 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.559928    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5d798ec-b58a-4a01-b46d-016d7fa4162d" containerName="istio-proxy"
Sep 07 21:20:27.559987 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.559938    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5d798ec-b58a-4a01-b46d-016d7fa4162d" containerName="istio-proxy"
Sep 07 21:20:27.559987 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.559943    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5d798ec-b58a-4a01-b46d-016d7fa4162d" containerName="istio-proxy"
Sep 07 21:20:27.559987 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.559951    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db6fc534-3ed7-4433-8789-b25d1cbe4e94" containerName="maas-api"
Sep 07 21:20:27.559987 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.559956    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="db6fc534-3ed7-4433-8789-b25d1cbe4e94" containerName="maas-api"
Sep 07 21:20:27.559987 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.559962    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8694d90-0977-46b2-a7c9-4d7aee779029" containerName="payload-processing"
Sep 07 21:20:27.559987 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.559968    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8694d90-0977-46b2-a7c9-4d7aee779029" containerName="payload-processing"
Sep 07 21:20:27.559987 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.559979    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="942a92f6-035a-46a0-a33f-d51e97365bfa" containerName="payload-pre-processing"
Sep 07 21:20:27.559987 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.559984    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="942a92f6-035a-46a0-a33f-d51e97365bfa" containerName="payload-pre-processing"
Sep 07 21:20:27.560443 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.559998    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23cfd3ce-e4fc-42e9-99e2-253f13f7627a" containerName="maas-api"
Sep 07 21:20:27.560443 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.560003    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="23cfd3ce-e4fc-42e9-99e2-253f13f7627a" containerName="maas-api"
Sep 07 21:20:27.560443 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.560060    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5d798ec-b58a-4a01-b46d-016d7fa4162d" containerName="istio-proxy"
Sep 07 21:20:27.560443 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.560066    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="23cfd3ce-e4fc-42e9-99e2-253f13f7627a" containerName="maas-api"
Sep 07 21:20:27.560443 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.560074    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="db6fc534-3ed7-4433-8789-b25d1cbe4e94" containerName="maas-api"
Sep 07 21:20:27.560443 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.560081    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8694d90-0977-46b2-a7c9-4d7aee779029" containerName="payload-processing"
Sep 07 21:20:27.560443 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.560087    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5d798ec-b58a-4a01-b46d-016d7fa4162d" containerName="istio-proxy"
Sep 07 21:20:27.560443 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.560093    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="942a92f6-035a-46a0-a33f-d51e97365bfa" containerName="payload-pre-processing"
Sep 07 21:20:27.564180 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.564163    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.566704 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.566681    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-15d5e2-openshift-default-dockercfg-6zkwq\""
Sep 07 21:20:27.576764 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.576740    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"]
Sep 07 21:20:27.686520 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.686483    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-envoy\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.686680 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.686532    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-data\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.686680 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.686564    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b49dedc1-7c78-4003-9b58-8aac6b488df5-istiod-ca-cert\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.686680 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.686590    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-workload-certs\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.686680 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.686610    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-workload-socket\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.686680 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.686627    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-podinfo\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.686926 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.686727    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-credential-socket\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.686926 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.686772    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4xrv\" (UniqueName: \"kubernetes.io/projected/b49dedc1-7c78-4003-9b58-8aac6b488df5-kube-api-access-s4xrv\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.686926 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.686842    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-token\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.787822 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.787781    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-token\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.788013 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.787839    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-envoy\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.788013 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.787865    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-data\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.788013 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.787893    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b49dedc1-7c78-4003-9b58-8aac6b488df5-istiod-ca-cert\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.788013 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.787918    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-workload-certs\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.788013 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.787940    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-workload-socket\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.788013 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.787965    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-podinfo\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.788013 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.787998    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-credential-socket\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.788435 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.788029    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4xrv\" (UniqueName: \"kubernetes.io/projected/b49dedc1-7c78-4003-9b58-8aac6b488df5-kube-api-access-s4xrv\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.788435 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.788332    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-data\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.788636 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.788613    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-workload-socket\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.788680 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.788641    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-workload-certs\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.788733 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.788716    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b49dedc1-7c78-4003-9b58-8aac6b488df5-istiod-ca-cert\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.788775 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.788762    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-credential-socket\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.790287 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.790271    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-envoy\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.790833 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.790809    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-podinfo\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.795470 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.795446    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4xrv\" (UniqueName: \"kubernetes.io/projected/b49dedc1-7c78-4003-9b58-8aac6b488df5-kube-api-access-s4xrv\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.795786 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.795766    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-token\") pod \"e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") " pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:27.877134 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:27.877042    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:28.170862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:28.170834    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"]
Sep 07 21:20:28.172230 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:20:28.172204    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb49dedc1_7c78_4003_9b58_8aac6b488df5.slice/crio-16bd6e5d754c40c8c5b6f72687fdbe936f7c26d6e9bed7ecd84301672f28c945 WatchSource:0}: Error finding container 16bd6e5d754c40c8c5b6f72687fdbe936f7c26d6e9bed7ecd84301672f28c945: Status 404 returned error can't find the container with id 16bd6e5d754c40c8c5b6f72687fdbe936f7c26d6e9bed7ecd84301672f28c945
Sep 07 21:20:28.174495 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:28.174458    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:20:28.174563 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:28.174540    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:20:28.174612 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:28.174583    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:20:28.249127 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:28.249097    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d" event={"ID":"b49dedc1-7c78-4003-9b58-8aac6b488df5","Type":"ContainerStarted","Data":"16bd6e5d754c40c8c5b6f72687fdbe936f7c26d6e9bed7ecd84301672f28c945"}
Sep 07 21:20:28.313819 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:28.313756    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d" podStartSLOduration=1.31373443 podStartE2EDuration="1.31373443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:20:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:20:28.309763905 +0000 UTC m=+1124.569581169" watchObservedRunningTime="2026-09-07 21:20:28.31373443 +0000 UTC m=+1124.573551679"
Sep 07 21:20:28.877172 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:28.877140    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:29.256910 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:29.256815    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d" event={"ID":"b49dedc1-7c78-4003-9b58-8aac6b488df5","Type":"ContainerStarted","Data":"c4cb01987b0975e83eadb78723d71ccabc81b33699e55cd382316abd540173b8"}
Sep 07 21:20:29.882988 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:29.882952    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:30.262513 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:30.262431    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:30.263482 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:30.263460    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:31.893177 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:31.893146    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx"]
Sep 07 21:20:31.896703 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:31.896686    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx"
Sep 07 21:20:31.898853 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:31.898837    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-15d5e2\""
Sep 07 21:20:31.910612 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:31.910505    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx"]
Sep 07 21:20:32.029571 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:32.029536    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqpcg\" (UniqueName: \"kubernetes.io/projected/ecfcd749-d853-4d07-a723-b550049333d7-kube-api-access-zqpcg\") pod \"payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx\" (UID: \"ecfcd749-d853-4d07-a723-b550049333d7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx"
Sep 07 21:20:32.029720 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:32.029680    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecfcd749-d853-4d07-a723-b550049333d7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx\" (UID: \"ecfcd749-d853-4d07-a723-b550049333d7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx"
Sep 07 21:20:32.130557 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:32.130522    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqpcg\" (UniqueName: \"kubernetes.io/projected/ecfcd749-d853-4d07-a723-b550049333d7-kube-api-access-zqpcg\") pod \"payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx\" (UID: \"ecfcd749-d853-4d07-a723-b550049333d7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx"
Sep 07 21:20:32.130700 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:32.130665    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecfcd749-d853-4d07-a723-b550049333d7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx\" (UID: \"ecfcd749-d853-4d07-a723-b550049333d7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx"
Sep 07 21:20:32.131374 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:32.131354    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecfcd749-d853-4d07-a723-b550049333d7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx\" (UID: \"ecfcd749-d853-4d07-a723-b550049333d7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx"
Sep 07 21:20:32.138090 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:32.138067    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqpcg\" (UniqueName: \"kubernetes.io/projected/ecfcd749-d853-4d07-a723-b550049333d7-kube-api-access-zqpcg\") pod \"payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx\" (UID: \"ecfcd749-d853-4d07-a723-b550049333d7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx"
Sep 07 21:20:32.214222 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:32.214129    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx"
Sep 07 21:20:32.486079 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:32.486048    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx"]
Sep 07 21:20:32.487291 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:20:32.487261    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecfcd749_d853_4d07_a723_b550049333d7.slice/crio-8306b28d43a1b288a7872b124027574d14e24960e4a2e558617b5188ba27e353 WatchSource:0}: Error finding container 8306b28d43a1b288a7872b124027574d14e24960e4a2e558617b5188ba27e353: Status 404 returned error can't find the container with id 8306b28d43a1b288a7872b124027574d14e24960e4a2e558617b5188ba27e353
Sep 07 21:20:33.287129 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:33.287091    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx" event={"ID":"ecfcd749-d853-4d07-a723-b550049333d7","Type":"ContainerStarted","Data":"5831d299347f2f83b2eb88d5606e1a47420b2184a548ce054a983141ecc20840"}
Sep 07 21:20:33.287572 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:33.287152    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx" event={"ID":"ecfcd749-d853-4d07-a723-b550049333d7","Type":"ContainerStarted","Data":"8306b28d43a1b288a7872b124027574d14e24960e4a2e558617b5188ba27e353"}
Sep 07 21:20:33.287572 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:33.287190    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx"
Sep 07 21:20:33.304271 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:33.304226    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx" podStartSLOduration=2.304211414 podStartE2EDuration="2.304211414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:20:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:20:33.301836159 +0000 UTC m=+1129.561653417" watchObservedRunningTime="2026-09-07 21:20:33.304211414 +0000 UTC m=+1129.564028657"
Sep 07 21:20:42.253179 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:42.253136    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7"]
Sep 07 21:20:42.257456 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:42.257429    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7"
Sep 07 21:20:42.259936 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:42.259909    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-d03ead\""
Sep 07 21:20:42.260077 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:42.259909    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-d03ead-dockercfg-xllcx\""
Sep 07 21:20:42.268481 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:42.268455    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7"]
Sep 07 21:20:42.327688 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:42.327653    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a90f24c5-a982-4e10-a51a-195c314cdcf8-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7\" (UID: \"a90f24c5-a982-4e10-a51a-195c314cdcf8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7"
Sep 07 21:20:42.327858 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:42.327695    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxfd6\" (UniqueName: \"kubernetes.io/projected/a90f24c5-a982-4e10-a51a-195c314cdcf8-kube-api-access-cxfd6\") pod \"payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7\" (UID: \"a90f24c5-a982-4e10-a51a-195c314cdcf8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7"
Sep 07 21:20:42.429163 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:42.429121    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a90f24c5-a982-4e10-a51a-195c314cdcf8-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7\" (UID: \"a90f24c5-a982-4e10-a51a-195c314cdcf8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7"
Sep 07 21:20:42.429486 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:42.429460    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxfd6\" (UniqueName: \"kubernetes.io/projected/a90f24c5-a982-4e10-a51a-195c314cdcf8-kube-api-access-cxfd6\") pod \"payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7\" (UID: \"a90f24c5-a982-4e10-a51a-195c314cdcf8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7"
Sep 07 21:20:42.430046 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:42.430028    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a90f24c5-a982-4e10-a51a-195c314cdcf8-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7\" (UID: \"a90f24c5-a982-4e10-a51a-195c314cdcf8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7"
Sep 07 21:20:42.441791 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:42.441757    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxfd6\" (UniqueName: \"kubernetes.io/projected/a90f24c5-a982-4e10-a51a-195c314cdcf8-kube-api-access-cxfd6\") pod \"payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7\" (UID: \"a90f24c5-a982-4e10-a51a-195c314cdcf8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7"
Sep 07 21:20:42.571143 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:42.571101    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7"
Sep 07 21:20:42.853104 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:42.853067    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7"]
Sep 07 21:20:42.853986 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:20:42.853953    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda90f24c5_a982_4e10_a51a_195c314cdcf8.slice/crio-08690992ae297d1203340713d5ca6b4036762b4a13d028a3fd41bbeb2089df2a WatchSource:0}: Error finding container 08690992ae297d1203340713d5ca6b4036762b4a13d028a3fd41bbeb2089df2a: Status 404 returned error can't find the container with id 08690992ae297d1203340713d5ca6b4036762b4a13d028a3fd41bbeb2089df2a
Sep 07 21:20:43.352273 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:43.352231    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7" event={"ID":"a90f24c5-a982-4e10-a51a-195c314cdcf8","Type":"ContainerStarted","Data":"b4ae912031247c243fb531b20820ece4ad938a1a9beee1ef9f23f073f7718886"}
Sep 07 21:20:43.352728 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:43.352345    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7" event={"ID":"a90f24c5-a982-4e10-a51a-195c314cdcf8","Type":"ContainerStarted","Data":"08690992ae297d1203340713d5ca6b4036762b4a13d028a3fd41bbeb2089df2a"}
Sep 07 21:20:43.352728 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:43.352491    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7"
Sep 07 21:20:43.366633 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:43.366576    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7" podStartSLOduration=1.366559576 podStartE2EDuration="1.366559576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:20:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:20:43.36575797 +0000 UTC m=+1139.625575239" watchObservedRunningTime="2026-09-07 21:20:43.366559576 +0000 UTC m=+1139.626376823"
Sep 07 21:20:44.296087 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:44.296055    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx"
Sep 07 21:20:45.264398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:45.264363    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 07 21:20:45.264804 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:45.264430    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d" podUID="b49dedc1-7c78-4003-9b58-8aac6b488df5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 07 21:20:45.367874 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:45.367840    2558 generic.go:356] "Generic (PLEG): container finished" podID="b49dedc1-7c78-4003-9b58-8aac6b488df5" containerID="c4cb01987b0975e83eadb78723d71ccabc81b33699e55cd382316abd540173b8" exitCode=0
Sep 07 21:20:45.368038 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:45.367910    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d" event={"ID":"b49dedc1-7c78-4003-9b58-8aac6b488df5","Type":"ContainerDied","Data":"c4cb01987b0975e83eadb78723d71ccabc81b33699e55cd382316abd540173b8"}
Sep 07 21:20:45.368346 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:45.368303    2558 scope.go:117] "RemoveContainer" containerID="c4cb01987b0975e83eadb78723d71ccabc81b33699e55cd382316abd540173b8"
Sep 07 21:20:45.369342 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:45.369305    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:20:45.369410 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:45.369397    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:20:45.369446 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:45.369431    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 07 21:20:46.375860 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:46.375825    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d" event={"ID":"b49dedc1-7c78-4003-9b58-8aac6b488df5","Type":"ContainerStarted","Data":"3901d613c743e33c78ed83ff37ab9c7b0f54f47d68ff75f39956748bc4979142"}
Sep 07 21:20:46.878260 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:46.878221    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:46.878533 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:46.878509    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 07 21:20:46.878597 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:46.878577    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d" podUID="b49dedc1-7c78-4003-9b58-8aac6b488df5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 07 21:20:47.877566 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:47.877526    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 07 21:20:47.877950 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:47.877588    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d" podUID="b49dedc1-7c78-4003-9b58-8aac6b488df5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 07 21:20:48.877451 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:48.877414    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 07 21:20:48.877634 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:48.877471    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d" podUID="b49dedc1-7c78-4003-9b58-8aac6b488df5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 07 21:20:49.878464 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:49.878421    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 07 21:20:49.878934 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:49.878487    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d" podUID="b49dedc1-7c78-4003-9b58-8aac6b488df5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 07 21:20:50.878046 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:50.878010    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 07 21:20:50.878227 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:50.878067    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d" podUID="b49dedc1-7c78-4003-9b58-8aac6b488df5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 07 21:20:52.154055 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:52.154010    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:52.154556 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:52.154432    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:52.155778 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:52.155756    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:20:54.362743 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:54.362709    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7"
Sep 07 21:20:59.737731 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:59.737695    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"]
Sep 07 21:20:59.742642 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:59.742621    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"
Sep 07 21:20:59.744845 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:59.744813    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-7fa21f-serving-cert\""
Sep 07 21:20:59.752222 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:59.752198    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"]
Sep 07 21:20:59.898380 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:59.898338    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k5ww\" (UniqueName: \"kubernetes.io/projected/719b90a9-07dc-480b-885e-07766d8d076a-kube-api-access-7k5ww\") pod \"maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn\" (UID: \"719b90a9-07dc-480b-885e-07766d8d076a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"
Sep 07 21:20:59.898564 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:59.898406    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/719b90a9-07dc-480b-885e-07766d8d076a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn\" (UID: \"719b90a9-07dc-480b-885e-07766d8d076a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"
Sep 07 21:20:59.898564 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:59.898526    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/719b90a9-07dc-480b-885e-07766d8d076a-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn\" (UID: \"719b90a9-07dc-480b-885e-07766d8d076a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"
Sep 07 21:20:59.898564 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:20:59.898555    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/719b90a9-07dc-480b-885e-07766d8d076a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn\" (UID: \"719b90a9-07dc-480b-885e-07766d8d076a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"
Sep 07 21:21:00.000098 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.000010    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/719b90a9-07dc-480b-885e-07766d8d076a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn\" (UID: \"719b90a9-07dc-480b-885e-07766d8d076a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"
Sep 07 21:21:00.000098 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.000078    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/719b90a9-07dc-480b-885e-07766d8d076a-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn\" (UID: \"719b90a9-07dc-480b-885e-07766d8d076a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"
Sep 07 21:21:00.000279 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.000109    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/719b90a9-07dc-480b-885e-07766d8d076a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn\" (UID: \"719b90a9-07dc-480b-885e-07766d8d076a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"
Sep 07 21:21:00.000279 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.000137    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k5ww\" (UniqueName: \"kubernetes.io/projected/719b90a9-07dc-480b-885e-07766d8d076a-kube-api-access-7k5ww\") pod \"maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn\" (UID: \"719b90a9-07dc-480b-885e-07766d8d076a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"
Sep 07 21:21:00.000765 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.000737    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/719b90a9-07dc-480b-885e-07766d8d076a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn\" (UID: \"719b90a9-07dc-480b-885e-07766d8d076a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"
Sep 07 21:21:00.002587 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.002565    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/719b90a9-07dc-480b-885e-07766d8d076a-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn\" (UID: \"719b90a9-07dc-480b-885e-07766d8d076a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"
Sep 07 21:21:00.002681 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.002656    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/719b90a9-07dc-480b-885e-07766d8d076a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn\" (UID: \"719b90a9-07dc-480b-885e-07766d8d076a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"
Sep 07 21:21:00.007434 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.007408    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k5ww\" (UniqueName: \"kubernetes.io/projected/719b90a9-07dc-480b-885e-07766d8d076a-kube-api-access-7k5ww\") pod \"maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn\" (UID: \"719b90a9-07dc-480b-885e-07766d8d076a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"
Sep 07 21:21:00.056297 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.056268    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"
Sep 07 21:21:00.336088 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.336055    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"]
Sep 07 21:21:00.337796 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:21:00.337767    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod719b90a9_07dc_480b_885e_07766d8d076a.slice/crio-d66c0226aea09b559919e26650384230cedc4702b7970e2c50c27b39d6ae9a43 WatchSource:0}: Error finding container d66c0226aea09b559919e26650384230cedc4702b7970e2c50c27b39d6ae9a43: Status 404 returned error can't find the container with id d66c0226aea09b559919e26650384230cedc4702b7970e2c50c27b39d6ae9a43
Sep 07 21:21:00.459798 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.459754    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn" event={"ID":"719b90a9-07dc-480b-885e-07766d8d076a","Type":"ContainerStarted","Data":"d66c0226aea09b559919e26650384230cedc4702b7970e2c50c27b39d6ae9a43"}
Sep 07 21:21:00.485558 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.485528    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2"]
Sep 07 21:21:00.490000 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.489980    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2"
Sep 07 21:21:00.492078 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.492054    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-7fa21f\""
Sep 07 21:21:00.492078 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.492072    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-7fa21f-dockercfg-rk4j4\""
Sep 07 21:21:00.500180 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.500154    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2"]
Sep 07 21:21:00.608386 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.605948    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b867\" (UniqueName: \"kubernetes.io/projected/1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6-kube-api-access-2b867\") pod \"payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2\" (UID: \"1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2"
Sep 07 21:21:00.608386 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.606032    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2\" (UID: \"1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2"
Sep 07 21:21:00.706698 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.706675    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b867\" (UniqueName: \"kubernetes.io/projected/1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6-kube-api-access-2b867\") pod \"payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2\" (UID: \"1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2"
Sep 07 21:21:00.706804 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.706712    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2\" (UID: \"1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2"
Sep 07 21:21:00.707346 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.707328    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2\" (UID: \"1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2"
Sep 07 21:21:00.713948 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.713925    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b867\" (UniqueName: \"kubernetes.io/projected/1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6-kube-api-access-2b867\") pod \"payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2\" (UID: \"1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2"
Sep 07 21:21:00.803273 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:00.803233    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2"
Sep 07 21:21:01.075782 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:01.075754    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2"]
Sep 07 21:21:01.077187 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:21:01.077156    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b2f10f8_2e4c_40cf_b350_d8f80f68b9c6.slice/crio-ee72fe11d8c7fdebe44d0de4e6b7dae657749e7f4cd2d13df533bd50396eedd0 WatchSource:0}: Error finding container ee72fe11d8c7fdebe44d0de4e6b7dae657749e7f4cd2d13df533bd50396eedd0: Status 404 returned error can't find the container with id ee72fe11d8c7fdebe44d0de4e6b7dae657749e7f4cd2d13df533bd50396eedd0
Sep 07 21:21:01.469219 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:01.469120    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn" event={"ID":"719b90a9-07dc-480b-885e-07766d8d076a","Type":"ContainerStarted","Data":"4c67202b29c709b00d9f71fbc01a76ba10cb20025131f789ba78be43a43a4615"}
Sep 07 21:21:01.469219 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:01.469204    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"
Sep 07 21:21:01.470947 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:01.470920    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2" event={"ID":"1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6","Type":"ContainerStarted","Data":"e4d47f633501a0ccd8bc4ece0048b7bb2516b0fa9242b4507a2e4848356f754a"}
Sep 07 21:21:01.471055 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:01.470966    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2" event={"ID":"1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6","Type":"ContainerStarted","Data":"ee72fe11d8c7fdebe44d0de4e6b7dae657749e7f4cd2d13df533bd50396eedd0"}
Sep 07 21:21:01.471055 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:01.470990    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2"
Sep 07 21:21:01.485104 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:01.485058    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn" podStartSLOduration=2.147336869 podStartE2EDuration="2.485042758s" totalImagesPullingTime="337.705889ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:20:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:21:01.484259378 +0000 UTC m=+1157.744076649" watchObservedRunningTime="2026-09-07 21:21:01.485042758 +0000 UTC m=+1157.744860000"
Sep 07 21:21:01.501189 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:01.501131    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2" podStartSLOduration=1.501116928 podStartE2EDuration="1.501116928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:21:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:21:01.498508086 +0000 UTC m=+1157.758325346" watchObservedRunningTime="2026-09-07 21:21:01.501116928 +0000 UTC m=+1157.760934171"
Sep 07 21:21:07.483520 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:07.483433    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"
Sep 07 21:21:09.786288 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:09.786244    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"]
Sep 07 21:21:09.792456 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:09.792421    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"
Sep 07 21:21:09.794922 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:09.794894    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-b9edc3-serving-cert\""
Sep 07 21:21:09.799071 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:09.799044    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"]
Sep 07 21:21:09.893749 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:09.893716    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b81df386-d787-41ea-bc9b-9217583e3eaa-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb\" (UID: \"b81df386-d787-41ea-bc9b-9217583e3eaa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"
Sep 07 21:21:09.893941 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:09.893778    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b81df386-d787-41ea-bc9b-9217583e3eaa-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb\" (UID: \"b81df386-d787-41ea-bc9b-9217583e3eaa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"
Sep 07 21:21:09.893941 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:09.893818    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b81df386-d787-41ea-bc9b-9217583e3eaa-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb\" (UID: \"b81df386-d787-41ea-bc9b-9217583e3eaa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"
Sep 07 21:21:09.893941 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:09.893920    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2tws\" (UniqueName: \"kubernetes.io/projected/b81df386-d787-41ea-bc9b-9217583e3eaa-kube-api-access-d2tws\") pod \"maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb\" (UID: \"b81df386-d787-41ea-bc9b-9217583e3eaa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"
Sep 07 21:21:09.994753 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:09.994716    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2tws\" (UniqueName: \"kubernetes.io/projected/b81df386-d787-41ea-bc9b-9217583e3eaa-kube-api-access-d2tws\") pod \"maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb\" (UID: \"b81df386-d787-41ea-bc9b-9217583e3eaa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"
Sep 07 21:21:09.994922 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:09.994757    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b81df386-d787-41ea-bc9b-9217583e3eaa-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb\" (UID: \"b81df386-d787-41ea-bc9b-9217583e3eaa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"
Sep 07 21:21:09.994922 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:09.994814    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b81df386-d787-41ea-bc9b-9217583e3eaa-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb\" (UID: \"b81df386-d787-41ea-bc9b-9217583e3eaa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"
Sep 07 21:21:09.994922 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:09.994845    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b81df386-d787-41ea-bc9b-9217583e3eaa-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb\" (UID: \"b81df386-d787-41ea-bc9b-9217583e3eaa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"
Sep 07 21:21:09.995520 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:09.995490    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b81df386-d787-41ea-bc9b-9217583e3eaa-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb\" (UID: \"b81df386-d787-41ea-bc9b-9217583e3eaa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"
Sep 07 21:21:09.997410 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:09.997389    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b81df386-d787-41ea-bc9b-9217583e3eaa-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb\" (UID: \"b81df386-d787-41ea-bc9b-9217583e3eaa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"
Sep 07 21:21:09.997506 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:09.997414    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b81df386-d787-41ea-bc9b-9217583e3eaa-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb\" (UID: \"b81df386-d787-41ea-bc9b-9217583e3eaa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"
Sep 07 21:21:10.002221 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:10.002203    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2tws\" (UniqueName: \"kubernetes.io/projected/b81df386-d787-41ea-bc9b-9217583e3eaa-kube-api-access-d2tws\") pod \"maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb\" (UID: \"b81df386-d787-41ea-bc9b-9217583e3eaa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"
Sep 07 21:21:10.106950 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:10.106913    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"
Sep 07 21:21:10.386532 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:10.386498    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"]
Sep 07 21:21:10.388098 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:21:10.388070    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb81df386_d787_41ea_bc9b_9217583e3eaa.slice/crio-b9752a614fe2a146e1b10c6f9e7eb37b6e6cb4749a475ce5a83a43e5283de1bd WatchSource:0}: Error finding container b9752a614fe2a146e1b10c6f9e7eb37b6e6cb4749a475ce5a83a43e5283de1bd: Status 404 returned error can't find the container with id b9752a614fe2a146e1b10c6f9e7eb37b6e6cb4749a475ce5a83a43e5283de1bd
Sep 07 21:21:10.530340 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:10.528194    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb" event={"ID":"b81df386-d787-41ea-bc9b-9217583e3eaa","Type":"ContainerStarted","Data":"b9752a614fe2a146e1b10c6f9e7eb37b6e6cb4749a475ce5a83a43e5283de1bd"}
Sep 07 21:21:11.535502 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:11.535467    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb" event={"ID":"b81df386-d787-41ea-bc9b-9217583e3eaa","Type":"ContainerStarted","Data":"7bb35988c8a17b3a7e355924a02da5fa895d01ed543958f4861d75615575d0e5"}
Sep 07 21:21:11.535895 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:11.535596    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"
Sep 07 21:21:11.552349 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:11.552272    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb" podStartSLOduration=2.144758999 podStartE2EDuration="2.552257268s" totalImagesPullingTime="407.498269ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:21:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:21:11.551370465 +0000 UTC m=+1167.811187727" watchObservedRunningTime="2026-09-07 21:21:11.552257268 +0000 UTC m=+1167.812074512"
Sep 07 21:21:12.479714 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:12.479687    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2"
Sep 07 21:21:17.546801 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:17.546763    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"
Sep 07 21:21:44.290602 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:44.290571    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-kv96r_d804af86-d937-4ea6-afb8-760911a10437/console-operator/1.log"
Sep 07 21:21:44.294835 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:44.294813    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-kv96r_d804af86-d937-4ea6-afb8-760911a10437/console-operator/1.log"
Sep 07 21:21:51.053742 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:51.053705    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"]
Sep 07 21:21:51.057847 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:51.057820    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"
Sep 07 21:21:51.060595 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:51.060560    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-424fbbc4-serving-cert\""
Sep 07 21:21:51.066643 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:51.066617    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"]
Sep 07 21:21:51.102234 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:51.102196    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9710be48-7bca-430d-8626-c5dd55b037c8-maas-api-tls\") pod \"maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd\" (UID: \"9710be48-7bca-430d-8626-c5dd55b037c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"
Sep 07 21:21:51.102465 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:51.102289    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9710be48-7bca-430d-8626-c5dd55b037c8-metrics-certs\") pod \"maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd\" (UID: \"9710be48-7bca-430d-8626-c5dd55b037c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"
Sep 07 21:21:51.102465 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:51.102357    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc5ln\" (UniqueName: \"kubernetes.io/projected/9710be48-7bca-430d-8626-c5dd55b037c8-kube-api-access-lc5ln\") pod \"maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd\" (UID: \"9710be48-7bca-430d-8626-c5dd55b037c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"
Sep 07 21:21:51.102465 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:51.102437    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9710be48-7bca-430d-8626-c5dd55b037c8-openshift-service-ca\") pod \"maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd\" (UID: \"9710be48-7bca-430d-8626-c5dd55b037c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"
Sep 07 21:21:51.203810 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:51.203780    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9710be48-7bca-430d-8626-c5dd55b037c8-openshift-service-ca\") pod \"maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd\" (UID: \"9710be48-7bca-430d-8626-c5dd55b037c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"
Sep 07 21:21:51.204013 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:51.203880    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9710be48-7bca-430d-8626-c5dd55b037c8-maas-api-tls\") pod \"maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd\" (UID: \"9710be48-7bca-430d-8626-c5dd55b037c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"
Sep 07 21:21:51.204013 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:51.203909    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9710be48-7bca-430d-8626-c5dd55b037c8-metrics-certs\") pod \"maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd\" (UID: \"9710be48-7bca-430d-8626-c5dd55b037c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"
Sep 07 21:21:51.204013 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:51.203936    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc5ln\" (UniqueName: \"kubernetes.io/projected/9710be48-7bca-430d-8626-c5dd55b037c8-kube-api-access-lc5ln\") pod \"maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd\" (UID: \"9710be48-7bca-430d-8626-c5dd55b037c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"
Sep 07 21:21:51.204626 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:51.204595    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9710be48-7bca-430d-8626-c5dd55b037c8-openshift-service-ca\") pod \"maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd\" (UID: \"9710be48-7bca-430d-8626-c5dd55b037c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"
Sep 07 21:21:51.206369 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:51.206338    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9710be48-7bca-430d-8626-c5dd55b037c8-metrics-certs\") pod \"maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd\" (UID: \"9710be48-7bca-430d-8626-c5dd55b037c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"
Sep 07 21:21:51.206466 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:51.206377    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9710be48-7bca-430d-8626-c5dd55b037c8-maas-api-tls\") pod \"maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd\" (UID: \"9710be48-7bca-430d-8626-c5dd55b037c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"
Sep 07 21:21:51.213263 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:51.213236    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc5ln\" (UniqueName: \"kubernetes.io/projected/9710be48-7bca-430d-8626-c5dd55b037c8-kube-api-access-lc5ln\") pod \"maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd\" (UID: \"9710be48-7bca-430d-8626-c5dd55b037c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"
Sep 07 21:21:51.371956 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:51.371868    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"
Sep 07 21:21:51.650077 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:51.650048    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"]
Sep 07 21:21:51.651715 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:21:51.651688    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9710be48_7bca_430d_8626_c5dd55b037c8.slice/crio-cacfcce52ba28578422244831cb7d7e7a36ab140fcb1e258d308148222d4cd16 WatchSource:0}: Error finding container cacfcce52ba28578422244831cb7d7e7a36ab140fcb1e258d308148222d4cd16: Status 404 returned error can't find the container with id cacfcce52ba28578422244831cb7d7e7a36ab140fcb1e258d308148222d4cd16
Sep 07 21:21:51.779797 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:51.779761    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd" event={"ID":"9710be48-7bca-430d-8626-c5dd55b037c8","Type":"ContainerStarted","Data":"cacfcce52ba28578422244831cb7d7e7a36ab140fcb1e258d308148222d4cd16"}
Sep 07 21:21:52.787285 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:52.787245    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd" event={"ID":"9710be48-7bca-430d-8626-c5dd55b037c8","Type":"ContainerStarted","Data":"fe31335be5d79b32f73896f8c1be96677ea2032c6c8ae7a199534f9754d36e0f"}
Sep 07 21:21:52.787721 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:52.787449    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"
Sep 07 21:21:52.805082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:52.805031    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd" podStartSLOduration=1.416020509 podStartE2EDuration="1.805014647s" totalImagesPullingTime="388.994138ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:21:52.80238338 +0000 UTC m=+1209.062200634" watchObservedRunningTime="2026-09-07 21:21:52.805014647 +0000 UTC m=+1209.064831889"
Sep 07 21:21:58.799176 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:21:58.799145    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"
Sep 07 21:23:25.148224 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:25.148187    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"]
Sep 07 21:23:25.148711 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:25.148475    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd" podUID="9710be48-7bca-430d-8626-c5dd55b037c8" containerName="maas-api" containerID="cri-o://fe31335be5d79b32f73896f8c1be96677ea2032c6c8ae7a199534f9754d36e0f" gracePeriod=30
Sep 07 21:23:25.343657 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:25.343627    2558 generic.go:356] "Generic (PLEG): container finished" podID="9710be48-7bca-430d-8626-c5dd55b037c8" containerID="fe31335be5d79b32f73896f8c1be96677ea2032c6c8ae7a199534f9754d36e0f" exitCode=0
Sep 07 21:23:25.343819 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:25.343697    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd" event={"ID":"9710be48-7bca-430d-8626-c5dd55b037c8","Type":"ContainerDied","Data":"fe31335be5d79b32f73896f8c1be96677ea2032c6c8ae7a199534f9754d36e0f"}
Sep 07 21:23:25.416707 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:25.416682    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"
Sep 07 21:23:25.535382 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:25.535352    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lc5ln\" (UniqueName: \"kubernetes.io/projected/9710be48-7bca-430d-8626-c5dd55b037c8-kube-api-access-lc5ln\") pod \"9710be48-7bca-430d-8626-c5dd55b037c8\" (UID: \"9710be48-7bca-430d-8626-c5dd55b037c8\") "
Sep 07 21:23:25.535541 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:25.535402    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9710be48-7bca-430d-8626-c5dd55b037c8-maas-api-tls\") pod \"9710be48-7bca-430d-8626-c5dd55b037c8\" (UID: \"9710be48-7bca-430d-8626-c5dd55b037c8\") "
Sep 07 21:23:25.535541 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:25.535427    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9710be48-7bca-430d-8626-c5dd55b037c8-openshift-service-ca\") pod \"9710be48-7bca-430d-8626-c5dd55b037c8\" (UID: \"9710be48-7bca-430d-8626-c5dd55b037c8\") "
Sep 07 21:23:25.535634 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:25.535607    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9710be48-7bca-430d-8626-c5dd55b037c8-metrics-certs\") pod \"9710be48-7bca-430d-8626-c5dd55b037c8\" (UID: \"9710be48-7bca-430d-8626-c5dd55b037c8\") "
Sep 07 21:23:25.535793 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:25.535770    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9710be48-7bca-430d-8626-c5dd55b037c8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9710be48-7bca-430d-8626-c5dd55b037c8" (UID: "9710be48-7bca-430d-8626-c5dd55b037c8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:23:25.536030 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:25.536013    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9710be48-7bca-430d-8626-c5dd55b037c8-openshift-service-ca\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:23:25.537566 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:25.537539    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9710be48-7bca-430d-8626-c5dd55b037c8-kube-api-access-lc5ln" (OuterVolumeSpecName: "kube-api-access-lc5ln") pod "9710be48-7bca-430d-8626-c5dd55b037c8" (UID: "9710be48-7bca-430d-8626-c5dd55b037c8"). InnerVolumeSpecName "kube-api-access-lc5ln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:23:25.537672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:25.537560    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9710be48-7bca-430d-8626-c5dd55b037c8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9710be48-7bca-430d-8626-c5dd55b037c8" (UID: "9710be48-7bca-430d-8626-c5dd55b037c8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:23:25.537672 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:25.537570    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9710be48-7bca-430d-8626-c5dd55b037c8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9710be48-7bca-430d-8626-c5dd55b037c8" (UID: "9710be48-7bca-430d-8626-c5dd55b037c8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:23:25.636933 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:25.636879    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lc5ln\" (UniqueName: \"kubernetes.io/projected/9710be48-7bca-430d-8626-c5dd55b037c8-kube-api-access-lc5ln\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:23:25.636933 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:25.636927    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9710be48-7bca-430d-8626-c5dd55b037c8-maas-api-tls\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:23:25.636933 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:25.636943    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9710be48-7bca-430d-8626-c5dd55b037c8-metrics-certs\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:23:26.350358 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:26.350330    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"
Sep 07 21:23:26.350736 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:26.350357    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd" event={"ID":"9710be48-7bca-430d-8626-c5dd55b037c8","Type":"ContainerDied","Data":"cacfcce52ba28578422244831cb7d7e7a36ab140fcb1e258d308148222d4cd16"}
Sep 07 21:23:26.350736 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:26.350421    2558 scope.go:117] "RemoveContainer" containerID="fe31335be5d79b32f73896f8c1be96677ea2032c6c8ae7a199534f9754d36e0f"
Sep 07 21:23:26.366576 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:26.366544    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"]
Sep 07 21:23:26.369969 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:26.369946    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-424fbbc4-6686f7fb6b-j9mtd"]
Sep 07 21:23:28.308615 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:23:28.308579    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9710be48-7bca-430d-8626-c5dd55b037c8" path="/var/lib/kubelet/pods/9710be48-7bca-430d-8626-c5dd55b037c8/volumes"
Sep 07 21:25:14.406409 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:14.406371    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"]
Sep 07 21:25:14.407030 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:14.406849    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9710be48-7bca-430d-8626-c5dd55b037c8" containerName="maas-api"
Sep 07 21:25:14.407030 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:14.406864    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9710be48-7bca-430d-8626-c5dd55b037c8" containerName="maas-api"
Sep 07 21:25:14.407030 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:14.406946    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9710be48-7bca-430d-8626-c5dd55b037c8" containerName="maas-api"
Sep 07 21:25:14.410046 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:14.410024    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"
Sep 07 21:25:14.412234 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:14.412208    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-4cf126-serving-cert\""
Sep 07 21:25:14.422128 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:14.422097    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"]
Sep 07 21:25:14.513207 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:14.513169    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7e7c30b-60b3-4ef9-8082-84156f0244af-maas-api-tls\") pod \"maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5\" (UID: \"e7e7c30b-60b3-4ef9-8082-84156f0244af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"
Sep 07 21:25:14.513434 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:14.513218    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tggl\" (UniqueName: \"kubernetes.io/projected/e7e7c30b-60b3-4ef9-8082-84156f0244af-kube-api-access-9tggl\") pod \"maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5\" (UID: \"e7e7c30b-60b3-4ef9-8082-84156f0244af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"
Sep 07 21:25:14.513434 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:14.513340    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7e7c30b-60b3-4ef9-8082-84156f0244af-metrics-certs\") pod \"maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5\" (UID: \"e7e7c30b-60b3-4ef9-8082-84156f0244af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"
Sep 07 21:25:14.513434 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:14.513377    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7e7c30b-60b3-4ef9-8082-84156f0244af-openshift-service-ca\") pod \"maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5\" (UID: \"e7e7c30b-60b3-4ef9-8082-84156f0244af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"
Sep 07 21:25:14.614062 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:14.614009    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7e7c30b-60b3-4ef9-8082-84156f0244af-maas-api-tls\") pod \"maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5\" (UID: \"e7e7c30b-60b3-4ef9-8082-84156f0244af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"
Sep 07 21:25:14.614253 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:14.614095    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tggl\" (UniqueName: \"kubernetes.io/projected/e7e7c30b-60b3-4ef9-8082-84156f0244af-kube-api-access-9tggl\") pod \"maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5\" (UID: \"e7e7c30b-60b3-4ef9-8082-84156f0244af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"
Sep 07 21:25:14.614253 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:14.614161    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7e7c30b-60b3-4ef9-8082-84156f0244af-metrics-certs\") pod \"maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5\" (UID: \"e7e7c30b-60b3-4ef9-8082-84156f0244af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"
Sep 07 21:25:14.614253 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:14.614196    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7e7c30b-60b3-4ef9-8082-84156f0244af-openshift-service-ca\") pod \"maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5\" (UID: \"e7e7c30b-60b3-4ef9-8082-84156f0244af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"
Sep 07 21:25:14.614993 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:14.614969    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7e7c30b-60b3-4ef9-8082-84156f0244af-openshift-service-ca\") pod \"maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5\" (UID: \"e7e7c30b-60b3-4ef9-8082-84156f0244af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"
Sep 07 21:25:14.616768 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:14.616742    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7e7c30b-60b3-4ef9-8082-84156f0244af-metrics-certs\") pod \"maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5\" (UID: \"e7e7c30b-60b3-4ef9-8082-84156f0244af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"
Sep 07 21:25:14.616889 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:14.616871    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7e7c30b-60b3-4ef9-8082-84156f0244af-maas-api-tls\") pod \"maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5\" (UID: \"e7e7c30b-60b3-4ef9-8082-84156f0244af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"
Sep 07 21:25:14.621538 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:14.621516    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tggl\" (UniqueName: \"kubernetes.io/projected/e7e7c30b-60b3-4ef9-8082-84156f0244af-kube-api-access-9tggl\") pod \"maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5\" (UID: \"e7e7c30b-60b3-4ef9-8082-84156f0244af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"
Sep 07 21:25:14.725675 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:14.725580    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"
Sep 07 21:25:15.000733 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:15.000702    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"]
Sep 07 21:25:15.002346 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:25:15.002287    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e7c30b_60b3_4ef9_8082_84156f0244af.slice/crio-01a0ee9d6d33e66cc801c2f99dda4944eaa3f8adc16bbaa06fb3666fa48e5073 WatchSource:0}: Error finding container 01a0ee9d6d33e66cc801c2f99dda4944eaa3f8adc16bbaa06fb3666fa48e5073: Status 404 returned error can't find the container with id 01a0ee9d6d33e66cc801c2f99dda4944eaa3f8adc16bbaa06fb3666fa48e5073
Sep 07 21:25:15.003786 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:15.003767    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 21:25:15.251968 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:15.251885    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh"]
Sep 07 21:25:15.256589 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:15.256573    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh"
Sep 07 21:25:15.259112 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:15.259091    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-4cf126\""
Sep 07 21:25:15.259112 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:15.259098    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-4cf126-dockercfg-xhhmp\""
Sep 07 21:25:15.265275 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:15.265250    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh"]
Sep 07 21:25:15.322652 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:15.322607    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kttw\" (UniqueName: \"kubernetes.io/projected/fa010651-9c98-43a3-82b4-a18869d9c773-kube-api-access-4kttw\") pod \"payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh\" (UID: \"fa010651-9c98-43a3-82b4-a18869d9c773\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh"
Sep 07 21:25:15.322833 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:15.322755    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa010651-9c98-43a3-82b4-a18869d9c773-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh\" (UID: \"fa010651-9c98-43a3-82b4-a18869d9c773\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh"
Sep 07 21:25:15.423909 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:15.423871    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kttw\" (UniqueName: \"kubernetes.io/projected/fa010651-9c98-43a3-82b4-a18869d9c773-kube-api-access-4kttw\") pod \"payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh\" (UID: \"fa010651-9c98-43a3-82b4-a18869d9c773\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh"
Sep 07 21:25:15.424388 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:15.424291    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa010651-9c98-43a3-82b4-a18869d9c773-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh\" (UID: \"fa010651-9c98-43a3-82b4-a18869d9c773\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh"
Sep 07 21:25:15.425140 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:15.425096    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa010651-9c98-43a3-82b4-a18869d9c773-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh\" (UID: \"fa010651-9c98-43a3-82b4-a18869d9c773\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh"
Sep 07 21:25:15.430840 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:15.430819    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kttw\" (UniqueName: \"kubernetes.io/projected/fa010651-9c98-43a3-82b4-a18869d9c773-kube-api-access-4kttw\") pod \"payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh\" (UID: \"fa010651-9c98-43a3-82b4-a18869d9c773\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh"
Sep 07 21:25:15.568639 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:15.568601    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh"
Sep 07 21:25:15.845703 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:15.845675    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh"]
Sep 07 21:25:15.847651 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:25:15.847621    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa010651_9c98_43a3_82b4_a18869d9c773.slice/crio-c851013e10139512fb2524a3bf25819be2c15855a5709c52d5fb0f96b38f346d WatchSource:0}: Error finding container c851013e10139512fb2524a3bf25819be2c15855a5709c52d5fb0f96b38f346d: Status 404 returned error can't find the container with id c851013e10139512fb2524a3bf25819be2c15855a5709c52d5fb0f96b38f346d
Sep 07 21:25:16.003977 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:16.003929    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh" event={"ID":"fa010651-9c98-43a3-82b4-a18869d9c773","Type":"ContainerStarted","Data":"e14989da34f62cdffca1c0206cd7fa1066521366c22cd24a8bc7cd2565e203bb"}
Sep 07 21:25:16.004195 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:16.003994    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh" event={"ID":"fa010651-9c98-43a3-82b4-a18869d9c773","Type":"ContainerStarted","Data":"c851013e10139512fb2524a3bf25819be2c15855a5709c52d5fb0f96b38f346d"}
Sep 07 21:25:16.004195 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:16.004098    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh"
Sep 07 21:25:16.005619 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:16.005590    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5" event={"ID":"e7e7c30b-60b3-4ef9-8082-84156f0244af","Type":"ContainerStarted","Data":"b49faac7a6e72210d33135922e9f564fde61144f125a6aa95c6967c39a453c49"}
Sep 07 21:25:16.005706 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:16.005639    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"
Sep 07 21:25:16.005706 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:16.005656    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5" event={"ID":"e7e7c30b-60b3-4ef9-8082-84156f0244af","Type":"ContainerStarted","Data":"01a0ee9d6d33e66cc801c2f99dda4944eaa3f8adc16bbaa06fb3666fa48e5073"}
Sep 07 21:25:16.020606 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:16.020549    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh" podStartSLOduration=1.02052963 podStartE2EDuration="1.02052963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:25:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:25:16.017605687 +0000 UTC m=+1412.277422961" watchObservedRunningTime="2026-09-07 21:25:16.02052963 +0000 UTC m=+1412.280346877"
Sep 07 21:25:16.038808 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:16.033761    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5" podStartSLOduration=1.6604521330000002 podStartE2EDuration="2.033737754s" totalImagesPullingTime="373.285621ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:25:16.032036903 +0000 UTC m=+1412.291854171" watchObservedRunningTime="2026-09-07 21:25:16.033737754 +0000 UTC m=+1412.293554997"
Sep 07 21:25:22.016909 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:22.016878    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"
Sep 07 21:25:27.014167 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:27.014137    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh"
Sep 07 21:25:44.137380 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.137346    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4"]
Sep 07 21:25:44.141143 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.141118    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4"
Sep 07 21:25:44.143431 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.143411    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-8f54f1-dockercfg-5z5lh\""
Sep 07 21:25:44.143876 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.143856    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-8f54f1\""
Sep 07 21:25:44.158239 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.158213    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4"]
Sep 07 21:25:44.169608 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.169583    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r"]
Sep 07 21:25:44.173612 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.173589    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r"
Sep 07 21:25:44.185764 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.185734    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r"]
Sep 07 21:25:44.221929 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.221895    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3382a58b-ac93-465c-8834-0d3a74be6113-plugins-config-volume\") pod \"payload-processing-e2e-api-b-8f54f1-647457757-dnz2r\" (UID: \"3382a58b-ac93-465c-8834-0d3a74be6113\") " pod="openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r"
Sep 07 21:25:44.222098 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.221943    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dztp\" (UniqueName: \"kubernetes.io/projected/6a5ba75a-2646-431d-a8d6-4c7f3af48562-kube-api-access-8dztp\") pod \"payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4\" (UID: \"6a5ba75a-2646-431d-a8d6-4c7f3af48562\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4"
Sep 07 21:25:44.222098 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.221965    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a5ba75a-2646-431d-a8d6-4c7f3af48562-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4\" (UID: \"6a5ba75a-2646-431d-a8d6-4c7f3af48562\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4"
Sep 07 21:25:44.222098 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.222002    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn8n8\" (UniqueName: \"kubernetes.io/projected/3382a58b-ac93-465c-8834-0d3a74be6113-kube-api-access-rn8n8\") pod \"payload-processing-e2e-api-b-8f54f1-647457757-dnz2r\" (UID: \"3382a58b-ac93-465c-8834-0d3a74be6113\") " pod="openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r"
Sep 07 21:25:44.322887 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.322854    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3382a58b-ac93-465c-8834-0d3a74be6113-plugins-config-volume\") pod \"payload-processing-e2e-api-b-8f54f1-647457757-dnz2r\" (UID: \"3382a58b-ac93-465c-8834-0d3a74be6113\") " pod="openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r"
Sep 07 21:25:44.323056 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.322920    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dztp\" (UniqueName: \"kubernetes.io/projected/6a5ba75a-2646-431d-a8d6-4c7f3af48562-kube-api-access-8dztp\") pod \"payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4\" (UID: \"6a5ba75a-2646-431d-a8d6-4c7f3af48562\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4"
Sep 07 21:25:44.323056 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.322960    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a5ba75a-2646-431d-a8d6-4c7f3af48562-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4\" (UID: \"6a5ba75a-2646-431d-a8d6-4c7f3af48562\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4"
Sep 07 21:25:44.323056 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.322993    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn8n8\" (UniqueName: \"kubernetes.io/projected/3382a58b-ac93-465c-8834-0d3a74be6113-kube-api-access-rn8n8\") pod \"payload-processing-e2e-api-b-8f54f1-647457757-dnz2r\" (UID: \"3382a58b-ac93-465c-8834-0d3a74be6113\") " pod="openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r"
Sep 07 21:25:44.323828 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.323799    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3382a58b-ac93-465c-8834-0d3a74be6113-plugins-config-volume\") pod \"payload-processing-e2e-api-b-8f54f1-647457757-dnz2r\" (UID: \"3382a58b-ac93-465c-8834-0d3a74be6113\") " pod="openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r"
Sep 07 21:25:44.323943 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.323839    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a5ba75a-2646-431d-a8d6-4c7f3af48562-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4\" (UID: \"6a5ba75a-2646-431d-a8d6-4c7f3af48562\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4"
Sep 07 21:25:44.334250 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.334219    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn8n8\" (UniqueName: \"kubernetes.io/projected/3382a58b-ac93-465c-8834-0d3a74be6113-kube-api-access-rn8n8\") pod \"payload-processing-e2e-api-b-8f54f1-647457757-dnz2r\" (UID: \"3382a58b-ac93-465c-8834-0d3a74be6113\") " pod="openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r"
Sep 07 21:25:44.334522 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.334499    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dztp\" (UniqueName: \"kubernetes.io/projected/6a5ba75a-2646-431d-a8d6-4c7f3af48562-kube-api-access-8dztp\") pod \"payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4\" (UID: \"6a5ba75a-2646-431d-a8d6-4c7f3af48562\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4"
Sep 07 21:25:44.431676 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.431598    2558 scope.go:117] "RemoveContainer" containerID="a58699e2ac58850dd97ca57c171ec4be4f09f595149017fdd652647dddd0e338"
Sep 07 21:25:44.451405 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.451376    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4"
Sep 07 21:25:44.487824 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.487791    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r"
Sep 07 21:25:44.724472 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.724444    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4"]
Sep 07 21:25:44.725080 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:25:44.725056    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a5ba75a_2646_431d_a8d6_4c7f3af48562.slice/crio-90ddf0881911c8191e8fdcf0fe649dd750d62564f2514f354ad823140602e454 WatchSource:0}: Error finding container 90ddf0881911c8191e8fdcf0fe649dd750d62564f2514f354ad823140602e454: Status 404 returned error can't find the container with id 90ddf0881911c8191e8fdcf0fe649dd750d62564f2514f354ad823140602e454
Sep 07 21:25:44.781398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:44.781372    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r"]
Sep 07 21:25:44.781931 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:25:44.781912    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3382a58b_ac93_465c_8834_0d3a74be6113.slice/crio-d478ffbe13cfde16be1c6d2292da950846cec51b037fbe36cf26d93ebddb2e72 WatchSource:0}: Error finding container d478ffbe13cfde16be1c6d2292da950846cec51b037fbe36cf26d93ebddb2e72: Status 404 returned error can't find the container with id d478ffbe13cfde16be1c6d2292da950846cec51b037fbe36cf26d93ebddb2e72
Sep 07 21:25:45.192779 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:45.192727    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4" event={"ID":"6a5ba75a-2646-431d-a8d6-4c7f3af48562","Type":"ContainerStarted","Data":"83d551825c919b8f8830efd9254133b2b23270dd903250d69108540446dfe644"}
Sep 07 21:25:45.193296 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:45.192830    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4" event={"ID":"6a5ba75a-2646-431d-a8d6-4c7f3af48562","Type":"ContainerStarted","Data":"90ddf0881911c8191e8fdcf0fe649dd750d62564f2514f354ad823140602e454"}
Sep 07 21:25:45.193296 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:45.192964    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4"
Sep 07 21:25:45.194652 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:45.194630    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r" event={"ID":"3382a58b-ac93-465c-8834-0d3a74be6113","Type":"ContainerStarted","Data":"50c44fc0bbd8fabae78df8774ae0529db77446fb0355ba81c1d52eedf91d20a3"}
Sep 07 21:25:45.194764 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:45.194668    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r" event={"ID":"3382a58b-ac93-465c-8834-0d3a74be6113","Type":"ContainerStarted","Data":"d478ffbe13cfde16be1c6d2292da950846cec51b037fbe36cf26d93ebddb2e72"}
Sep 07 21:25:45.194806 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:45.194766    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r"
Sep 07 21:25:45.227543 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:45.227490    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4" podStartSLOduration=1.227474023 podStartE2EDuration="1.227474023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:25:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:25:45.209723529 +0000 UTC m=+1441.469540949" watchObservedRunningTime="2026-09-07 21:25:45.227474023 +0000 UTC m=+1441.487291304"
Sep 07 21:25:45.228411 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:45.228381    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r" podStartSLOduration=1.228372779 podStartE2EDuration="1.228372779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:25:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:25:45.22616099 +0000 UTC m=+1441.485978252" watchObservedRunningTime="2026-09-07 21:25:45.228372779 +0000 UTC m=+1441.488190064"
Sep 07 21:25:56.203179 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:56.203140    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4"
Sep 07 21:25:56.203617 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:25:56.203218    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r"
Sep 07 21:26:25.417439 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.417394    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"]
Sep 07 21:26:25.417974 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.417639    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5" podUID="e7e7c30b-60b3-4ef9-8082-84156f0244af" containerName="maas-api" containerID="cri-o://b49faac7a6e72210d33135922e9f564fde61144f125a6aa95c6967c39a453c49" gracePeriod=30
Sep 07 21:26:25.479498 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.479466    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh"]
Sep 07 21:26:25.479712 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.479684    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh" podUID="fa010651-9c98-43a3-82b4-a18869d9c773" containerName="payload-pre-processing" containerID="cri-o://e14989da34f62cdffca1c0206cd7fa1066521366c22cd24a8bc7cd2565e203bb" gracePeriod=30
Sep 07 21:26:25.752823 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.752793    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"
Sep 07 21:26:25.789504 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.789478    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh"
Sep 07 21:26:25.826915 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.826879    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7e7c30b-60b3-4ef9-8082-84156f0244af-metrics-certs\") pod \"e7e7c30b-60b3-4ef9-8082-84156f0244af\" (UID: \"e7e7c30b-60b3-4ef9-8082-84156f0244af\") "
Sep 07 21:26:25.827107 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.826941    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tggl\" (UniqueName: \"kubernetes.io/projected/e7e7c30b-60b3-4ef9-8082-84156f0244af-kube-api-access-9tggl\") pod \"e7e7c30b-60b3-4ef9-8082-84156f0244af\" (UID: \"e7e7c30b-60b3-4ef9-8082-84156f0244af\") "
Sep 07 21:26:25.827107 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.827005    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa010651-9c98-43a3-82b4-a18869d9c773-plugins-config-volume\") pod \"fa010651-9c98-43a3-82b4-a18869d9c773\" (UID: \"fa010651-9c98-43a3-82b4-a18869d9c773\") "
Sep 07 21:26:25.827107 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.827031    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7e7c30b-60b3-4ef9-8082-84156f0244af-openshift-service-ca\") pod \"e7e7c30b-60b3-4ef9-8082-84156f0244af\" (UID: \"e7e7c30b-60b3-4ef9-8082-84156f0244af\") "
Sep 07 21:26:25.827297 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.827214    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kttw\" (UniqueName: \"kubernetes.io/projected/fa010651-9c98-43a3-82b4-a18869d9c773-kube-api-access-4kttw\") pod \"fa010651-9c98-43a3-82b4-a18869d9c773\" (UID: \"fa010651-9c98-43a3-82b4-a18869d9c773\") "
Sep 07 21:26:25.827297 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.827263    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7e7c30b-60b3-4ef9-8082-84156f0244af-maas-api-tls\") pod \"e7e7c30b-60b3-4ef9-8082-84156f0244af\" (UID: \"e7e7c30b-60b3-4ef9-8082-84156f0244af\") "
Sep 07 21:26:25.827431 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.827378    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7e7c30b-60b3-4ef9-8082-84156f0244af-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e7e7c30b-60b3-4ef9-8082-84156f0244af" (UID: "e7e7c30b-60b3-4ef9-8082-84156f0244af"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:26:25.827431 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.827411    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa010651-9c98-43a3-82b4-a18869d9c773-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fa010651-9c98-43a3-82b4-a18869d9c773" (UID: "fa010651-9c98-43a3-82b4-a18869d9c773"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:26:25.827857 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.827833    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa010651-9c98-43a3-82b4-a18869d9c773-plugins-config-volume\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:26:25.827857 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.827858    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7e7c30b-60b3-4ef9-8082-84156f0244af-openshift-service-ca\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:26:25.829351 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.829324    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa010651-9c98-43a3-82b4-a18869d9c773-kube-api-access-4kttw" (OuterVolumeSpecName: "kube-api-access-4kttw") pod "fa010651-9c98-43a3-82b4-a18869d9c773" (UID: "fa010651-9c98-43a3-82b4-a18869d9c773"). InnerVolumeSpecName "kube-api-access-4kttw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:26:25.829572 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.829549    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7e7c30b-60b3-4ef9-8082-84156f0244af-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e7e7c30b-60b3-4ef9-8082-84156f0244af" (UID: "e7e7c30b-60b3-4ef9-8082-84156f0244af"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:26:25.829646 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.829628    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7e7c30b-60b3-4ef9-8082-84156f0244af-kube-api-access-9tggl" (OuterVolumeSpecName: "kube-api-access-9tggl") pod "e7e7c30b-60b3-4ef9-8082-84156f0244af" (UID: "e7e7c30b-60b3-4ef9-8082-84156f0244af"). InnerVolumeSpecName "kube-api-access-9tggl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:26:25.829720 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.829706    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7e7c30b-60b3-4ef9-8082-84156f0244af-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e7e7c30b-60b3-4ef9-8082-84156f0244af" (UID: "e7e7c30b-60b3-4ef9-8082-84156f0244af"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:26:25.929071 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.929030    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kttw\" (UniqueName: \"kubernetes.io/projected/fa010651-9c98-43a3-82b4-a18869d9c773-kube-api-access-4kttw\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:26:25.929071 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.929065    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7e7c30b-60b3-4ef9-8082-84156f0244af-maas-api-tls\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:26:25.929071 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.929077    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7e7c30b-60b3-4ef9-8082-84156f0244af-metrics-certs\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:26:25.929349 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:25.929086    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tggl\" (UniqueName: \"kubernetes.io/projected/e7e7c30b-60b3-4ef9-8082-84156f0244af-kube-api-access-9tggl\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:26:26.442193 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:26.442159    2558 generic.go:356] "Generic (PLEG): container finished" podID="e7e7c30b-60b3-4ef9-8082-84156f0244af" containerID="b49faac7a6e72210d33135922e9f564fde61144f125a6aa95c6967c39a453c49" exitCode=0
Sep 07 21:26:26.442611 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:26.442214    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"
Sep 07 21:26:26.442611 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:26.442245    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5" event={"ID":"e7e7c30b-60b3-4ef9-8082-84156f0244af","Type":"ContainerDied","Data":"b49faac7a6e72210d33135922e9f564fde61144f125a6aa95c6967c39a453c49"}
Sep 07 21:26:26.442611 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:26.442301    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5" event={"ID":"e7e7c30b-60b3-4ef9-8082-84156f0244af","Type":"ContainerDied","Data":"01a0ee9d6d33e66cc801c2f99dda4944eaa3f8adc16bbaa06fb3666fa48e5073"}
Sep 07 21:26:26.442611 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:26.442338    2558 scope.go:117] "RemoveContainer" containerID="b49faac7a6e72210d33135922e9f564fde61144f125a6aa95c6967c39a453c49"
Sep 07 21:26:26.444048 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:26.444021    2558 generic.go:356] "Generic (PLEG): container finished" podID="fa010651-9c98-43a3-82b4-a18869d9c773" containerID="e14989da34f62cdffca1c0206cd7fa1066521366c22cd24a8bc7cd2565e203bb" exitCode=0
Sep 07 21:26:26.444172 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:26.444077    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh" event={"ID":"fa010651-9c98-43a3-82b4-a18869d9c773","Type":"ContainerDied","Data":"e14989da34f62cdffca1c0206cd7fa1066521366c22cd24a8bc7cd2565e203bb"}
Sep 07 21:26:26.444172 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:26.444120    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh" event={"ID":"fa010651-9c98-43a3-82b4-a18869d9c773","Type":"ContainerDied","Data":"c851013e10139512fb2524a3bf25819be2c15855a5709c52d5fb0f96b38f346d"}
Sep 07 21:26:26.444172 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:26.444081    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh"
Sep 07 21:26:26.452294 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:26.452273    2558 scope.go:117] "RemoveContainer" containerID="b49faac7a6e72210d33135922e9f564fde61144f125a6aa95c6967c39a453c49"
Sep 07 21:26:26.452587 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:26:26.452570    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b49faac7a6e72210d33135922e9f564fde61144f125a6aa95c6967c39a453c49\": container with ID starting with b49faac7a6e72210d33135922e9f564fde61144f125a6aa95c6967c39a453c49 not found: ID does not exist" containerID="b49faac7a6e72210d33135922e9f564fde61144f125a6aa95c6967c39a453c49"
Sep 07 21:26:26.452653 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:26.452593    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b49faac7a6e72210d33135922e9f564fde61144f125a6aa95c6967c39a453c49"} err="failed to get container status \"b49faac7a6e72210d33135922e9f564fde61144f125a6aa95c6967c39a453c49\": rpc error: code = NotFound desc = could not find container \"b49faac7a6e72210d33135922e9f564fde61144f125a6aa95c6967c39a453c49\": container with ID starting with b49faac7a6e72210d33135922e9f564fde61144f125a6aa95c6967c39a453c49 not found: ID does not exist"
Sep 07 21:26:26.452653 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:26.452610    2558 scope.go:117] "RemoveContainer" containerID="e14989da34f62cdffca1c0206cd7fa1066521366c22cd24a8bc7cd2565e203bb"
Sep 07 21:26:26.458322 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:26.458292    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"]
Sep 07 21:26:26.461176 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:26.461160    2558 scope.go:117] "RemoveContainer" containerID="e14989da34f62cdffca1c0206cd7fa1066521366c22cd24a8bc7cd2565e203bb"
Sep 07 21:26:26.461571 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:26:26.461549    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e14989da34f62cdffca1c0206cd7fa1066521366c22cd24a8bc7cd2565e203bb\": container with ID starting with e14989da34f62cdffca1c0206cd7fa1066521366c22cd24a8bc7cd2565e203bb not found: ID does not exist" containerID="e14989da34f62cdffca1c0206cd7fa1066521366c22cd24a8bc7cd2565e203bb"
Sep 07 21:26:26.461651 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:26.461581    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e14989da34f62cdffca1c0206cd7fa1066521366c22cd24a8bc7cd2565e203bb"} err="failed to get container status \"e14989da34f62cdffca1c0206cd7fa1066521366c22cd24a8bc7cd2565e203bb\": rpc error: code = NotFound desc = could not find container \"e14989da34f62cdffca1c0206cd7fa1066521366c22cd24a8bc7cd2565e203bb\": container with ID starting with e14989da34f62cdffca1c0206cd7fa1066521366c22cd24a8bc7cd2565e203bb not found: ID does not exist"
Sep 07 21:26:26.469647 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:26.469625    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4cf126-7c8cd8b7b6-24xf5"]
Sep 07 21:26:26.481372 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:26.481351    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh"]
Sep 07 21:26:26.484487 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:26.484468    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh"]
Sep 07 21:26:28.309539 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:28.309504    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7e7c30b-60b3-4ef9-8082-84156f0244af" path="/var/lib/kubelet/pods/e7e7c30b-60b3-4ef9-8082-84156f0244af/volumes"
Sep 07 21:26:28.309916 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:28.309856    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa010651-9c98-43a3-82b4-a18869d9c773" path="/var/lib/kubelet/pods/fa010651-9c98-43a3-82b4-a18869d9c773/volumes"
Sep 07 21:26:44.339148 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:44.339118    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-kv96r_d804af86-d937-4ea6-afb8-760911a10437/console-operator/1.log"
Sep 07 21:26:44.359983 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:44.359946    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-kv96r_d804af86-d937-4ea6-afb8-760911a10437/console-operator/1.log"
Sep 07 21:26:48.048186 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.048121    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r"]
Sep 07 21:26:48.048674 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.048522    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r" podUID="3382a58b-ac93-465c-8834-0d3a74be6113" containerName="payload-processing" containerID="cri-o://50c44fc0bbd8fabae78df8774ae0529db77446fb0355ba81c1d52eedf91d20a3" gracePeriod=30
Sep 07 21:26:48.054262 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.054206    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4"]
Sep 07 21:26:48.054915 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.054799    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4" podUID="6a5ba75a-2646-431d-a8d6-4c7f3af48562" containerName="payload-pre-processing" containerID="cri-o://83d551825c919b8f8830efd9254133b2b23270dd903250d69108540446dfe644" gracePeriod=30
Sep 07 21:26:48.308024 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.307996    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r"
Sep 07 21:26:48.345898 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.345872    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4"
Sep 07 21:26:48.448277 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.448243    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dztp\" (UniqueName: \"kubernetes.io/projected/6a5ba75a-2646-431d-a8d6-4c7f3af48562-kube-api-access-8dztp\") pod \"6a5ba75a-2646-431d-a8d6-4c7f3af48562\" (UID: \"6a5ba75a-2646-431d-a8d6-4c7f3af48562\") "
Sep 07 21:26:48.448463 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.448356    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3382a58b-ac93-465c-8834-0d3a74be6113-plugins-config-volume\") pod \"3382a58b-ac93-465c-8834-0d3a74be6113\" (UID: \"3382a58b-ac93-465c-8834-0d3a74be6113\") "
Sep 07 21:26:48.448463 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.448406    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rn8n8\" (UniqueName: \"kubernetes.io/projected/3382a58b-ac93-465c-8834-0d3a74be6113-kube-api-access-rn8n8\") pod \"3382a58b-ac93-465c-8834-0d3a74be6113\" (UID: \"3382a58b-ac93-465c-8834-0d3a74be6113\") "
Sep 07 21:26:48.448463 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.448448    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a5ba75a-2646-431d-a8d6-4c7f3af48562-plugins-config-volume\") pod \"6a5ba75a-2646-431d-a8d6-4c7f3af48562\" (UID: \"6a5ba75a-2646-431d-a8d6-4c7f3af48562\") "
Sep 07 21:26:48.448783 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.448749    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3382a58b-ac93-465c-8834-0d3a74be6113-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3382a58b-ac93-465c-8834-0d3a74be6113" (UID: "3382a58b-ac93-465c-8834-0d3a74be6113"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:26:48.448944 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.448866    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a5ba75a-2646-431d-a8d6-4c7f3af48562-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6a5ba75a-2646-431d-a8d6-4c7f3af48562" (UID: "6a5ba75a-2646-431d-a8d6-4c7f3af48562"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:26:48.450552 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.450532    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a5ba75a-2646-431d-a8d6-4c7f3af48562-kube-api-access-8dztp" (OuterVolumeSpecName: "kube-api-access-8dztp") pod "6a5ba75a-2646-431d-a8d6-4c7f3af48562" (UID: "6a5ba75a-2646-431d-a8d6-4c7f3af48562"). InnerVolumeSpecName "kube-api-access-8dztp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:26:48.450552 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.450540    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3382a58b-ac93-465c-8834-0d3a74be6113-kube-api-access-rn8n8" (OuterVolumeSpecName: "kube-api-access-rn8n8") pod "3382a58b-ac93-465c-8834-0d3a74be6113" (UID: "3382a58b-ac93-465c-8834-0d3a74be6113"). InnerVolumeSpecName "kube-api-access-rn8n8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:26:48.550219 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.550184    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a5ba75a-2646-431d-a8d6-4c7f3af48562-plugins-config-volume\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:26:48.550219 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.550211    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dztp\" (UniqueName: \"kubernetes.io/projected/6a5ba75a-2646-431d-a8d6-4c7f3af48562-kube-api-access-8dztp\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:26:48.550219 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.550220    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3382a58b-ac93-465c-8834-0d3a74be6113-plugins-config-volume\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:26:48.550481 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.550229    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rn8n8\" (UniqueName: \"kubernetes.io/projected/3382a58b-ac93-465c-8834-0d3a74be6113-kube-api-access-rn8n8\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:26:48.582291 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.582212    2558 generic.go:356] "Generic (PLEG): container finished" podID="3382a58b-ac93-465c-8834-0d3a74be6113" containerID="50c44fc0bbd8fabae78df8774ae0529db77446fb0355ba81c1d52eedf91d20a3" exitCode=0
Sep 07 21:26:48.582291 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.582265    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r"
Sep 07 21:26:48.582513 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.582294    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r" event={"ID":"3382a58b-ac93-465c-8834-0d3a74be6113","Type":"ContainerDied","Data":"50c44fc0bbd8fabae78df8774ae0529db77446fb0355ba81c1d52eedf91d20a3"}
Sep 07 21:26:48.582513 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.582400    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r" event={"ID":"3382a58b-ac93-465c-8834-0d3a74be6113","Type":"ContainerDied","Data":"d478ffbe13cfde16be1c6d2292da950846cec51b037fbe36cf26d93ebddb2e72"}
Sep 07 21:26:48.582513 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.582428    2558 scope.go:117] "RemoveContainer" containerID="50c44fc0bbd8fabae78df8774ae0529db77446fb0355ba81c1d52eedf91d20a3"
Sep 07 21:26:48.583827 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.583802    2558 generic.go:356] "Generic (PLEG): container finished" podID="6a5ba75a-2646-431d-a8d6-4c7f3af48562" containerID="83d551825c919b8f8830efd9254133b2b23270dd903250d69108540446dfe644" exitCode=0
Sep 07 21:26:48.583940 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.583845    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4" event={"ID":"6a5ba75a-2646-431d-a8d6-4c7f3af48562","Type":"ContainerDied","Data":"83d551825c919b8f8830efd9254133b2b23270dd903250d69108540446dfe644"}
Sep 07 21:26:48.583940 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.583897    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4" event={"ID":"6a5ba75a-2646-431d-a8d6-4c7f3af48562","Type":"ContainerDied","Data":"90ddf0881911c8191e8fdcf0fe649dd750d62564f2514f354ad823140602e454"}
Sep 07 21:26:48.583940 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.583855    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4"
Sep 07 21:26:48.593052 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.593037    2558 scope.go:117] "RemoveContainer" containerID="50c44fc0bbd8fabae78df8774ae0529db77446fb0355ba81c1d52eedf91d20a3"
Sep 07 21:26:48.593429 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:26:48.593353    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50c44fc0bbd8fabae78df8774ae0529db77446fb0355ba81c1d52eedf91d20a3\": container with ID starting with 50c44fc0bbd8fabae78df8774ae0529db77446fb0355ba81c1d52eedf91d20a3 not found: ID does not exist" containerID="50c44fc0bbd8fabae78df8774ae0529db77446fb0355ba81c1d52eedf91d20a3"
Sep 07 21:26:48.593429 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.593380    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50c44fc0bbd8fabae78df8774ae0529db77446fb0355ba81c1d52eedf91d20a3"} err="failed to get container status \"50c44fc0bbd8fabae78df8774ae0529db77446fb0355ba81c1d52eedf91d20a3\": rpc error: code = NotFound desc = could not find container \"50c44fc0bbd8fabae78df8774ae0529db77446fb0355ba81c1d52eedf91d20a3\": container with ID starting with 50c44fc0bbd8fabae78df8774ae0529db77446fb0355ba81c1d52eedf91d20a3 not found: ID does not exist"
Sep 07 21:26:48.593429 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.593396    2558 scope.go:117] "RemoveContainer" containerID="83d551825c919b8f8830efd9254133b2b23270dd903250d69108540446dfe644"
Sep 07 21:26:48.602860 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.602841    2558 scope.go:117] "RemoveContainer" containerID="83d551825c919b8f8830efd9254133b2b23270dd903250d69108540446dfe644"
Sep 07 21:26:48.603132 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:26:48.603110    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83d551825c919b8f8830efd9254133b2b23270dd903250d69108540446dfe644\": container with ID starting with 83d551825c919b8f8830efd9254133b2b23270dd903250d69108540446dfe644 not found: ID does not exist" containerID="83d551825c919b8f8830efd9254133b2b23270dd903250d69108540446dfe644"
Sep 07 21:26:48.603227 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.603136    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83d551825c919b8f8830efd9254133b2b23270dd903250d69108540446dfe644"} err="failed to get container status \"83d551825c919b8f8830efd9254133b2b23270dd903250d69108540446dfe644\": rpc error: code = NotFound desc = could not find container \"83d551825c919b8f8830efd9254133b2b23270dd903250d69108540446dfe644\": container with ID starting with 83d551825c919b8f8830efd9254133b2b23270dd903250d69108540446dfe644 not found: ID does not exist"
Sep 07 21:26:48.605255 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.605231    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r"]
Sep 07 21:26:48.608554 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.608533    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r"]
Sep 07 21:26:48.618166 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.618146    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4"]
Sep 07 21:26:48.623874 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:48.623854    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4"]
Sep 07 21:26:50.309020 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:50.308985    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3382a58b-ac93-465c-8834-0d3a74be6113" path="/var/lib/kubelet/pods/3382a58b-ac93-465c-8834-0d3a74be6113/volumes"
Sep 07 21:26:50.309398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:26:50.309388    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a5ba75a-2646-431d-a8d6-4c7f3af48562" path="/var/lib/kubelet/pods/6a5ba75a-2646-431d-a8d6-4c7f3af48562/volumes"
Sep 07 21:27:05.366437 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:05.366403    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7"]
Sep 07 21:27:05.367089 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:05.366686    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7" podUID="a90f24c5-a982-4e10-a51a-195c314cdcf8" containerName="payload-pre-processing" containerID="cri-o://b4ae912031247c243fb531b20820ece4ad938a1a9beee1ef9f23f073f7718886" gracePeriod=30
Sep 07 21:27:05.639651 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:05.639624    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7"
Sep 07 21:27:05.683757 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:05.683726    2558 generic.go:356] "Generic (PLEG): container finished" podID="a90f24c5-a982-4e10-a51a-195c314cdcf8" containerID="b4ae912031247c243fb531b20820ece4ad938a1a9beee1ef9f23f073f7718886" exitCode=0
Sep 07 21:27:05.683945 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:05.683774    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7"
Sep 07 21:27:05.683945 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:05.683818    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7" event={"ID":"a90f24c5-a982-4e10-a51a-195c314cdcf8","Type":"ContainerDied","Data":"b4ae912031247c243fb531b20820ece4ad938a1a9beee1ef9f23f073f7718886"}
Sep 07 21:27:05.683945 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:05.683903    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7" event={"ID":"a90f24c5-a982-4e10-a51a-195c314cdcf8","Type":"ContainerDied","Data":"08690992ae297d1203340713d5ca6b4036762b4a13d028a3fd41bbeb2089df2a"}
Sep 07 21:27:05.683945 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:05.683925    2558 scope.go:117] "RemoveContainer" containerID="b4ae912031247c243fb531b20820ece4ad938a1a9beee1ef9f23f073f7718886"
Sep 07 21:27:05.701241 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:05.701216    2558 scope.go:117] "RemoveContainer" containerID="b4ae912031247c243fb531b20820ece4ad938a1a9beee1ef9f23f073f7718886"
Sep 07 21:27:05.702492 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:27:05.702464    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4ae912031247c243fb531b20820ece4ad938a1a9beee1ef9f23f073f7718886\": container with ID starting with b4ae912031247c243fb531b20820ece4ad938a1a9beee1ef9f23f073f7718886 not found: ID does not exist" containerID="b4ae912031247c243fb531b20820ece4ad938a1a9beee1ef9f23f073f7718886"
Sep 07 21:27:05.702621 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:05.702514    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4ae912031247c243fb531b20820ece4ad938a1a9beee1ef9f23f073f7718886"} err="failed to get container status \"b4ae912031247c243fb531b20820ece4ad938a1a9beee1ef9f23f073f7718886\": rpc error: code = NotFound desc = could not find container \"b4ae912031247c243fb531b20820ece4ad938a1a9beee1ef9f23f073f7718886\": container with ID starting with b4ae912031247c243fb531b20820ece4ad938a1a9beee1ef9f23f073f7718886 not found: ID does not exist"
Sep 07 21:27:05.712774 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:05.712743    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a90f24c5-a982-4e10-a51a-195c314cdcf8-plugins-config-volume\") pod \"a90f24c5-a982-4e10-a51a-195c314cdcf8\" (UID: \"a90f24c5-a982-4e10-a51a-195c314cdcf8\") "
Sep 07 21:27:05.712935 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:05.712801    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxfd6\" (UniqueName: \"kubernetes.io/projected/a90f24c5-a982-4e10-a51a-195c314cdcf8-kube-api-access-cxfd6\") pod \"a90f24c5-a982-4e10-a51a-195c314cdcf8\" (UID: \"a90f24c5-a982-4e10-a51a-195c314cdcf8\") "
Sep 07 21:27:05.713395 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:05.713363    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a90f24c5-a982-4e10-a51a-195c314cdcf8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a90f24c5-a982-4e10-a51a-195c314cdcf8" (UID: "a90f24c5-a982-4e10-a51a-195c314cdcf8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:27:05.719656 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:05.719591    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a90f24c5-a982-4e10-a51a-195c314cdcf8-kube-api-access-cxfd6" (OuterVolumeSpecName: "kube-api-access-cxfd6") pod "a90f24c5-a982-4e10-a51a-195c314cdcf8" (UID: "a90f24c5-a982-4e10-a51a-195c314cdcf8"). InnerVolumeSpecName "kube-api-access-cxfd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:27:05.814540 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:05.814510    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a90f24c5-a982-4e10-a51a-195c314cdcf8-plugins-config-volume\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:27:05.814540 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:05.814535    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxfd6\" (UniqueName: \"kubernetes.io/projected/a90f24c5-a982-4e10-a51a-195c314cdcf8-kube-api-access-cxfd6\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:27:06.018841 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:06.018805    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7"]
Sep 07 21:27:06.027433 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:06.027403    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7"]
Sep 07 21:27:06.308712 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:06.308685    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a90f24c5-a982-4e10-a51a-195c314cdcf8" path="/var/lib/kubelet/pods/a90f24c5-a982-4e10-a51a-195c314cdcf8/volumes"
Sep 07 21:27:22.523768 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:22.523733    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"]
Sep 07 21:27:22.524182 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:22.524004    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb" podUID="b81df386-d787-41ea-bc9b-9217583e3eaa" containerName="maas-api" containerID="cri-o://7bb35988c8a17b3a7e355924a02da5fa895d01ed543958f4861d75615575d0e5" gracePeriod=30
Sep 07 21:27:22.541935 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:22.541786    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb" podUID="b81df386-d787-41ea-bc9b-9217583e3eaa" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.68:8443/health\": dial tcp 10.133.0.68:8443: connect: connection refused"
Sep 07 21:27:22.782489 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:22.782427    2558 generic.go:356] "Generic (PLEG): container finished" podID="b81df386-d787-41ea-bc9b-9217583e3eaa" containerID="7bb35988c8a17b3a7e355924a02da5fa895d01ed543958f4861d75615575d0e5" exitCode=0
Sep 07 21:27:22.782603 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:22.782500    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb" event={"ID":"b81df386-d787-41ea-bc9b-9217583e3eaa","Type":"ContainerDied","Data":"7bb35988c8a17b3a7e355924a02da5fa895d01ed543958f4861d75615575d0e5"}
Sep 07 21:27:22.782603 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:22.782550    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb" event={"ID":"b81df386-d787-41ea-bc9b-9217583e3eaa","Type":"ContainerDied","Data":"b9752a614fe2a146e1b10c6f9e7eb37b6e6cb4749a475ce5a83a43e5283de1bd"}
Sep 07 21:27:22.782603 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:22.782571    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9752a614fe2a146e1b10c6f9e7eb37b6e6cb4749a475ce5a83a43e5283de1bd"
Sep 07 21:27:22.784348 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:22.784302    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"
Sep 07 21:27:22.880216 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:22.880189    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b81df386-d787-41ea-bc9b-9217583e3eaa-openshift-service-ca\") pod \"b81df386-d787-41ea-bc9b-9217583e3eaa\" (UID: \"b81df386-d787-41ea-bc9b-9217583e3eaa\") "
Sep 07 21:27:22.880419 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:22.880245    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2tws\" (UniqueName: \"kubernetes.io/projected/b81df386-d787-41ea-bc9b-9217583e3eaa-kube-api-access-d2tws\") pod \"b81df386-d787-41ea-bc9b-9217583e3eaa\" (UID: \"b81df386-d787-41ea-bc9b-9217583e3eaa\") "
Sep 07 21:27:22.880419 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:22.880284    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b81df386-d787-41ea-bc9b-9217583e3eaa-metrics-certs\") pod \"b81df386-d787-41ea-bc9b-9217583e3eaa\" (UID: \"b81df386-d787-41ea-bc9b-9217583e3eaa\") "
Sep 07 21:27:22.880541 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:22.880460    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b81df386-d787-41ea-bc9b-9217583e3eaa-maas-api-tls\") pod \"b81df386-d787-41ea-bc9b-9217583e3eaa\" (UID: \"b81df386-d787-41ea-bc9b-9217583e3eaa\") "
Sep 07 21:27:22.880621 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:22.880598    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b81df386-d787-41ea-bc9b-9217583e3eaa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b81df386-d787-41ea-bc9b-9217583e3eaa" (UID: "b81df386-d787-41ea-bc9b-9217583e3eaa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:27:22.880842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:22.880825    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b81df386-d787-41ea-bc9b-9217583e3eaa-openshift-service-ca\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:27:22.882417 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:22.882392    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b81df386-d787-41ea-bc9b-9217583e3eaa-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b81df386-d787-41ea-bc9b-9217583e3eaa" (UID: "b81df386-d787-41ea-bc9b-9217583e3eaa"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:27:22.882509 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:22.882421    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b81df386-d787-41ea-bc9b-9217583e3eaa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b81df386-d787-41ea-bc9b-9217583e3eaa" (UID: "b81df386-d787-41ea-bc9b-9217583e3eaa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:27:22.882509 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:22.882494    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b81df386-d787-41ea-bc9b-9217583e3eaa-kube-api-access-d2tws" (OuterVolumeSpecName: "kube-api-access-d2tws") pod "b81df386-d787-41ea-bc9b-9217583e3eaa" (UID: "b81df386-d787-41ea-bc9b-9217583e3eaa"). InnerVolumeSpecName "kube-api-access-d2tws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:27:22.981546 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:22.981513    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b81df386-d787-41ea-bc9b-9217583e3eaa-maas-api-tls\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:27:22.981546 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:22.981538    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2tws\" (UniqueName: \"kubernetes.io/projected/b81df386-d787-41ea-bc9b-9217583e3eaa-kube-api-access-d2tws\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:27:22.981546 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:22.981548    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b81df386-d787-41ea-bc9b-9217583e3eaa-metrics-certs\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:27:23.788061 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:23.788027    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"
Sep 07 21:27:23.816328 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:23.816274    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"]
Sep 07 21:27:23.816585 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:23.816566    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b9edc3-6bcbd578-sk8qb"]
Sep 07 21:27:24.310975 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:24.310940    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b81df386-d787-41ea-bc9b-9217583e3eaa" path="/var/lib/kubelet/pods/b81df386-d787-41ea-bc9b-9217583e3eaa/volumes"
Sep 07 21:27:44.489227 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:44.489195    2558 scope.go:117] "RemoveContainer" containerID="7bb35988c8a17b3a7e355924a02da5fa895d01ed543958f4861d75615575d0e5"
Sep 07 21:27:52.030586 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.030546    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws"]
Sep 07 21:27:52.031050 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.030972    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b81df386-d787-41ea-bc9b-9217583e3eaa" containerName="maas-api"
Sep 07 21:27:52.031050 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.030983    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b81df386-d787-41ea-bc9b-9217583e3eaa" containerName="maas-api"
Sep 07 21:27:52.031050 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.031000    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3382a58b-ac93-465c-8834-0d3a74be6113" containerName="payload-processing"
Sep 07 21:27:52.031050 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.031006    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3382a58b-ac93-465c-8834-0d3a74be6113" containerName="payload-processing"
Sep 07 21:27:52.031050 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.031020    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a90f24c5-a982-4e10-a51a-195c314cdcf8" containerName="payload-pre-processing"
Sep 07 21:27:52.031050 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.031026    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a90f24c5-a982-4e10-a51a-195c314cdcf8" containerName="payload-pre-processing"
Sep 07 21:27:52.031050 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.031038    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa010651-9c98-43a3-82b4-a18869d9c773" containerName="payload-pre-processing"
Sep 07 21:27:52.031050 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.031043    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa010651-9c98-43a3-82b4-a18869d9c773" containerName="payload-pre-processing"
Sep 07 21:27:52.031050 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.031050    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5ba75a-2646-431d-a8d6-4c7f3af48562" containerName="payload-pre-processing"
Sep 07 21:27:52.031050 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.031054    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5ba75a-2646-431d-a8d6-4c7f3af48562" containerName="payload-pre-processing"
Sep 07 21:27:52.031431 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.031062    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7e7c30b-60b3-4ef9-8082-84156f0244af" containerName="maas-api"
Sep 07 21:27:52.031431 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.031067    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7e7c30b-60b3-4ef9-8082-84156f0244af" containerName="maas-api"
Sep 07 21:27:52.031431 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.031127    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b81df386-d787-41ea-bc9b-9217583e3eaa" containerName="maas-api"
Sep 07 21:27:52.031431 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.031135    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3382a58b-ac93-465c-8834-0d3a74be6113" containerName="payload-processing"
Sep 07 21:27:52.031431 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.031140    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7e7c30b-60b3-4ef9-8082-84156f0244af" containerName="maas-api"
Sep 07 21:27:52.031431 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.031146    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a90f24c5-a982-4e10-a51a-195c314cdcf8" containerName="payload-pre-processing"
Sep 07 21:27:52.031431 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.031151    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa010651-9c98-43a3-82b4-a18869d9c773" containerName="payload-pre-processing"
Sep 07 21:27:52.031431 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.031157    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a5ba75a-2646-431d-a8d6-4c7f3af48562" containerName="payload-pre-processing"
Sep 07 21:27:52.034287 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.034271    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws"
Sep 07 21:27:52.036849 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.036823    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-52269e\""
Sep 07 21:27:52.037008 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.036931    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-52269e-dockercfg-jvtg5\""
Sep 07 21:27:52.044399 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.044374    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws"]
Sep 07 21:27:52.160968 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.160934    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58wwp\" (UniqueName: \"kubernetes.io/projected/d8bf7307-f04b-484d-8559-83e850862f97-kube-api-access-58wwp\") pod \"payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws\" (UID: \"d8bf7307-f04b-484d-8559-83e850862f97\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws"
Sep 07 21:27:52.161133 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.160999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8bf7307-f04b-484d-8559-83e850862f97-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws\" (UID: \"d8bf7307-f04b-484d-8559-83e850862f97\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws"
Sep 07 21:27:52.261577 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.261526    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8bf7307-f04b-484d-8559-83e850862f97-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws\" (UID: \"d8bf7307-f04b-484d-8559-83e850862f97\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws"
Sep 07 21:27:52.261762 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.261645    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58wwp\" (UniqueName: \"kubernetes.io/projected/d8bf7307-f04b-484d-8559-83e850862f97-kube-api-access-58wwp\") pod \"payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws\" (UID: \"d8bf7307-f04b-484d-8559-83e850862f97\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws"
Sep 07 21:27:52.262231 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.262209    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8bf7307-f04b-484d-8559-83e850862f97-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws\" (UID: \"d8bf7307-f04b-484d-8559-83e850862f97\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws"
Sep 07 21:27:52.269740 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.269713    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58wwp\" (UniqueName: \"kubernetes.io/projected/d8bf7307-f04b-484d-8559-83e850862f97-kube-api-access-58wwp\") pod \"payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws\" (UID: \"d8bf7307-f04b-484d-8559-83e850862f97\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws"
Sep 07 21:27:52.346236 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.346200    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws"
Sep 07 21:27:52.619752 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.619721    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws"]
Sep 07 21:27:52.620504 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:27:52.620477    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8bf7307_f04b_484d_8559_83e850862f97.slice/crio-17f2f04563d7a744951355ecf6a71a47696ffecb60f569a3fd7dbc588fb7aaca WatchSource:0}: Error finding container 17f2f04563d7a744951355ecf6a71a47696ffecb60f569a3fd7dbc588fb7aaca: Status 404 returned error can't find the container with id 17f2f04563d7a744951355ecf6a71a47696ffecb60f569a3fd7dbc588fb7aaca
Sep 07 21:27:52.954429 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.954291    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws" event={"ID":"d8bf7307-f04b-484d-8559-83e850862f97","Type":"ContainerStarted","Data":"0a3ed9d6a2700a1cca5729fc1abb36b4d8d8da1f8c84f9ebb6bbbf4e7ced54df"}
Sep 07 21:27:52.954429 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.954401    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws"
Sep 07 21:27:52.954429 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.954427    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws" event={"ID":"d8bf7307-f04b-484d-8559-83e850862f97","Type":"ContainerStarted","Data":"17f2f04563d7a744951355ecf6a71a47696ffecb60f569a3fd7dbc588fb7aaca"}
Sep 07 21:27:52.972889 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:27:52.972830    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws" podStartSLOduration=0.972810238 podStartE2EDuration="972.810238ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:27:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:27:52.969116316 +0000 UTC m=+1569.228933586" watchObservedRunningTime="2026-09-07 21:27:52.972810238 +0000 UTC m=+1569.232627485"
Sep 07 21:28:03.962275 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:03.962239    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws"
Sep 07 21:28:20.381808 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:20.381769    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"]
Sep 07 21:28:20.385752 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:20.385733    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"
Sep 07 21:28:20.388142 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:20.388121    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-629e95-serving-cert\""
Sep 07 21:28:20.397468 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:20.397443    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"]
Sep 07 21:28:20.445402 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:20.445365    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z8df\" (UniqueName: \"kubernetes.io/projected/5f24aecc-4569-4712-a0e3-7b1009af30df-kube-api-access-5z8df\") pod \"maas-api-e2e-ipp-b-629e95-57574db996-vbmxb\" (UID: \"5f24aecc-4569-4712-a0e3-7b1009af30df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"
Sep 07 21:28:20.445602 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:20.445409    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f24aecc-4569-4712-a0e3-7b1009af30df-metrics-certs\") pod \"maas-api-e2e-ipp-b-629e95-57574db996-vbmxb\" (UID: \"5f24aecc-4569-4712-a0e3-7b1009af30df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"
Sep 07 21:28:20.445602 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:20.445442    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f24aecc-4569-4712-a0e3-7b1009af30df-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-629e95-57574db996-vbmxb\" (UID: \"5f24aecc-4569-4712-a0e3-7b1009af30df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"
Sep 07 21:28:20.445602 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:20.445539    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f24aecc-4569-4712-a0e3-7b1009af30df-maas-api-tls\") pod \"maas-api-e2e-ipp-b-629e95-57574db996-vbmxb\" (UID: \"5f24aecc-4569-4712-a0e3-7b1009af30df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"
Sep 07 21:28:20.546743 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:20.546703    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z8df\" (UniqueName: \"kubernetes.io/projected/5f24aecc-4569-4712-a0e3-7b1009af30df-kube-api-access-5z8df\") pod \"maas-api-e2e-ipp-b-629e95-57574db996-vbmxb\" (UID: \"5f24aecc-4569-4712-a0e3-7b1009af30df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"
Sep 07 21:28:20.546946 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:20.546751    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f24aecc-4569-4712-a0e3-7b1009af30df-metrics-certs\") pod \"maas-api-e2e-ipp-b-629e95-57574db996-vbmxb\" (UID: \"5f24aecc-4569-4712-a0e3-7b1009af30df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"
Sep 07 21:28:20.546946 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:20.546876    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f24aecc-4569-4712-a0e3-7b1009af30df-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-629e95-57574db996-vbmxb\" (UID: \"5f24aecc-4569-4712-a0e3-7b1009af30df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"
Sep 07 21:28:20.546946 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:20.546932    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f24aecc-4569-4712-a0e3-7b1009af30df-maas-api-tls\") pod \"maas-api-e2e-ipp-b-629e95-57574db996-vbmxb\" (UID: \"5f24aecc-4569-4712-a0e3-7b1009af30df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"
Sep 07 21:28:20.547222 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:28:20.547031    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-serving-cert: secret "maas-api-e2e-ipp-b-629e95-serving-cert" not found
Sep 07 21:28:20.547222 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:28:20.547110    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f24aecc-4569-4712-a0e3-7b1009af30df-maas-api-tls podName:5f24aecc-4569-4712-a0e3-7b1009af30df nodeName:}" failed. No retries permitted until 2026-09-07 21:28:21.04708841 +0000 UTC m=+1597.306905635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5f24aecc-4569-4712-a0e3-7b1009af30df-maas-api-tls") pod "maas-api-e2e-ipp-b-629e95-57574db996-vbmxb" (UID: "5f24aecc-4569-4712-a0e3-7b1009af30df") : secret "maas-api-e2e-ipp-b-629e95-serving-cert" not found
Sep 07 21:28:20.547518 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:20.547499    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f24aecc-4569-4712-a0e3-7b1009af30df-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-629e95-57574db996-vbmxb\" (UID: \"5f24aecc-4569-4712-a0e3-7b1009af30df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"
Sep 07 21:28:20.549353 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:20.549332    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f24aecc-4569-4712-a0e3-7b1009af30df-metrics-certs\") pod \"maas-api-e2e-ipp-b-629e95-57574db996-vbmxb\" (UID: \"5f24aecc-4569-4712-a0e3-7b1009af30df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"
Sep 07 21:28:20.554942 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:20.554917    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z8df\" (UniqueName: \"kubernetes.io/projected/5f24aecc-4569-4712-a0e3-7b1009af30df-kube-api-access-5z8df\") pod \"maas-api-e2e-ipp-b-629e95-57574db996-vbmxb\" (UID: \"5f24aecc-4569-4712-a0e3-7b1009af30df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"
Sep 07 21:28:21.054921 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:21.054883    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f24aecc-4569-4712-a0e3-7b1009af30df-maas-api-tls\") pod \"maas-api-e2e-ipp-b-629e95-57574db996-vbmxb\" (UID: \"5f24aecc-4569-4712-a0e3-7b1009af30df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"
Sep 07 21:28:21.057440 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:21.057411    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f24aecc-4569-4712-a0e3-7b1009af30df-maas-api-tls\") pod \"maas-api-e2e-ipp-b-629e95-57574db996-vbmxb\" (UID: \"5f24aecc-4569-4712-a0e3-7b1009af30df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"
Sep 07 21:28:21.301141 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:21.301102    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"
Sep 07 21:28:21.576417 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:21.576386    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"]
Sep 07 21:28:21.577716 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:28:21.577692    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f24aecc_4569_4712_a0e3_7b1009af30df.slice/crio-73930ea1e10e308dcf2922ec5acc39937f1a4c905b565a23cc34c229e338dc67 WatchSource:0}: Error finding container 73930ea1e10e308dcf2922ec5acc39937f1a4c905b565a23cc34c229e338dc67: Status 404 returned error can't find the container with id 73930ea1e10e308dcf2922ec5acc39937f1a4c905b565a23cc34c229e338dc67
Sep 07 21:28:22.131626 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:22.131595    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb" event={"ID":"5f24aecc-4569-4712-a0e3-7b1009af30df","Type":"ContainerStarted","Data":"5620708ade38a007d95d8d536102270f63e6274259e964383ca55f731b933906"}
Sep 07 21:28:22.131819 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:22.131654    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb" event={"ID":"5f24aecc-4569-4712-a0e3-7b1009af30df","Type":"ContainerStarted","Data":"73930ea1e10e308dcf2922ec5acc39937f1a4c905b565a23cc34c229e338dc67"}
Sep 07 21:28:22.131819 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:22.131686    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"
Sep 07 21:28:22.151520 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:22.151426    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb" podStartSLOduration=1.836759429 podStartE2EDuration="2.1514106s" totalImagesPullingTime="314.651171ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:28:22.150463599 +0000 UTC m=+1598.410280865" watchObservedRunningTime="2026-09-07 21:28:22.1514106 +0000 UTC m=+1598.411227842"
Sep 07 21:28:28.142767 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:28:28.142736    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"
Sep 07 21:29:24.800025 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:24.799990    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"]
Sep 07 21:29:24.804417 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:24.804392    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"
Sep 07 21:29:24.806522 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:24.806499    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-f420a1-serving-cert\""
Sep 07 21:29:24.814667 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:24.814642    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"]
Sep 07 21:29:24.981200 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:24.981164    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b104c1f4-9c9b-485c-a06c-159a3048c4c2-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6\" (UID: \"b104c1f4-9c9b-485c-a06c-159a3048c4c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"
Sep 07 21:29:24.981424 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:24.981212    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnskh\" (UniqueName: \"kubernetes.io/projected/b104c1f4-9c9b-485c-a06c-159a3048c4c2-kube-api-access-dnskh\") pod \"maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6\" (UID: \"b104c1f4-9c9b-485c-a06c-159a3048c4c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"
Sep 07 21:29:24.981424 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:24.981242    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b104c1f4-9c9b-485c-a06c-159a3048c4c2-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6\" (UID: \"b104c1f4-9c9b-485c-a06c-159a3048c4c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"
Sep 07 21:29:24.981424 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:24.981297    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b104c1f4-9c9b-485c-a06c-159a3048c4c2-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6\" (UID: \"b104c1f4-9c9b-485c-a06c-159a3048c4c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"
Sep 07 21:29:25.082288 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.082257    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b104c1f4-9c9b-485c-a06c-159a3048c4c2-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6\" (UID: \"b104c1f4-9c9b-485c-a06c-159a3048c4c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"
Sep 07 21:29:25.082462 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.082296    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b104c1f4-9c9b-485c-a06c-159a3048c4c2-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6\" (UID: \"b104c1f4-9c9b-485c-a06c-159a3048c4c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"
Sep 07 21:29:25.082462 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:29:25.082447    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-serving-cert: secret "maas-api-e2e-ipp-cleanup-f420a1-serving-cert" not found
Sep 07 21:29:25.082544 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.082450    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b104c1f4-9c9b-485c-a06c-159a3048c4c2-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6\" (UID: \"b104c1f4-9c9b-485c-a06c-159a3048c4c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"
Sep 07 21:29:25.082544 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:29:25.082535    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b104c1f4-9c9b-485c-a06c-159a3048c4c2-maas-api-tls podName:b104c1f4-9c9b-485c-a06c-159a3048c4c2 nodeName:}" failed. No retries permitted until 2026-09-07 21:29:25.582513105 +0000 UTC m=+1661.842330332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b104c1f4-9c9b-485c-a06c-159a3048c4c2-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6" (UID: "b104c1f4-9c9b-485c-a06c-159a3048c4c2") : secret "maas-api-e2e-ipp-cleanup-f420a1-serving-cert" not found
Sep 07 21:29:25.082648 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.082590    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnskh\" (UniqueName: \"kubernetes.io/projected/b104c1f4-9c9b-485c-a06c-159a3048c4c2-kube-api-access-dnskh\") pod \"maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6\" (UID: \"b104c1f4-9c9b-485c-a06c-159a3048c4c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"
Sep 07 21:29:25.083083 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.083062    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b104c1f4-9c9b-485c-a06c-159a3048c4c2-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6\" (UID: \"b104c1f4-9c9b-485c-a06c-159a3048c4c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"
Sep 07 21:29:25.084784 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.084766    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b104c1f4-9c9b-485c-a06c-159a3048c4c2-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6\" (UID: \"b104c1f4-9c9b-485c-a06c-159a3048c4c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"
Sep 07 21:29:25.090708 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.090680    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnskh\" (UniqueName: \"kubernetes.io/projected/b104c1f4-9c9b-485c-a06c-159a3048c4c2-kube-api-access-dnskh\") pod \"maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6\" (UID: \"b104c1f4-9c9b-485c-a06c-159a3048c4c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"
Sep 07 21:29:25.445528 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.445432    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn"]
Sep 07 21:29:25.449425 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.449399    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn"
Sep 07 21:29:25.451787 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.451761    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-f420a1-dockercfg-gjq89\""
Sep 07 21:29:25.451787 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.451774    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-f420a1\""
Sep 07 21:29:25.460479 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.460453    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn"]
Sep 07 21:29:25.588618 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.588581    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6gzj\" (UniqueName: \"kubernetes.io/projected/72e4194e-a849-4298-9b24-7e5105f68232-kube-api-access-h6gzj\") pod \"payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn\" (UID: \"72e4194e-a849-4298-9b24-7e5105f68232\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn"
Sep 07 21:29:25.588819 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.588645    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b104c1f4-9c9b-485c-a06c-159a3048c4c2-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6\" (UID: \"b104c1f4-9c9b-485c-a06c-159a3048c4c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"
Sep 07 21:29:25.588819 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.588708    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72e4194e-a849-4298-9b24-7e5105f68232-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn\" (UID: \"72e4194e-a849-4298-9b24-7e5105f68232\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn"
Sep 07 21:29:25.591109 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.591072    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b104c1f4-9c9b-485c-a06c-159a3048c4c2-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6\" (UID: \"b104c1f4-9c9b-485c-a06c-159a3048c4c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"
Sep 07 21:29:25.690215 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.690174    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6gzj\" (UniqueName: \"kubernetes.io/projected/72e4194e-a849-4298-9b24-7e5105f68232-kube-api-access-h6gzj\") pod \"payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn\" (UID: \"72e4194e-a849-4298-9b24-7e5105f68232\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn"
Sep 07 21:29:25.690439 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.690248    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72e4194e-a849-4298-9b24-7e5105f68232-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn\" (UID: \"72e4194e-a849-4298-9b24-7e5105f68232\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn"
Sep 07 21:29:25.690967 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.690942    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72e4194e-a849-4298-9b24-7e5105f68232-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn\" (UID: \"72e4194e-a849-4298-9b24-7e5105f68232\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn"
Sep 07 21:29:25.697917 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.697865    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6gzj\" (UniqueName: \"kubernetes.io/projected/72e4194e-a849-4298-9b24-7e5105f68232-kube-api-access-h6gzj\") pod \"payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn\" (UID: \"72e4194e-a849-4298-9b24-7e5105f68232\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn"
Sep 07 21:29:25.718160 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.718128    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"
Sep 07 21:29:25.762353 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.762318    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn"
Sep 07 21:29:25.998455 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:25.998430    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"]
Sep 07 21:29:25.999747 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:29:25.999722    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb104c1f4_9c9b_485c_a06c_159a3048c4c2.slice/crio-89a1251d5be35d09aaa8f43357f384c3a1609972ba37f4cf8288ab813f336917 WatchSource:0}: Error finding container 89a1251d5be35d09aaa8f43357f384c3a1609972ba37f4cf8288ab813f336917: Status 404 returned error can't find the container with id 89a1251d5be35d09aaa8f43357f384c3a1609972ba37f4cf8288ab813f336917
Sep 07 21:29:26.066515 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:26.066489    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn"]
Sep 07 21:29:26.067696 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:29:26.067670    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72e4194e_a849_4298_9b24_7e5105f68232.slice/crio-8d88f14c45ff36f6a5c832b2f1e5166a09565147ff8e6847b4b48c6a634c7263 WatchSource:0}: Error finding container 8d88f14c45ff36f6a5c832b2f1e5166a09565147ff8e6847b4b48c6a634c7263: Status 404 returned error can't find the container with id 8d88f14c45ff36f6a5c832b2f1e5166a09565147ff8e6847b4b48c6a634c7263
Sep 07 21:29:26.494595 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:26.494557    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn" event={"ID":"72e4194e-a849-4298-9b24-7e5105f68232","Type":"ContainerStarted","Data":"550631f4d75de6da3c77d13f0367b70b1bb6573e7bc50efc768d0e56f7973b01"}
Sep 07 21:29:26.494802 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:26.494626    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn"
Sep 07 21:29:26.494802 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:26.494651    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn" event={"ID":"72e4194e-a849-4298-9b24-7e5105f68232","Type":"ContainerStarted","Data":"8d88f14c45ff36f6a5c832b2f1e5166a09565147ff8e6847b4b48c6a634c7263"}
Sep 07 21:29:26.496282 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:26.496255    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6" event={"ID":"b104c1f4-9c9b-485c-a06c-159a3048c4c2","Type":"ContainerStarted","Data":"2cbea14e985c61e83c7b7bfae5377f8ad03a3c1a9300847e126abc917674c89b"}
Sep 07 21:29:26.496399 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:26.496296    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6" event={"ID":"b104c1f4-9c9b-485c-a06c-159a3048c4c2","Type":"ContainerStarted","Data":"89a1251d5be35d09aaa8f43357f384c3a1609972ba37f4cf8288ab813f336917"}
Sep 07 21:29:26.496452 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:26.496412    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"
Sep 07 21:29:26.513038 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:26.512989    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn" podStartSLOduration=1.512974363 podStartE2EDuration="1.512974363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:29:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:29:26.509869598 +0000 UTC m=+1662.769686858" watchObservedRunningTime="2026-09-07 21:29:26.512974363 +0000 UTC m=+1662.772791606"
Sep 07 21:29:26.527595 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:26.527539    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6" podStartSLOduration=2.223744952 podStartE2EDuration="2.527520328s" totalImagesPullingTime="303.775376ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:29:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:29:26.524621689 +0000 UTC m=+1662.784438930" watchObservedRunningTime="2026-09-07 21:29:26.527520328 +0000 UTC m=+1662.787337573"
Sep 07 21:29:32.507288 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:32.507259    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"
Sep 07 21:29:37.504374 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:37.504342    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn"
Sep 07 21:29:55.404790 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.404755    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"]
Sep 07 21:29:55.405413 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.405028    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6" podUID="b104c1f4-9c9b-485c-a06c-159a3048c4c2" containerName="maas-api" containerID="cri-o://2cbea14e985c61e83c7b7bfae5377f8ad03a3c1a9300847e126abc917674c89b" gracePeriod=30
Sep 07 21:29:55.469590 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.469557    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn"]
Sep 07 21:29:55.470017 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.469978    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn" podUID="72e4194e-a849-4298-9b24-7e5105f68232" containerName="payload-processing" containerID="cri-o://550631f4d75de6da3c77d13f0367b70b1bb6573e7bc50efc768d0e56f7973b01" gracePeriod=30
Sep 07 21:29:55.673250 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.673165    2558 generic.go:356] "Generic (PLEG): container finished" podID="b104c1f4-9c9b-485c-a06c-159a3048c4c2" containerID="2cbea14e985c61e83c7b7bfae5377f8ad03a3c1a9300847e126abc917674c89b" exitCode=0
Sep 07 21:29:55.673437 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.673275    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6" event={"ID":"b104c1f4-9c9b-485c-a06c-159a3048c4c2","Type":"ContainerDied","Data":"2cbea14e985c61e83c7b7bfae5377f8ad03a3c1a9300847e126abc917674c89b"}
Sep 07 21:29:55.675481 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.675456    2558 generic.go:356] "Generic (PLEG): container finished" podID="72e4194e-a849-4298-9b24-7e5105f68232" containerID="550631f4d75de6da3c77d13f0367b70b1bb6573e7bc50efc768d0e56f7973b01" exitCode=0
Sep 07 21:29:55.675621 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.675488    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn" event={"ID":"72e4194e-a849-4298-9b24-7e5105f68232","Type":"ContainerDied","Data":"550631f4d75de6da3c77d13f0367b70b1bb6573e7bc50efc768d0e56f7973b01"}
Sep 07 21:29:55.748132 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.748109    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"
Sep 07 21:29:55.752773 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.752753    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn"
Sep 07 21:29:55.897096 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.897067    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b104c1f4-9c9b-485c-a06c-159a3048c4c2-maas-api-tls\") pod \"b104c1f4-9c9b-485c-a06c-159a3048c4c2\" (UID: \"b104c1f4-9c9b-485c-a06c-159a3048c4c2\") "
Sep 07 21:29:55.897096 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.897100    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6gzj\" (UniqueName: \"kubernetes.io/projected/72e4194e-a849-4298-9b24-7e5105f68232-kube-api-access-h6gzj\") pod \"72e4194e-a849-4298-9b24-7e5105f68232\" (UID: \"72e4194e-a849-4298-9b24-7e5105f68232\") "
Sep 07 21:29:55.897365 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.897153    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b104c1f4-9c9b-485c-a06c-159a3048c4c2-metrics-certs\") pod \"b104c1f4-9c9b-485c-a06c-159a3048c4c2\" (UID: \"b104c1f4-9c9b-485c-a06c-159a3048c4c2\") "
Sep 07 21:29:55.897365 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.897321    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b104c1f4-9c9b-485c-a06c-159a3048c4c2-openshift-service-ca\") pod \"b104c1f4-9c9b-485c-a06c-159a3048c4c2\" (UID: \"b104c1f4-9c9b-485c-a06c-159a3048c4c2\") "
Sep 07 21:29:55.897452 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.897372    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72e4194e-a849-4298-9b24-7e5105f68232-plugins-config-volume\") pod \"72e4194e-a849-4298-9b24-7e5105f68232\" (UID: \"72e4194e-a849-4298-9b24-7e5105f68232\") "
Sep 07 21:29:55.897452 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.897405    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnskh\" (UniqueName: \"kubernetes.io/projected/b104c1f4-9c9b-485c-a06c-159a3048c4c2-kube-api-access-dnskh\") pod \"b104c1f4-9c9b-485c-a06c-159a3048c4c2\" (UID: \"b104c1f4-9c9b-485c-a06c-159a3048c4c2\") "
Sep 07 21:29:55.897860 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.897826    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72e4194e-a849-4298-9b24-7e5105f68232-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "72e4194e-a849-4298-9b24-7e5105f68232" (UID: "72e4194e-a849-4298-9b24-7e5105f68232"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:29:55.898023 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.897991    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b104c1f4-9c9b-485c-a06c-159a3048c4c2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b104c1f4-9c9b-485c-a06c-159a3048c4c2" (UID: "b104c1f4-9c9b-485c-a06c-159a3048c4c2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:29:55.899199 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.899171    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b104c1f4-9c9b-485c-a06c-159a3048c4c2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b104c1f4-9c9b-485c-a06c-159a3048c4c2" (UID: "b104c1f4-9c9b-485c-a06c-159a3048c4c2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:29:55.899581 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.899559    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72e4194e-a849-4298-9b24-7e5105f68232-kube-api-access-h6gzj" (OuterVolumeSpecName: "kube-api-access-h6gzj") pod "72e4194e-a849-4298-9b24-7e5105f68232" (UID: "72e4194e-a849-4298-9b24-7e5105f68232"). InnerVolumeSpecName "kube-api-access-h6gzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:29:55.899650 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.899585    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b104c1f4-9c9b-485c-a06c-159a3048c4c2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b104c1f4-9c9b-485c-a06c-159a3048c4c2" (UID: "b104c1f4-9c9b-485c-a06c-159a3048c4c2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:29:55.899736 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.899705    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b104c1f4-9c9b-485c-a06c-159a3048c4c2-kube-api-access-dnskh" (OuterVolumeSpecName: "kube-api-access-dnskh") pod "b104c1f4-9c9b-485c-a06c-159a3048c4c2" (UID: "b104c1f4-9c9b-485c-a06c-159a3048c4c2"). InnerVolumeSpecName "kube-api-access-dnskh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:29:55.998895 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.998806    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b104c1f4-9c9b-485c-a06c-159a3048c4c2-metrics-certs\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:29:55.998895 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.998837    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b104c1f4-9c9b-485c-a06c-159a3048c4c2-openshift-service-ca\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:29:55.998895 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.998847    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72e4194e-a849-4298-9b24-7e5105f68232-plugins-config-volume\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:29:55.998895 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.998855    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnskh\" (UniqueName: \"kubernetes.io/projected/b104c1f4-9c9b-485c-a06c-159a3048c4c2-kube-api-access-dnskh\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:29:55.998895 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.998863    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b104c1f4-9c9b-485c-a06c-159a3048c4c2-maas-api-tls\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:29:55.998895 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:55.998873    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6gzj\" (UniqueName: \"kubernetes.io/projected/72e4194e-a849-4298-9b24-7e5105f68232-kube-api-access-h6gzj\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:29:56.682535 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:56.682453    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn"
Sep 07 21:29:56.682535 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:56.682489    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn" event={"ID":"72e4194e-a849-4298-9b24-7e5105f68232","Type":"ContainerDied","Data":"8d88f14c45ff36f6a5c832b2f1e5166a09565147ff8e6847b4b48c6a634c7263"}
Sep 07 21:29:56.683009 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:56.682549    2558 scope.go:117] "RemoveContainer" containerID="550631f4d75de6da3c77d13f0367b70b1bb6573e7bc50efc768d0e56f7973b01"
Sep 07 21:29:56.684180 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:56.684149    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6" event={"ID":"b104c1f4-9c9b-485c-a06c-159a3048c4c2","Type":"ContainerDied","Data":"89a1251d5be35d09aaa8f43357f384c3a1609972ba37f4cf8288ab813f336917"}
Sep 07 21:29:56.684180 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:56.684165    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"
Sep 07 21:29:56.692331 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:56.692300    2558 scope.go:117] "RemoveContainer" containerID="2cbea14e985c61e83c7b7bfae5377f8ad03a3c1a9300847e126abc917674c89b"
Sep 07 21:29:56.701991 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:56.701973    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn"]
Sep 07 21:29:56.706033 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:56.706013    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn"]
Sep 07 21:29:56.715281 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:56.715255    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"]
Sep 07 21:29:56.719497 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:56.719478    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f420a1-54d69c79d8-z4gr6"]
Sep 07 21:29:58.308692 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:58.308661    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72e4194e-a849-4298-9b24-7e5105f68232" path="/var/lib/kubelet/pods/72e4194e-a849-4298-9b24-7e5105f68232/volumes"
Sep 07 21:29:58.309083 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:29:58.309068    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b104c1f4-9c9b-485c-a06c-159a3048c4c2" path="/var/lib/kubelet/pods/b104c1f4-9c9b-485c-a06c-159a3048c4c2/volumes"
Sep 07 21:30:00.137862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:00.137819    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-52269e-29813610-wnnjh"]
Sep 07 21:30:00.138255 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:00.138242    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72e4194e-a849-4298-9b24-7e5105f68232" containerName="payload-processing"
Sep 07 21:30:00.138255 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:00.138256    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="72e4194e-a849-4298-9b24-7e5105f68232" containerName="payload-processing"
Sep 07 21:30:00.138374 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:00.138276    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b104c1f4-9c9b-485c-a06c-159a3048c4c2" containerName="maas-api"
Sep 07 21:30:00.138374 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:00.138282    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b104c1f4-9c9b-485c-a06c-159a3048c4c2" containerName="maas-api"
Sep 07 21:30:00.138441 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:00.138378    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b104c1f4-9c9b-485c-a06c-159a3048c4c2" containerName="maas-api"
Sep 07 21:30:00.138441 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:00.138389    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="72e4194e-a849-4298-9b24-7e5105f68232" containerName="payload-processing"
Sep 07 21:30:00.143063 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:00.143042    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-52269e-29813610-wnnjh"
Sep 07 21:30:00.145305 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:00.145283    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2mv4w\""
Sep 07 21:30:00.153203 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:00.152664    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-52269e-29813610-wnnjh"]
Sep 07 21:30:00.157495 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:00.157469    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-52269e-29813610-wnnjh"
Sep 07 21:30:00.440254 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:00.440227    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-52269e-29813610-wnnjh"]
Sep 07 21:30:00.441621 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:30:00.441588    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod172f4c37_41d1_4044_931a_9909565feee2.slice/crio-6396f4c9149d690be3667b171a61c93e53cafb2d2c77608389a7e7534c9991df WatchSource:0}: Error finding container 6396f4c9149d690be3667b171a61c93e53cafb2d2c77608389a7e7534c9991df: Status 404 returned error can't find the container with id 6396f4c9149d690be3667b171a61c93e53cafb2d2c77608389a7e7534c9991df
Sep 07 21:30:00.718561 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:00.718463    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-52269e-29813610-wnnjh" event={"ID":"172f4c37-41d1-4044-931a-9909565feee2","Type":"ContainerStarted","Data":"6396f4c9149d690be3667b171a61c93e53cafb2d2c77608389a7e7534c9991df"}
Sep 07 21:30:03.738946 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:03.738914    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-52269e-29813610-wnnjh" event={"ID":"172f4c37-41d1-4044-931a-9909565feee2","Type":"ContainerStarted","Data":"f94476b6694126973c1bac1af0f9c82e2c67c77956114f584508884fcc32ebbe"}
Sep 07 21:30:03.754673 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:03.754615    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-52269e-29813610-wnnjh" podStartSLOduration=0.930949014 podStartE2EDuration="3.754597914s" totalImagesPullingTime="2.8236489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:30:03.752493576 +0000 UTC m=+1700.012310851" watchObservedRunningTime="2026-09-07 21:30:03.754597914 +0000 UTC m=+1700.014415157"
Sep 07 21:30:04.746501 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:04.746465    2558 generic.go:356] "Generic (PLEG): container finished" podID="172f4c37-41d1-4044-931a-9909565feee2" containerID="f94476b6694126973c1bac1af0f9c82e2c67c77956114f584508884fcc32ebbe" exitCode=0
Sep 07 21:30:04.746928 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:04.746554    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-52269e-29813610-wnnjh" event={"ID":"172f4c37-41d1-4044-931a-9909565feee2","Type":"ContainerDied","Data":"f94476b6694126973c1bac1af0f9c82e2c67c77956114f584508884fcc32ebbe"}
Sep 07 21:30:05.882706 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:05.880892    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-52269e-29813610-wnnjh"
Sep 07 21:30:06.759778 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:06.759668    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-52269e-29813610-wnnjh"
Sep 07 21:30:06.759778 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:06.759672    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-52269e-29813610-wnnjh" event={"ID":"172f4c37-41d1-4044-931a-9909565feee2","Type":"ContainerDied","Data":"6396f4c9149d690be3667b171a61c93e53cafb2d2c77608389a7e7534c9991df"}
Sep 07 21:30:06.759989 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:06.759787    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6396f4c9149d690be3667b171a61c93e53cafb2d2c77608389a7e7534c9991df"
Sep 07 21:30:21.152895 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:21.152857    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-52269e-29813610-wnnjh"]
Sep 07 21:30:21.156706 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:21.156681    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-52269e-29813610-wnnjh"]
Sep 07 21:30:21.187929 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:21.187894    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws"]
Sep 07 21:30:21.188219 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:21.188184    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws" podUID="d8bf7307-f04b-484d-8559-83e850862f97" containerName="payload-pre-processing" containerID="cri-o://0a3ed9d6a2700a1cca5729fc1abb36b4d8d8da1f8c84f9ebb6bbbf4e7ced54df" gracePeriod=30
Sep 07 21:30:21.464658 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:21.464632    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws"
Sep 07 21:30:21.560039 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:21.559996    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58wwp\" (UniqueName: \"kubernetes.io/projected/d8bf7307-f04b-484d-8559-83e850862f97-kube-api-access-58wwp\") pod \"d8bf7307-f04b-484d-8559-83e850862f97\" (UID: \"d8bf7307-f04b-484d-8559-83e850862f97\") "
Sep 07 21:30:21.560193 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:21.560074    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8bf7307-f04b-484d-8559-83e850862f97-plugins-config-volume\") pod \"d8bf7307-f04b-484d-8559-83e850862f97\" (UID: \"d8bf7307-f04b-484d-8559-83e850862f97\") "
Sep 07 21:30:21.560542 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:21.560519    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8bf7307-f04b-484d-8559-83e850862f97-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d8bf7307-f04b-484d-8559-83e850862f97" (UID: "d8bf7307-f04b-484d-8559-83e850862f97"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:30:21.562572 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:21.562544    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8bf7307-f04b-484d-8559-83e850862f97-kube-api-access-58wwp" (OuterVolumeSpecName: "kube-api-access-58wwp") pod "d8bf7307-f04b-484d-8559-83e850862f97" (UID: "d8bf7307-f04b-484d-8559-83e850862f97"). InnerVolumeSpecName "kube-api-access-58wwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:30:21.661687 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:21.661644    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58wwp\" (UniqueName: \"kubernetes.io/projected/d8bf7307-f04b-484d-8559-83e850862f97-kube-api-access-58wwp\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:30:21.661687 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:21.661678    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8bf7307-f04b-484d-8559-83e850862f97-plugins-config-volume\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:30:21.849411 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:21.849376    2558 generic.go:356] "Generic (PLEG): container finished" podID="d8bf7307-f04b-484d-8559-83e850862f97" containerID="0a3ed9d6a2700a1cca5729fc1abb36b4d8d8da1f8c84f9ebb6bbbf4e7ced54df" exitCode=0
Sep 07 21:30:21.849608 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:21.849427    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws"
Sep 07 21:30:21.849608 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:21.849465    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws" event={"ID":"d8bf7307-f04b-484d-8559-83e850862f97","Type":"ContainerDied","Data":"0a3ed9d6a2700a1cca5729fc1abb36b4d8d8da1f8c84f9ebb6bbbf4e7ced54df"}
Sep 07 21:30:21.849608 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:21.849527    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws" event={"ID":"d8bf7307-f04b-484d-8559-83e850862f97","Type":"ContainerDied","Data":"17f2f04563d7a744951355ecf6a71a47696ffecb60f569a3fd7dbc588fb7aaca"}
Sep 07 21:30:21.849608 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:21.849551    2558 scope.go:117] "RemoveContainer" containerID="0a3ed9d6a2700a1cca5729fc1abb36b4d8d8da1f8c84f9ebb6bbbf4e7ced54df"
Sep 07 21:30:21.859801 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:21.859779    2558 scope.go:117] "RemoveContainer" containerID="0a3ed9d6a2700a1cca5729fc1abb36b4d8d8da1f8c84f9ebb6bbbf4e7ced54df"
Sep 07 21:30:21.860111 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:30:21.860086    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a3ed9d6a2700a1cca5729fc1abb36b4d8d8da1f8c84f9ebb6bbbf4e7ced54df\": container with ID starting with 0a3ed9d6a2700a1cca5729fc1abb36b4d8d8da1f8c84f9ebb6bbbf4e7ced54df not found: ID does not exist" containerID="0a3ed9d6a2700a1cca5729fc1abb36b4d8d8da1f8c84f9ebb6bbbf4e7ced54df"
Sep 07 21:30:21.860172 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:21.860124    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a3ed9d6a2700a1cca5729fc1abb36b4d8d8da1f8c84f9ebb6bbbf4e7ced54df"} err="failed to get container status \"0a3ed9d6a2700a1cca5729fc1abb36b4d8d8da1f8c84f9ebb6bbbf4e7ced54df\": rpc error: code = NotFound desc = could not find container \"0a3ed9d6a2700a1cca5729fc1abb36b4d8d8da1f8c84f9ebb6bbbf4e7ced54df\": container with ID starting with 0a3ed9d6a2700a1cca5729fc1abb36b4d8d8da1f8c84f9ebb6bbbf4e7ced54df not found: ID does not exist"
Sep 07 21:30:21.872278 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:21.872253    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws"]
Sep 07 21:30:21.875597 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:21.875568    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws"]
Sep 07 21:30:22.309168 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:22.309136    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="172f4c37-41d1-4044-931a-9909565feee2" path="/var/lib/kubelet/pods/172f4c37-41d1-4044-931a-9909565feee2/volumes"
Sep 07 21:30:22.309553 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:30:22.309539    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8bf7307-f04b-484d-8559-83e850862f97" path="/var/lib/kubelet/pods/d8bf7307-f04b-484d-8559-83e850862f97/volumes"
Sep 07 21:31:20.352796 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:20.352760    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"]
Sep 07 21:31:20.353411 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:20.352999    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb" podUID="5f24aecc-4569-4712-a0e3-7b1009af30df" containerName="maas-api" containerID="cri-o://5620708ade38a007d95d8d536102270f63e6274259e964383ca55f731b933906" gracePeriod=30
Sep 07 21:31:20.613923 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:20.613869    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"
Sep 07 21:31:20.662493 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:20.662131    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f24aecc-4569-4712-a0e3-7b1009af30df-openshift-service-ca\") pod \"5f24aecc-4569-4712-a0e3-7b1009af30df\" (UID: \"5f24aecc-4569-4712-a0e3-7b1009af30df\") "
Sep 07 21:31:20.662493 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:20.662217    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f24aecc-4569-4712-a0e3-7b1009af30df-maas-api-tls\") pod \"5f24aecc-4569-4712-a0e3-7b1009af30df\" (UID: \"5f24aecc-4569-4712-a0e3-7b1009af30df\") "
Sep 07 21:31:20.662493 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:20.662269    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f24aecc-4569-4712-a0e3-7b1009af30df-metrics-certs\") pod \"5f24aecc-4569-4712-a0e3-7b1009af30df\" (UID: \"5f24aecc-4569-4712-a0e3-7b1009af30df\") "
Sep 07 21:31:20.662493 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:20.662302    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5z8df\" (UniqueName: \"kubernetes.io/projected/5f24aecc-4569-4712-a0e3-7b1009af30df-kube-api-access-5z8df\") pod \"5f24aecc-4569-4712-a0e3-7b1009af30df\" (UID: \"5f24aecc-4569-4712-a0e3-7b1009af30df\") "
Sep 07 21:31:20.670834 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:20.670762    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f24aecc-4569-4712-a0e3-7b1009af30df-kube-api-access-5z8df" (OuterVolumeSpecName: "kube-api-access-5z8df") pod "5f24aecc-4569-4712-a0e3-7b1009af30df" (UID: "5f24aecc-4569-4712-a0e3-7b1009af30df"). InnerVolumeSpecName "kube-api-access-5z8df". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:31:20.671782 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:20.671752    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f24aecc-4569-4712-a0e3-7b1009af30df-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5f24aecc-4569-4712-a0e3-7b1009af30df" (UID: "5f24aecc-4569-4712-a0e3-7b1009af30df"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:31:20.672016 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:20.671991    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f24aecc-4569-4712-a0e3-7b1009af30df-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5f24aecc-4569-4712-a0e3-7b1009af30df" (UID: "5f24aecc-4569-4712-a0e3-7b1009af30df"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:31:20.672893 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:20.672856    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f24aecc-4569-4712-a0e3-7b1009af30df-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5f24aecc-4569-4712-a0e3-7b1009af30df" (UID: "5f24aecc-4569-4712-a0e3-7b1009af30df"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:31:20.764084 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:20.764051    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f24aecc-4569-4712-a0e3-7b1009af30df-openshift-service-ca\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:31:20.764084 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:20.764082    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f24aecc-4569-4712-a0e3-7b1009af30df-maas-api-tls\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:31:20.764084 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:20.764091    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f24aecc-4569-4712-a0e3-7b1009af30df-metrics-certs\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:31:20.764342 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:20.764100    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5z8df\" (UniqueName: \"kubernetes.io/projected/5f24aecc-4569-4712-a0e3-7b1009af30df-kube-api-access-5z8df\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:31:21.193562 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:21.193521    2558 generic.go:356] "Generic (PLEG): container finished" podID="5f24aecc-4569-4712-a0e3-7b1009af30df" containerID="5620708ade38a007d95d8d536102270f63e6274259e964383ca55f731b933906" exitCode=0
Sep 07 21:31:21.193742 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:21.193576    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"
Sep 07 21:31:21.193742 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:21.193593    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb" event={"ID":"5f24aecc-4569-4712-a0e3-7b1009af30df","Type":"ContainerDied","Data":"5620708ade38a007d95d8d536102270f63e6274259e964383ca55f731b933906"}
Sep 07 21:31:21.193742 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:21.193636    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb" event={"ID":"5f24aecc-4569-4712-a0e3-7b1009af30df","Type":"ContainerDied","Data":"73930ea1e10e308dcf2922ec5acc39937f1a4c905b565a23cc34c229e338dc67"}
Sep 07 21:31:21.193742 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:21.193657    2558 scope.go:117] "RemoveContainer" containerID="5620708ade38a007d95d8d536102270f63e6274259e964383ca55f731b933906"
Sep 07 21:31:21.203248 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:21.203230    2558 scope.go:117] "RemoveContainer" containerID="5620708ade38a007d95d8d536102270f63e6274259e964383ca55f731b933906"
Sep 07 21:31:21.203604 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:31:21.203586    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5620708ade38a007d95d8d536102270f63e6274259e964383ca55f731b933906\": container with ID starting with 5620708ade38a007d95d8d536102270f63e6274259e964383ca55f731b933906 not found: ID does not exist" containerID="5620708ade38a007d95d8d536102270f63e6274259e964383ca55f731b933906"
Sep 07 21:31:21.203680 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:21.203612    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5620708ade38a007d95d8d536102270f63e6274259e964383ca55f731b933906"} err="failed to get container status \"5620708ade38a007d95d8d536102270f63e6274259e964383ca55f731b933906\": rpc error: code = NotFound desc = could not find container \"5620708ade38a007d95d8d536102270f63e6274259e964383ca55f731b933906\": container with ID starting with 5620708ade38a007d95d8d536102270f63e6274259e964383ca55f731b933906 not found: ID does not exist"
Sep 07 21:31:21.215713 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:21.215687    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"]
Sep 07 21:31:21.218250 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:21.218230    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-629e95-57574db996-vbmxb"]
Sep 07 21:31:22.312420 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:22.312387    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f24aecc-4569-4712-a0e3-7b1009af30df" path="/var/lib/kubelet/pods/5f24aecc-4569-4712-a0e3-7b1009af30df/volumes"
Sep 07 21:31:37.986040 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:37.985963    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx"]
Sep 07 21:31:37.986470 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:37.986252    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx" podUID="ecfcd749-d853-4d07-a723-b550049333d7" containerName="payload-pre-processing" containerID="cri-o://5831d299347f2f83b2eb88d5606e1a47420b2184a548ce054a983141ecc20840" gracePeriod=30
Sep 07 21:31:38.266484 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:38.266459    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx"
Sep 07 21:31:38.300881 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:38.300794    2558 generic.go:356] "Generic (PLEG): container finished" podID="ecfcd749-d853-4d07-a723-b550049333d7" containerID="5831d299347f2f83b2eb88d5606e1a47420b2184a548ce054a983141ecc20840" exitCode=0
Sep 07 21:31:38.300881 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:38.300846    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx" event={"ID":"ecfcd749-d853-4d07-a723-b550049333d7","Type":"ContainerDied","Data":"5831d299347f2f83b2eb88d5606e1a47420b2184a548ce054a983141ecc20840"}
Sep 07 21:31:38.300881 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:38.300865    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx"
Sep 07 21:31:38.301252 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:38.300930    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx" event={"ID":"ecfcd749-d853-4d07-a723-b550049333d7","Type":"ContainerDied","Data":"8306b28d43a1b288a7872b124027574d14e24960e4a2e558617b5188ba27e353"}
Sep 07 21:31:38.301252 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:38.300963    2558 scope.go:117] "RemoveContainer" containerID="5831d299347f2f83b2eb88d5606e1a47420b2184a548ce054a983141ecc20840"
Sep 07 21:31:38.312233 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:38.312210    2558 scope.go:117] "RemoveContainer" containerID="5831d299347f2f83b2eb88d5606e1a47420b2184a548ce054a983141ecc20840"
Sep 07 21:31:38.312560 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:31:38.312537    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5831d299347f2f83b2eb88d5606e1a47420b2184a548ce054a983141ecc20840\": container with ID starting with 5831d299347f2f83b2eb88d5606e1a47420b2184a548ce054a983141ecc20840 not found: ID does not exist" containerID="5831d299347f2f83b2eb88d5606e1a47420b2184a548ce054a983141ecc20840"
Sep 07 21:31:38.312636 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:38.312572    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5831d299347f2f83b2eb88d5606e1a47420b2184a548ce054a983141ecc20840"} err="failed to get container status \"5831d299347f2f83b2eb88d5606e1a47420b2184a548ce054a983141ecc20840\": rpc error: code = NotFound desc = could not find container \"5831d299347f2f83b2eb88d5606e1a47420b2184a548ce054a983141ecc20840\": container with ID starting with 5831d299347f2f83b2eb88d5606e1a47420b2184a548ce054a983141ecc20840 not found: ID does not exist"
Sep 07 21:31:38.436288 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:38.436252    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqpcg\" (UniqueName: \"kubernetes.io/projected/ecfcd749-d853-4d07-a723-b550049333d7-kube-api-access-zqpcg\") pod \"ecfcd749-d853-4d07-a723-b550049333d7\" (UID: \"ecfcd749-d853-4d07-a723-b550049333d7\") "
Sep 07 21:31:38.436288 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:38.436292    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecfcd749-d853-4d07-a723-b550049333d7-plugins-config-volume\") pod \"ecfcd749-d853-4d07-a723-b550049333d7\" (UID: \"ecfcd749-d853-4d07-a723-b550049333d7\") "
Sep 07 21:31:38.436718 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:38.436695    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecfcd749-d853-4d07-a723-b550049333d7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ecfcd749-d853-4d07-a723-b550049333d7" (UID: "ecfcd749-d853-4d07-a723-b550049333d7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:31:38.438499 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:38.438469    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecfcd749-d853-4d07-a723-b550049333d7-kube-api-access-zqpcg" (OuterVolumeSpecName: "kube-api-access-zqpcg") pod "ecfcd749-d853-4d07-a723-b550049333d7" (UID: "ecfcd749-d853-4d07-a723-b550049333d7"). InnerVolumeSpecName "kube-api-access-zqpcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:31:38.537586 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:38.537490    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqpcg\" (UniqueName: \"kubernetes.io/projected/ecfcd749-d853-4d07-a723-b550049333d7-kube-api-access-zqpcg\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:31:38.537586 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:38.537516    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecfcd749-d853-4d07-a723-b550049333d7-plugins-config-volume\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:31:38.622459 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:38.622428    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx"]
Sep 07 21:31:38.627832 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:38.627806    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx"]
Sep 07 21:31:40.308767 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:40.308730    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecfcd749-d853-4d07-a723-b550049333d7" path="/var/lib/kubelet/pods/ecfcd749-d853-4d07-a723-b550049333d7/volumes"
Sep 07 21:31:44.393167 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:44.393134    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-kv96r_d804af86-d937-4ea6-afb8-760911a10437/console-operator/1.log"
Sep 07 21:31:44.399285 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:44.399261    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-kv96r_d804af86-d937-4ea6-afb8-760911a10437/console-operator/1.log"
Sep 07 21:31:45.110358 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:45.110293    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"]
Sep 07 21:31:45.110650 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:45.110594    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d" podUID="b49dedc1-7c78-4003-9b58-8aac6b488df5" containerName="istio-proxy" containerID="cri-o://3901d613c743e33c78ed83ff37ab9c7b0f54f47d68ff75f39956748bc4979142" gracePeriod=30
Sep 07 21:31:50.363015 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.362990    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:31:50.371142 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.371115    2558 generic.go:356] "Generic (PLEG): container finished" podID="b49dedc1-7c78-4003-9b58-8aac6b488df5" containerID="3901d613c743e33c78ed83ff37ab9c7b0f54f47d68ff75f39956748bc4979142" exitCode=0
Sep 07 21:31:50.371256 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.371153    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"
Sep 07 21:31:50.371256 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.371159    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d" event={"ID":"b49dedc1-7c78-4003-9b58-8aac6b488df5","Type":"ContainerDied","Data":"3901d613c743e33c78ed83ff37ab9c7b0f54f47d68ff75f39956748bc4979142"}
Sep 07 21:31:50.371256 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.371214    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d" event={"ID":"b49dedc1-7c78-4003-9b58-8aac6b488df5","Type":"ContainerDied","Data":"16bd6e5d754c40c8c5b6f72687fdbe936f7c26d6e9bed7ecd84301672f28c945"}
Sep 07 21:31:50.371256 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.371238    2558 scope.go:117] "RemoveContainer" containerID="3901d613c743e33c78ed83ff37ab9c7b0f54f47d68ff75f39956748bc4979142"
Sep 07 21:31:50.380033 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.380010    2558 scope.go:117] "RemoveContainer" containerID="c4cb01987b0975e83eadb78723d71ccabc81b33699e55cd382316abd540173b8"
Sep 07 21:31:50.391690 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.391666    2558 scope.go:117] "RemoveContainer" containerID="3901d613c743e33c78ed83ff37ab9c7b0f54f47d68ff75f39956748bc4979142"
Sep 07 21:31:50.391999 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:31:50.391979    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3901d613c743e33c78ed83ff37ab9c7b0f54f47d68ff75f39956748bc4979142\": container with ID starting with 3901d613c743e33c78ed83ff37ab9c7b0f54f47d68ff75f39956748bc4979142 not found: ID does not exist" containerID="3901d613c743e33c78ed83ff37ab9c7b0f54f47d68ff75f39956748bc4979142"
Sep 07 21:31:50.392044 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.392008    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3901d613c743e33c78ed83ff37ab9c7b0f54f47d68ff75f39956748bc4979142"} err="failed to get container status \"3901d613c743e33c78ed83ff37ab9c7b0f54f47d68ff75f39956748bc4979142\": rpc error: code = NotFound desc = could not find container \"3901d613c743e33c78ed83ff37ab9c7b0f54f47d68ff75f39956748bc4979142\": container with ID starting with 3901d613c743e33c78ed83ff37ab9c7b0f54f47d68ff75f39956748bc4979142 not found: ID does not exist"
Sep 07 21:31:50.392044 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.392028    2558 scope.go:117] "RemoveContainer" containerID="c4cb01987b0975e83eadb78723d71ccabc81b33699e55cd382316abd540173b8"
Sep 07 21:31:50.392290 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:31:50.392271    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4cb01987b0975e83eadb78723d71ccabc81b33699e55cd382316abd540173b8\": container with ID starting with c4cb01987b0975e83eadb78723d71ccabc81b33699e55cd382316abd540173b8 not found: ID does not exist" containerID="c4cb01987b0975e83eadb78723d71ccabc81b33699e55cd382316abd540173b8"
Sep 07 21:31:50.392359 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.392295    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4cb01987b0975e83eadb78723d71ccabc81b33699e55cd382316abd540173b8"} err="failed to get container status \"c4cb01987b0975e83eadb78723d71ccabc81b33699e55cd382316abd540173b8\": rpc error: code = NotFound desc = could not find container \"c4cb01987b0975e83eadb78723d71ccabc81b33699e55cd382316abd540173b8\": container with ID starting with c4cb01987b0975e83eadb78723d71ccabc81b33699e55cd382316abd540173b8 not found: ID does not exist"
Sep 07 21:31:50.449816 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.449766    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-credential-socket\") pod \"b49dedc1-7c78-4003-9b58-8aac6b488df5\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") "
Sep 07 21:31:50.449816 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.449820    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-envoy\") pod \"b49dedc1-7c78-4003-9b58-8aac6b488df5\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") "
Sep 07 21:31:50.450073 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.449856    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4xrv\" (UniqueName: \"kubernetes.io/projected/b49dedc1-7c78-4003-9b58-8aac6b488df5-kube-api-access-s4xrv\") pod \"b49dedc1-7c78-4003-9b58-8aac6b488df5\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") "
Sep 07 21:31:50.450073 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.449905    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-token\") pod \"b49dedc1-7c78-4003-9b58-8aac6b488df5\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") "
Sep 07 21:31:50.450178 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.450092    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b49dedc1-7c78-4003-9b58-8aac6b488df5" (UID: "b49dedc1-7c78-4003-9b58-8aac6b488df5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:31:50.450178 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.450122    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-podinfo\") pod \"b49dedc1-7c78-4003-9b58-8aac6b488df5\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") "
Sep 07 21:31:50.450290 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.450207    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b49dedc1-7c78-4003-9b58-8aac6b488df5-istiod-ca-cert\") pod \"b49dedc1-7c78-4003-9b58-8aac6b488df5\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") "
Sep 07 21:31:50.450290 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.450235    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-workload-certs\") pod \"b49dedc1-7c78-4003-9b58-8aac6b488df5\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") "
Sep 07 21:31:50.450290 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.450265    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-data\") pod \"b49dedc1-7c78-4003-9b58-8aac6b488df5\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") "
Sep 07 21:31:50.450478 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.450302    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-workload-socket\") pod \"b49dedc1-7c78-4003-9b58-8aac6b488df5\" (UID: \"b49dedc1-7c78-4003-9b58-8aac6b488df5\") "
Sep 07 21:31:50.450554 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.450530    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-data" (OuterVolumeSpecName: "istio-data") pod "b49dedc1-7c78-4003-9b58-8aac6b488df5" (UID: "b49dedc1-7c78-4003-9b58-8aac6b488df5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:31:50.450643 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.450614    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b49dedc1-7c78-4003-9b58-8aac6b488df5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b49dedc1-7c78-4003-9b58-8aac6b488df5" (UID: "b49dedc1-7c78-4003-9b58-8aac6b488df5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:31:50.450790 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.450739    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-data\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:31:50.450790 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.450755    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b49dedc1-7c78-4003-9b58-8aac6b488df5" (UID: "b49dedc1-7c78-4003-9b58-8aac6b488df5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:31:50.450790 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.450766    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-credential-socket\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:31:50.450965 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.450794    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b49dedc1-7c78-4003-9b58-8aac6b488df5" (UID: "b49dedc1-7c78-4003-9b58-8aac6b488df5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:31:50.452265 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.452238    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b49dedc1-7c78-4003-9b58-8aac6b488df5" (UID: "b49dedc1-7c78-4003-9b58-8aac6b488df5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:31:50.452400 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.452271    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b49dedc1-7c78-4003-9b58-8aac6b488df5" (UID: "b49dedc1-7c78-4003-9b58-8aac6b488df5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 21:31:50.452521 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.452504    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-token" (OuterVolumeSpecName: "istio-token") pod "b49dedc1-7c78-4003-9b58-8aac6b488df5" (UID: "b49dedc1-7c78-4003-9b58-8aac6b488df5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:31:50.452521 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.452515    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b49dedc1-7c78-4003-9b58-8aac6b488df5-kube-api-access-s4xrv" (OuterVolumeSpecName: "kube-api-access-s4xrv") pod "b49dedc1-7c78-4003-9b58-8aac6b488df5" (UID: "b49dedc1-7c78-4003-9b58-8aac6b488df5"). InnerVolumeSpecName "kube-api-access-s4xrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:31:50.551420 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.551381    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-podinfo\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:31:50.551420 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.551415    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b49dedc1-7c78-4003-9b58-8aac6b488df5-istiod-ca-cert\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:31:50.551420 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.551424    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-workload-certs\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:31:50.551655 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.551432    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-workload-socket\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:31:50.551655 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.551442    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-envoy\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:31:50.551655 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.551451    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4xrv\" (UniqueName: \"kubernetes.io/projected/b49dedc1-7c78-4003-9b58-8aac6b488df5-kube-api-access-s4xrv\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:31:50.551655 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.551459    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b49dedc1-7c78-4003-9b58-8aac6b488df5-istio-token\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:31:50.694899 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.694871    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"]
Sep 07 21:31:50.698696 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:50.698668    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d"]
Sep 07 21:31:52.308564 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:52.308531    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b49dedc1-7c78-4003-9b58-8aac6b488df5" path="/var/lib/kubelet/pods/b49dedc1-7c78-4003-9b58-8aac6b488df5/volumes"
Sep 07 21:31:55.914023 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:55.913989    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"]
Sep 07 21:31:55.914465 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:55.914264    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn" podUID="719b90a9-07dc-480b-885e-07766d8d076a" containerName="maas-api" containerID="cri-o://4c67202b29c709b00d9f71fbc01a76ba10cb20025131f789ba78be43a43a4615" gracePeriod=30
Sep 07 21:31:55.974947 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:55.974908    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2"]
Sep 07 21:31:55.975418 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:55.975382    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2" podUID="1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6" containerName="payload-processing" containerID="cri-o://e4d47f633501a0ccd8bc4ece0048b7bb2516b0fa9242b4507a2e4848356f754a" gracePeriod=30
Sep 07 21:31:56.246061 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.246028    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"
Sep 07 21:31:56.263105 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.263079    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2"
Sep 07 21:31:56.303802 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.303767    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/719b90a9-07dc-480b-885e-07766d8d076a-maas-api-tls\") pod \"719b90a9-07dc-480b-885e-07766d8d076a\" (UID: \"719b90a9-07dc-480b-885e-07766d8d076a\") "
Sep 07 21:31:56.303985 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.303881    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/719b90a9-07dc-480b-885e-07766d8d076a-openshift-service-ca\") pod \"719b90a9-07dc-480b-885e-07766d8d076a\" (UID: \"719b90a9-07dc-480b-885e-07766d8d076a\") "
Sep 07 21:31:56.303985 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.303936    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7k5ww\" (UniqueName: \"kubernetes.io/projected/719b90a9-07dc-480b-885e-07766d8d076a-kube-api-access-7k5ww\") pod \"719b90a9-07dc-480b-885e-07766d8d076a\" (UID: \"719b90a9-07dc-480b-885e-07766d8d076a\") "
Sep 07 21:31:56.303985 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.303973    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2b867\" (UniqueName: \"kubernetes.io/projected/1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6-kube-api-access-2b867\") pod \"1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6\" (UID: \"1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6\") "
Sep 07 21:31:56.304155 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.303998    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/719b90a9-07dc-480b-885e-07766d8d076a-metrics-certs\") pod \"719b90a9-07dc-480b-885e-07766d8d076a\" (UID: \"719b90a9-07dc-480b-885e-07766d8d076a\") "
Sep 07 21:31:56.304155 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.304057    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6-plugins-config-volume\") pod \"1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6\" (UID: \"1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6\") "
Sep 07 21:31:56.304299 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.304269    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/719b90a9-07dc-480b-885e-07766d8d076a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "719b90a9-07dc-480b-885e-07766d8d076a" (UID: "719b90a9-07dc-480b-885e-07766d8d076a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:31:56.304426 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.304404    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/719b90a9-07dc-480b-885e-07766d8d076a-openshift-service-ca\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:31:56.304725 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.304698    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6" (UID: "1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:31:56.306467 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.306440    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/719b90a9-07dc-480b-885e-07766d8d076a-kube-api-access-7k5ww" (OuterVolumeSpecName: "kube-api-access-7k5ww") pod "719b90a9-07dc-480b-885e-07766d8d076a" (UID: "719b90a9-07dc-480b-885e-07766d8d076a"). InnerVolumeSpecName "kube-api-access-7k5ww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:31:56.306581 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.306497    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6-kube-api-access-2b867" (OuterVolumeSpecName: "kube-api-access-2b867") pod "1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6" (UID: "1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6"). InnerVolumeSpecName "kube-api-access-2b867". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:31:56.306632 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.306618    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/719b90a9-07dc-480b-885e-07766d8d076a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "719b90a9-07dc-480b-885e-07766d8d076a" (UID: "719b90a9-07dc-480b-885e-07766d8d076a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:31:56.306673 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.306640    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/719b90a9-07dc-480b-885e-07766d8d076a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "719b90a9-07dc-480b-885e-07766d8d076a" (UID: "719b90a9-07dc-480b-885e-07766d8d076a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:31:56.404939 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.404904    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6-plugins-config-volume\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:31:56.404939 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.404936    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/719b90a9-07dc-480b-885e-07766d8d076a-maas-api-tls\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:31:56.405162 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.404951    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7k5ww\" (UniqueName: \"kubernetes.io/projected/719b90a9-07dc-480b-885e-07766d8d076a-kube-api-access-7k5ww\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:31:56.405162 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.404963    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b867\" (UniqueName: \"kubernetes.io/projected/1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6-kube-api-access-2b867\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:31:56.405162 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.404976    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/719b90a9-07dc-480b-885e-07766d8d076a-metrics-certs\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:31:56.406381 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.406353    2558 generic.go:356] "Generic (PLEG): container finished" podID="719b90a9-07dc-480b-885e-07766d8d076a" containerID="4c67202b29c709b00d9f71fbc01a76ba10cb20025131f789ba78be43a43a4615" exitCode=0
Sep 07 21:31:56.406513 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.406405    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"
Sep 07 21:31:56.406513 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.406435    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn" event={"ID":"719b90a9-07dc-480b-885e-07766d8d076a","Type":"ContainerDied","Data":"4c67202b29c709b00d9f71fbc01a76ba10cb20025131f789ba78be43a43a4615"}
Sep 07 21:31:56.406513 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.406498    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn" event={"ID":"719b90a9-07dc-480b-885e-07766d8d076a","Type":"ContainerDied","Data":"d66c0226aea09b559919e26650384230cedc4702b7970e2c50c27b39d6ae9a43"}
Sep 07 21:31:56.406654 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.406533    2558 scope.go:117] "RemoveContainer" containerID="4c67202b29c709b00d9f71fbc01a76ba10cb20025131f789ba78be43a43a4615"
Sep 07 21:31:56.407936 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.407915    2558 generic.go:356] "Generic (PLEG): container finished" podID="1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6" containerID="e4d47f633501a0ccd8bc4ece0048b7bb2516b0fa9242b4507a2e4848356f754a" exitCode=0
Sep 07 21:31:56.408051 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.407958    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2"
Sep 07 21:31:56.408051 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.407977    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2" event={"ID":"1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6","Type":"ContainerDied","Data":"e4d47f633501a0ccd8bc4ece0048b7bb2516b0fa9242b4507a2e4848356f754a"}
Sep 07 21:31:56.408051 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.408013    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2" event={"ID":"1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6","Type":"ContainerDied","Data":"ee72fe11d8c7fdebe44d0de4e6b7dae657749e7f4cd2d13df533bd50396eedd0"}
Sep 07 21:31:56.416248 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.416229    2558 scope.go:117] "RemoveContainer" containerID="4c67202b29c709b00d9f71fbc01a76ba10cb20025131f789ba78be43a43a4615"
Sep 07 21:31:56.416571 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:31:56.416549    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c67202b29c709b00d9f71fbc01a76ba10cb20025131f789ba78be43a43a4615\": container with ID starting with 4c67202b29c709b00d9f71fbc01a76ba10cb20025131f789ba78be43a43a4615 not found: ID does not exist" containerID="4c67202b29c709b00d9f71fbc01a76ba10cb20025131f789ba78be43a43a4615"
Sep 07 21:31:56.416635 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.416578    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c67202b29c709b00d9f71fbc01a76ba10cb20025131f789ba78be43a43a4615"} err="failed to get container status \"4c67202b29c709b00d9f71fbc01a76ba10cb20025131f789ba78be43a43a4615\": rpc error: code = NotFound desc = could not find container \"4c67202b29c709b00d9f71fbc01a76ba10cb20025131f789ba78be43a43a4615\": container with ID starting with 4c67202b29c709b00d9f71fbc01a76ba10cb20025131f789ba78be43a43a4615 not found: ID does not exist"
Sep 07 21:31:56.416635 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.416595    2558 scope.go:117] "RemoveContainer" containerID="e4d47f633501a0ccd8bc4ece0048b7bb2516b0fa9242b4507a2e4848356f754a"
Sep 07 21:31:56.425299 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.425221    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2"]
Sep 07 21:31:56.425787 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.425765    2558 scope.go:117] "RemoveContainer" containerID="e4d47f633501a0ccd8bc4ece0048b7bb2516b0fa9242b4507a2e4848356f754a"
Sep 07 21:31:56.426113 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:31:56.426088    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4d47f633501a0ccd8bc4ece0048b7bb2516b0fa9242b4507a2e4848356f754a\": container with ID starting with e4d47f633501a0ccd8bc4ece0048b7bb2516b0fa9242b4507a2e4848356f754a not found: ID does not exist" containerID="e4d47f633501a0ccd8bc4ece0048b7bb2516b0fa9242b4507a2e4848356f754a"
Sep 07 21:31:56.426185 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.426122    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4d47f633501a0ccd8bc4ece0048b7bb2516b0fa9242b4507a2e4848356f754a"} err="failed to get container status \"e4d47f633501a0ccd8bc4ece0048b7bb2516b0fa9242b4507a2e4848356f754a\": rpc error: code = NotFound desc = could not find container \"e4d47f633501a0ccd8bc4ece0048b7bb2516b0fa9242b4507a2e4848356f754a\": container with ID starting with e4d47f633501a0ccd8bc4ece0048b7bb2516b0fa9242b4507a2e4848356f754a not found: ID does not exist"
Sep 07 21:31:56.427751 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.427732    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2"]
Sep 07 21:31:56.436072 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.436051    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"]
Sep 07 21:31:56.439973 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:56.439951    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7fa21f-64d9589756-cmgcn"]
Sep 07 21:31:58.309248 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:58.309198    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6" path="/var/lib/kubelet/pods/1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6/volumes"
Sep 07 21:31:58.309830 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:31:58.309808    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="719b90a9-07dc-480b-885e-07766d8d076a" path="/var/lib/kubelet/pods/719b90a9-07dc-480b-885e-07766d8d076a/volumes"
Sep 07 21:32:05.157293 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:32:05.157243    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59f5bb5dd-65tbd"]
Sep 07 21:32:05.157804 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:32:05.157475    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-59f5bb5dd-65tbd" podUID="90686432-ff48-415f-b61f-da2998912abe" containerName="manager" containerID="cri-o://a617f2262c095749bf4f741beaeb1dbe82a9e81848ad897d5901ee9f5ea95f17" gracePeriod=30
Sep 07 21:32:05.410273 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:32:05.410163    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59f5bb5dd-65tbd"
Sep 07 21:32:05.460598 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:32:05.460563    2558 generic.go:356] "Generic (PLEG): container finished" podID="90686432-ff48-415f-b61f-da2998912abe" containerID="a617f2262c095749bf4f741beaeb1dbe82a9e81848ad897d5901ee9f5ea95f17" exitCode=0
Sep 07 21:32:05.460762 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:32:05.460616    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59f5bb5dd-65tbd"
Sep 07 21:32:05.460762 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:32:05.460653    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59f5bb5dd-65tbd" event={"ID":"90686432-ff48-415f-b61f-da2998912abe","Type":"ContainerDied","Data":"a617f2262c095749bf4f741beaeb1dbe82a9e81848ad897d5901ee9f5ea95f17"}
Sep 07 21:32:05.460762 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:32:05.460723    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59f5bb5dd-65tbd" event={"ID":"90686432-ff48-415f-b61f-da2998912abe","Type":"ContainerDied","Data":"b7810b66994d9e495491ae5db01719c29e7cb82195ebb31b87d278081a032aed"}
Sep 07 21:32:05.460762 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:32:05.460748    2558 scope.go:117] "RemoveContainer" containerID="a617f2262c095749bf4f741beaeb1dbe82a9e81848ad897d5901ee9f5ea95f17"
Sep 07 21:32:05.473876 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:32:05.473849    2558 scope.go:117] "RemoveContainer" containerID="a617f2262c095749bf4f741beaeb1dbe82a9e81848ad897d5901ee9f5ea95f17"
Sep 07 21:32:05.474223 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:32:05.474202    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a617f2262c095749bf4f741beaeb1dbe82a9e81848ad897d5901ee9f5ea95f17\": container with ID starting with a617f2262c095749bf4f741beaeb1dbe82a9e81848ad897d5901ee9f5ea95f17 not found: ID does not exist" containerID="a617f2262c095749bf4f741beaeb1dbe82a9e81848ad897d5901ee9f5ea95f17"
Sep 07 21:32:05.474287 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:32:05.474232    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a617f2262c095749bf4f741beaeb1dbe82a9e81848ad897d5901ee9f5ea95f17"} err="failed to get container status \"a617f2262c095749bf4f741beaeb1dbe82a9e81848ad897d5901ee9f5ea95f17\": rpc error: code = NotFound desc = could not find container \"a617f2262c095749bf4f741beaeb1dbe82a9e81848ad897d5901ee9f5ea95f17\": container with ID starting with a617f2262c095749bf4f741beaeb1dbe82a9e81848ad897d5901ee9f5ea95f17 not found: ID does not exist"
Sep 07 21:32:05.489536 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:32:05.489508    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90686432-ff48-415f-b61f-da2998912abe-metrics-certs\") pod \"90686432-ff48-415f-b61f-da2998912abe\" (UID: \"90686432-ff48-415f-b61f-da2998912abe\") "
Sep 07 21:32:05.489678 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:32:05.489547    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxw6m\" (UniqueName: \"kubernetes.io/projected/90686432-ff48-415f-b61f-da2998912abe-kube-api-access-cxw6m\") pod \"90686432-ff48-415f-b61f-da2998912abe\" (UID: \"90686432-ff48-415f-b61f-da2998912abe\") "
Sep 07 21:32:05.489678 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:32:05.489626    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90686432-ff48-415f-b61f-da2998912abe-webhook-cert\") pod \"90686432-ff48-415f-b61f-da2998912abe\" (UID: \"90686432-ff48-415f-b61f-da2998912abe\") "
Sep 07 21:32:05.491673 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:32:05.491644    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90686432-ff48-415f-b61f-da2998912abe-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "90686432-ff48-415f-b61f-da2998912abe" (UID: "90686432-ff48-415f-b61f-da2998912abe"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:32:05.491792 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:32:05.491757    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90686432-ff48-415f-b61f-da2998912abe-kube-api-access-cxw6m" (OuterVolumeSpecName: "kube-api-access-cxw6m") pod "90686432-ff48-415f-b61f-da2998912abe" (UID: "90686432-ff48-415f-b61f-da2998912abe"). InnerVolumeSpecName "kube-api-access-cxw6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:32:05.491837 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:32:05.491781    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90686432-ff48-415f-b61f-da2998912abe-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "90686432-ff48-415f-b61f-da2998912abe" (UID: "90686432-ff48-415f-b61f-da2998912abe"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:32:05.590805 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:32:05.590776    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90686432-ff48-415f-b61f-da2998912abe-webhook-cert\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:32:05.590805 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:32:05.590801    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90686432-ff48-415f-b61f-da2998912abe-metrics-certs\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:32:05.590805 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:32:05.590811    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxw6m\" (UniqueName: \"kubernetes.io/projected/90686432-ff48-415f-b61f-da2998912abe-kube-api-access-cxw6m\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:32:05.784459 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:32:05.784422    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59f5bb5dd-65tbd"]
Sep 07 21:32:05.786683 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:32:05.786664    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-59f5bb5dd-65tbd"]
Sep 07 21:32:06.309499 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:32:06.309467    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90686432-ff48-415f-b61f-da2998912abe" path="/var/lib/kubelet/pods/90686432-ff48-415f-b61f-da2998912abe/volumes"
Sep 07 21:33:06.589893 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.589858    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59f5bb5dd-jx6wj"]
Sep 07 21:33:06.590398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590222    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b49dedc1-7c78-4003-9b58-8aac6b488df5" containerName="istio-proxy"
Sep 07 21:33:06.590398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590235    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b49dedc1-7c78-4003-9b58-8aac6b488df5" containerName="istio-proxy"
Sep 07 21:33:06.590398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590246    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8bf7307-f04b-484d-8559-83e850862f97" containerName="payload-pre-processing"
Sep 07 21:33:06.590398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590251    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8bf7307-f04b-484d-8559-83e850862f97" containerName="payload-pre-processing"
Sep 07 21:33:06.590398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590259    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f24aecc-4569-4712-a0e3-7b1009af30df" containerName="maas-api"
Sep 07 21:33:06.590398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590265    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f24aecc-4569-4712-a0e3-7b1009af30df" containerName="maas-api"
Sep 07 21:33:06.590398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590275    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90686432-ff48-415f-b61f-da2998912abe" containerName="manager"
Sep 07 21:33:06.590398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590280    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="90686432-ff48-415f-b61f-da2998912abe" containerName="manager"
Sep 07 21:33:06.590398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590290    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="172f4c37-41d1-4044-931a-9909565feee2" containerName="cleanup"
Sep 07 21:33:06.590398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590295    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="172f4c37-41d1-4044-931a-9909565feee2" containerName="cleanup"
Sep 07 21:33:06.590398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590321    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6" containerName="payload-processing"
Sep 07 21:33:06.590398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590327    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6" containerName="payload-processing"
Sep 07 21:33:06.590398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590336    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecfcd749-d853-4d07-a723-b550049333d7" containerName="payload-pre-processing"
Sep 07 21:33:06.590398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590342    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecfcd749-d853-4d07-a723-b550049333d7" containerName="payload-pre-processing"
Sep 07 21:33:06.590398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590348    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="719b90a9-07dc-480b-885e-07766d8d076a" containerName="maas-api"
Sep 07 21:33:06.590398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590353    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="719b90a9-07dc-480b-885e-07766d8d076a" containerName="maas-api"
Sep 07 21:33:06.590398 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590407    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="90686432-ff48-415f-b61f-da2998912abe" containerName="manager"
Sep 07 21:33:06.590919 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590416    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f24aecc-4569-4712-a0e3-7b1009af30df" containerName="maas-api"
Sep 07 21:33:06.590919 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590422    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b49dedc1-7c78-4003-9b58-8aac6b488df5" containerName="istio-proxy"
Sep 07 21:33:06.590919 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590429    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b2f10f8-2e4c-40cf-b350-d8f80f68b9c6" containerName="payload-processing"
Sep 07 21:33:06.590919 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590435    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="719b90a9-07dc-480b-885e-07766d8d076a" containerName="maas-api"
Sep 07 21:33:06.590919 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590441    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="172f4c37-41d1-4044-931a-9909565feee2" containerName="cleanup"
Sep 07 21:33:06.590919 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590449    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b49dedc1-7c78-4003-9b58-8aac6b488df5" containerName="istio-proxy"
Sep 07 21:33:06.590919 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590454    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8bf7307-f04b-484d-8559-83e850862f97" containerName="payload-pre-processing"
Sep 07 21:33:06.590919 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.590460    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecfcd749-d853-4d07-a723-b550049333d7" containerName="payload-pre-processing"
Sep 07 21:33:06.593360 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.593337    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59f5bb5dd-jx6wj"
Sep 07 21:33:06.596671 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.596650    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dchmp\""
Sep 07 21:33:06.596779 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.596652    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 07 21:33:06.596779 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.596685    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 07 21:33:06.596779 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.596692    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 07 21:33:06.603394 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.603371    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59f5bb5dd-jx6wj"]
Sep 07 21:33:06.651330 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.651274    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e680b14-6972-47f6-b60b-6a0382c6864a-webhook-cert\") pod \"maas-controller-59f5bb5dd-jx6wj\" (UID: \"9e680b14-6972-47f6-b60b-6a0382c6864a\") " pod="opendatahub/maas-controller-59f5bb5dd-jx6wj"
Sep 07 21:33:06.651489 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.651338    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6nds\" (UniqueName: \"kubernetes.io/projected/9e680b14-6972-47f6-b60b-6a0382c6864a-kube-api-access-r6nds\") pod \"maas-controller-59f5bb5dd-jx6wj\" (UID: \"9e680b14-6972-47f6-b60b-6a0382c6864a\") " pod="opendatahub/maas-controller-59f5bb5dd-jx6wj"
Sep 07 21:33:06.651489 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.651389    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e680b14-6972-47f6-b60b-6a0382c6864a-metrics-certs\") pod \"maas-controller-59f5bb5dd-jx6wj\" (UID: \"9e680b14-6972-47f6-b60b-6a0382c6864a\") " pod="opendatahub/maas-controller-59f5bb5dd-jx6wj"
Sep 07 21:33:06.752696 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.752609    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e680b14-6972-47f6-b60b-6a0382c6864a-webhook-cert\") pod \"maas-controller-59f5bb5dd-jx6wj\" (UID: \"9e680b14-6972-47f6-b60b-6a0382c6864a\") " pod="opendatahub/maas-controller-59f5bb5dd-jx6wj"
Sep 07 21:33:06.752696 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.752663    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6nds\" (UniqueName: \"kubernetes.io/projected/9e680b14-6972-47f6-b60b-6a0382c6864a-kube-api-access-r6nds\") pod \"maas-controller-59f5bb5dd-jx6wj\" (UID: \"9e680b14-6972-47f6-b60b-6a0382c6864a\") " pod="opendatahub/maas-controller-59f5bb5dd-jx6wj"
Sep 07 21:33:06.752696 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.752691    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e680b14-6972-47f6-b60b-6a0382c6864a-metrics-certs\") pod \"maas-controller-59f5bb5dd-jx6wj\" (UID: \"9e680b14-6972-47f6-b60b-6a0382c6864a\") " pod="opendatahub/maas-controller-59f5bb5dd-jx6wj"
Sep 07 21:33:06.755161 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.755136    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e680b14-6972-47f6-b60b-6a0382c6864a-metrics-certs\") pod \"maas-controller-59f5bb5dd-jx6wj\" (UID: \"9e680b14-6972-47f6-b60b-6a0382c6864a\") " pod="opendatahub/maas-controller-59f5bb5dd-jx6wj"
Sep 07 21:33:06.755291 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.755162    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e680b14-6972-47f6-b60b-6a0382c6864a-webhook-cert\") pod \"maas-controller-59f5bb5dd-jx6wj\" (UID: \"9e680b14-6972-47f6-b60b-6a0382c6864a\") " pod="opendatahub/maas-controller-59f5bb5dd-jx6wj"
Sep 07 21:33:06.760384 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.760356    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6nds\" (UniqueName: \"kubernetes.io/projected/9e680b14-6972-47f6-b60b-6a0382c6864a-kube-api-access-r6nds\") pod \"maas-controller-59f5bb5dd-jx6wj\" (UID: \"9e680b14-6972-47f6-b60b-6a0382c6864a\") " pod="opendatahub/maas-controller-59f5bb5dd-jx6wj"
Sep 07 21:33:06.905158 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:06.905070    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59f5bb5dd-jx6wj"
Sep 07 21:33:07.175509 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:07.175483    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59f5bb5dd-jx6wj"]
Sep 07 21:33:07.177130 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:33:07.177100    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e680b14_6972_47f6_b60b_6a0382c6864a.slice/crio-5171397223ac53019c19b1169c9f8fa80ce402b3661e5e6fb226ca6f52b1ea36 WatchSource:0}: Error finding container 5171397223ac53019c19b1169c9f8fa80ce402b3661e5e6fb226ca6f52b1ea36: Status 404 returned error can't find the container with id 5171397223ac53019c19b1169c9f8fa80ce402b3661e5e6fb226ca6f52b1ea36
Sep 07 21:33:07.178413 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:07.178395    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 21:33:07.805108 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:07.805073    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59f5bb5dd-jx6wj" event={"ID":"9e680b14-6972-47f6-b60b-6a0382c6864a","Type":"ContainerStarted","Data":"6782c1f8b5f31df858f8f5f3d163d02adeb38b745422f8b7952734525c27c75c"}
Sep 07 21:33:07.805528 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:07.805132    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59f5bb5dd-jx6wj" event={"ID":"9e680b14-6972-47f6-b60b-6a0382c6864a","Type":"ContainerStarted","Data":"5171397223ac53019c19b1169c9f8fa80ce402b3661e5e6fb226ca6f52b1ea36"}
Sep 07 21:33:07.805528 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:07.805160    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59f5bb5dd-jx6wj"
Sep 07 21:33:07.823756 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:07.823706    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59f5bb5dd-jx6wj" podStartSLOduration=1.39487791 podStartE2EDuration="1.823691541s" totalImagesPullingTime="428.813631ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:33:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:33:07.822163266 +0000 UTC m=+1884.081980510" watchObservedRunningTime="2026-09-07 21:33:07.823691541 +0000 UTC m=+1884.083508784"
Sep 07 21:33:18.813842 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:18.813807    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59f5bb5dd-jx6wj"
Sep 07 21:33:30.234450 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:30.234413    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59f5bb5dd-jx6wj"]
Sep 07 21:33:30.234980 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:30.234717    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-59f5bb5dd-jx6wj" podUID="9e680b14-6972-47f6-b60b-6a0382c6864a" containerName="manager" containerID="cri-o://6782c1f8b5f31df858f8f5f3d163d02adeb38b745422f8b7952734525c27c75c" gracePeriod=30
Sep 07 21:33:30.486807 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:30.486745    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59f5bb5dd-jx6wj"
Sep 07 21:33:30.572931 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:30.572901    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e680b14-6972-47f6-b60b-6a0382c6864a-metrics-certs\") pod \"9e680b14-6972-47f6-b60b-6a0382c6864a\" (UID: \"9e680b14-6972-47f6-b60b-6a0382c6864a\") "
Sep 07 21:33:30.573108 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:30.572991    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6nds\" (UniqueName: \"kubernetes.io/projected/9e680b14-6972-47f6-b60b-6a0382c6864a-kube-api-access-r6nds\") pod \"9e680b14-6972-47f6-b60b-6a0382c6864a\" (UID: \"9e680b14-6972-47f6-b60b-6a0382c6864a\") "
Sep 07 21:33:30.573108 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:30.573019    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e680b14-6972-47f6-b60b-6a0382c6864a-webhook-cert\") pod \"9e680b14-6972-47f6-b60b-6a0382c6864a\" (UID: \"9e680b14-6972-47f6-b60b-6a0382c6864a\") "
Sep 07 21:33:30.574927 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:30.574893    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e680b14-6972-47f6-b60b-6a0382c6864a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9e680b14-6972-47f6-b60b-6a0382c6864a" (UID: "9e680b14-6972-47f6-b60b-6a0382c6864a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:33:30.575048 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:30.575004    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e680b14-6972-47f6-b60b-6a0382c6864a-kube-api-access-r6nds" (OuterVolumeSpecName: "kube-api-access-r6nds") pod "9e680b14-6972-47f6-b60b-6a0382c6864a" (UID: "9e680b14-6972-47f6-b60b-6a0382c6864a"). InnerVolumeSpecName "kube-api-access-r6nds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:33:30.575048 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:30.575028    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e680b14-6972-47f6-b60b-6a0382c6864a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9e680b14-6972-47f6-b60b-6a0382c6864a" (UID: "9e680b14-6972-47f6-b60b-6a0382c6864a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:33:30.674430 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:30.674386    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e680b14-6972-47f6-b60b-6a0382c6864a-webhook-cert\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:33:30.674430 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:30.674423    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e680b14-6972-47f6-b60b-6a0382c6864a-metrics-certs\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:33:30.674430 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:30.674432    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6nds\" (UniqueName: \"kubernetes.io/projected/9e680b14-6972-47f6-b60b-6a0382c6864a-kube-api-access-r6nds\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:33:30.932884 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:30.932852    2558 generic.go:356] "Generic (PLEG): container finished" podID="9e680b14-6972-47f6-b60b-6a0382c6864a" containerID="6782c1f8b5f31df858f8f5f3d163d02adeb38b745422f8b7952734525c27c75c" exitCode=0
Sep 07 21:33:30.933059 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:30.932903    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59f5bb5dd-jx6wj"
Sep 07 21:33:30.933059 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:30.932920    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59f5bb5dd-jx6wj" event={"ID":"9e680b14-6972-47f6-b60b-6a0382c6864a","Type":"ContainerDied","Data":"6782c1f8b5f31df858f8f5f3d163d02adeb38b745422f8b7952734525c27c75c"}
Sep 07 21:33:30.933059 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:30.932963    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59f5bb5dd-jx6wj" event={"ID":"9e680b14-6972-47f6-b60b-6a0382c6864a","Type":"ContainerDied","Data":"5171397223ac53019c19b1169c9f8fa80ce402b3661e5e6fb226ca6f52b1ea36"}
Sep 07 21:33:30.933059 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:30.932985    2558 scope.go:117] "RemoveContainer" containerID="6782c1f8b5f31df858f8f5f3d163d02adeb38b745422f8b7952734525c27c75c"
Sep 07 21:33:30.942157 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:30.942140    2558 scope.go:117] "RemoveContainer" containerID="6782c1f8b5f31df858f8f5f3d163d02adeb38b745422f8b7952734525c27c75c"
Sep 07 21:33:30.942446 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:33:30.942425    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6782c1f8b5f31df858f8f5f3d163d02adeb38b745422f8b7952734525c27c75c\": container with ID starting with 6782c1f8b5f31df858f8f5f3d163d02adeb38b745422f8b7952734525c27c75c not found: ID does not exist" containerID="6782c1f8b5f31df858f8f5f3d163d02adeb38b745422f8b7952734525c27c75c"
Sep 07 21:33:30.942519 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:30.942457    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6782c1f8b5f31df858f8f5f3d163d02adeb38b745422f8b7952734525c27c75c"} err="failed to get container status \"6782c1f8b5f31df858f8f5f3d163d02adeb38b745422f8b7952734525c27c75c\": rpc error: code = NotFound desc = could not find container \"6782c1f8b5f31df858f8f5f3d163d02adeb38b745422f8b7952734525c27c75c\": container with ID starting with 6782c1f8b5f31df858f8f5f3d163d02adeb38b745422f8b7952734525c27c75c not found: ID does not exist"
Sep 07 21:33:30.953649 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:30.953629    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59f5bb5dd-jx6wj"]
Sep 07 21:33:30.956756 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:30.956739    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-59f5bb5dd-jx6wj"]
Sep 07 21:33:31.728876 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:31.728840    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59f5bb5dd-n8qwx"]
Sep 07 21:33:31.729253 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:31.729245    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b49dedc1-7c78-4003-9b58-8aac6b488df5" containerName="istio-proxy"
Sep 07 21:33:31.729339 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:31.729268    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b49dedc1-7c78-4003-9b58-8aac6b488df5" containerName="istio-proxy"
Sep 07 21:33:31.729339 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:31.729292    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e680b14-6972-47f6-b60b-6a0382c6864a" containerName="manager"
Sep 07 21:33:31.729339 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:31.729298    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e680b14-6972-47f6-b60b-6a0382c6864a" containerName="manager"
Sep 07 21:33:31.729444 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:31.729377    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e680b14-6972-47f6-b60b-6a0382c6864a" containerName="manager"
Sep 07 21:33:31.733721 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:31.733701    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59f5bb5dd-n8qwx"
Sep 07 21:33:31.736003 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:31.735982    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 07 21:33:31.736798 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:31.736777    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 07 21:33:31.736798 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:31.736790    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dchmp\""
Sep 07 21:33:31.736964 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:31.736822    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 07 21:33:31.741482 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:31.741461    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59f5bb5dd-n8qwx"]
Sep 07 21:33:31.784165 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:31.784137    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlg9l\" (UniqueName: \"kubernetes.io/projected/8a802688-72d0-42fc-951e-26e8f4c6d5f1-kube-api-access-jlg9l\") pod \"maas-controller-59f5bb5dd-n8qwx\" (UID: \"8a802688-72d0-42fc-951e-26e8f4c6d5f1\") " pod="opendatahub/maas-controller-59f5bb5dd-n8qwx"
Sep 07 21:33:31.784339 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:31.784189    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a802688-72d0-42fc-951e-26e8f4c6d5f1-webhook-cert\") pod \"maas-controller-59f5bb5dd-n8qwx\" (UID: \"8a802688-72d0-42fc-951e-26e8f4c6d5f1\") " pod="opendatahub/maas-controller-59f5bb5dd-n8qwx"
Sep 07 21:33:31.784339 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:31.784213    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a802688-72d0-42fc-951e-26e8f4c6d5f1-metrics-certs\") pod \"maas-controller-59f5bb5dd-n8qwx\" (UID: \"8a802688-72d0-42fc-951e-26e8f4c6d5f1\") " pod="opendatahub/maas-controller-59f5bb5dd-n8qwx"
Sep 07 21:33:31.885304 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:31.885269    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlg9l\" (UniqueName: \"kubernetes.io/projected/8a802688-72d0-42fc-951e-26e8f4c6d5f1-kube-api-access-jlg9l\") pod \"maas-controller-59f5bb5dd-n8qwx\" (UID: \"8a802688-72d0-42fc-951e-26e8f4c6d5f1\") " pod="opendatahub/maas-controller-59f5bb5dd-n8qwx"
Sep 07 21:33:31.885484 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:31.885361    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a802688-72d0-42fc-951e-26e8f4c6d5f1-webhook-cert\") pod \"maas-controller-59f5bb5dd-n8qwx\" (UID: \"8a802688-72d0-42fc-951e-26e8f4c6d5f1\") " pod="opendatahub/maas-controller-59f5bb5dd-n8qwx"
Sep 07 21:33:31.885484 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:31.885390    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a802688-72d0-42fc-951e-26e8f4c6d5f1-metrics-certs\") pod \"maas-controller-59f5bb5dd-n8qwx\" (UID: \"8a802688-72d0-42fc-951e-26e8f4c6d5f1\") " pod="opendatahub/maas-controller-59f5bb5dd-n8qwx"
Sep 07 21:33:31.887888 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:31.887868    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a802688-72d0-42fc-951e-26e8f4c6d5f1-webhook-cert\") pod \"maas-controller-59f5bb5dd-n8qwx\" (UID: \"8a802688-72d0-42fc-951e-26e8f4c6d5f1\") " pod="opendatahub/maas-controller-59f5bb5dd-n8qwx"
Sep 07 21:33:31.887961 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:31.887894    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a802688-72d0-42fc-951e-26e8f4c6d5f1-metrics-certs\") pod \"maas-controller-59f5bb5dd-n8qwx\" (UID: \"8a802688-72d0-42fc-951e-26e8f4c6d5f1\") " pod="opendatahub/maas-controller-59f5bb5dd-n8qwx"
Sep 07 21:33:31.893139 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:31.893115    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlg9l\" (UniqueName: \"kubernetes.io/projected/8a802688-72d0-42fc-951e-26e8f4c6d5f1-kube-api-access-jlg9l\") pod \"maas-controller-59f5bb5dd-n8qwx\" (UID: \"8a802688-72d0-42fc-951e-26e8f4c6d5f1\") " pod="opendatahub/maas-controller-59f5bb5dd-n8qwx"
Sep 07 21:33:32.045805 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:32.045719    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59f5bb5dd-n8qwx"
Sep 07 21:33:32.308380 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:32.308350    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e680b14-6972-47f6-b60b-6a0382c6864a" path="/var/lib/kubelet/pods/9e680b14-6972-47f6-b60b-6a0382c6864a/volumes"
Sep 07 21:33:32.326393 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:32.326370    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59f5bb5dd-n8qwx"]
Sep 07 21:33:32.327602 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:33:32.327579    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a802688_72d0_42fc_951e_26e8f4c6d5f1.slice/crio-f49655fdbe2a1dfb9083aea9013b961630c46c6b5687891065b92ad10a2e555d WatchSource:0}: Error finding container f49655fdbe2a1dfb9083aea9013b961630c46c6b5687891065b92ad10a2e555d: Status 404 returned error can't find the container with id f49655fdbe2a1dfb9083aea9013b961630c46c6b5687891065b92ad10a2e555d
Sep 07 21:33:32.947185 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:32.947096    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59f5bb5dd-n8qwx" event={"ID":"8a802688-72d0-42fc-951e-26e8f4c6d5f1","Type":"ContainerStarted","Data":"d5b193f6fa4171c5c0686cd535ca3b4c5c684ba0afc612bffa130603962c965b"}
Sep 07 21:33:32.947185 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:32.947151    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59f5bb5dd-n8qwx" event={"ID":"8a802688-72d0-42fc-951e-26e8f4c6d5f1","Type":"ContainerStarted","Data":"f49655fdbe2a1dfb9083aea9013b961630c46c6b5687891065b92ad10a2e555d"}
Sep 07 21:33:32.947612 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:32.947213    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59f5bb5dd-n8qwx"
Sep 07 21:33:32.964153 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:32.964099    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59f5bb5dd-n8qwx" podStartSLOduration=1.608441126 podStartE2EDuration="1.964079993s" totalImagesPullingTime="355.638867ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:33:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:33:32.962468168 +0000 UTC m=+1909.222285431" watchObservedRunningTime="2026-09-07 21:33:32.964079993 +0000 UTC m=+1909.223897240"
Sep 07 21:33:43.955192 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:33:43.955159    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59f5bb5dd-n8qwx"
Sep 07 21:36:44.429890 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:36:44.429862    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-kv96r_d804af86-d937-4ea6-afb8-760911a10437/console-operator/1.log"
Sep 07 21:36:44.440066 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:36:44.440030    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-kv96r_d804af86-d937-4ea6-afb8-760911a10437/console-operator/1.log"
Sep 07 21:36:44.636974 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:36:44.636942    2558 scope.go:117] "RemoveContainer" containerID="f94476b6694126973c1bac1af0f9c82e2c67c77956114f584508884fcc32ebbe"
Sep 07 21:37:07.943952 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:07.943923    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7844d4b579-x7bqc"]
Sep 07 21:37:07.947487 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:07.947466    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7844d4b579-x7bqc"
Sep 07 21:37:07.966082 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:07.966060    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7844d4b579-x7bqc"]
Sep 07 21:37:08.058279 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:08.058246    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41b1c2f5-a275-46d9-af66-4b6674a70abf-openshift-service-ca\") pod \"maas-api-7844d4b579-x7bqc\" (UID: \"41b1c2f5-a275-46d9-af66-4b6674a70abf\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-x7bqc"
Sep 07 21:37:08.058466 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:08.058366    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41b1c2f5-a275-46d9-af66-4b6674a70abf-metrics-certs\") pod \"maas-api-7844d4b579-x7bqc\" (UID: \"41b1c2f5-a275-46d9-af66-4b6674a70abf\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-x7bqc"
Sep 07 21:37:08.058466 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:08.058441    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41b1c2f5-a275-46d9-af66-4b6674a70abf-maas-api-tls\") pod \"maas-api-7844d4b579-x7bqc\" (UID: \"41b1c2f5-a275-46d9-af66-4b6674a70abf\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-x7bqc"
Sep 07 21:37:08.058564 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:08.058488    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxzcp\" (UniqueName: \"kubernetes.io/projected/41b1c2f5-a275-46d9-af66-4b6674a70abf-kube-api-access-wxzcp\") pod \"maas-api-7844d4b579-x7bqc\" (UID: \"41b1c2f5-a275-46d9-af66-4b6674a70abf\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-x7bqc"
Sep 07 21:37:08.159608 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:08.159573    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41b1c2f5-a275-46d9-af66-4b6674a70abf-openshift-service-ca\") pod \"maas-api-7844d4b579-x7bqc\" (UID: \"41b1c2f5-a275-46d9-af66-4b6674a70abf\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-x7bqc"
Sep 07 21:37:08.159803 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:08.159627    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41b1c2f5-a275-46d9-af66-4b6674a70abf-metrics-certs\") pod \"maas-api-7844d4b579-x7bqc\" (UID: \"41b1c2f5-a275-46d9-af66-4b6674a70abf\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-x7bqc"
Sep 07 21:37:08.159803 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:08.159668    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41b1c2f5-a275-46d9-af66-4b6674a70abf-maas-api-tls\") pod \"maas-api-7844d4b579-x7bqc\" (UID: \"41b1c2f5-a275-46d9-af66-4b6674a70abf\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-x7bqc"
Sep 07 21:37:08.159803 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:08.159709    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxzcp\" (UniqueName: \"kubernetes.io/projected/41b1c2f5-a275-46d9-af66-4b6674a70abf-kube-api-access-wxzcp\") pod \"maas-api-7844d4b579-x7bqc\" (UID: \"41b1c2f5-a275-46d9-af66-4b6674a70abf\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-x7bqc"
Sep 07 21:37:08.160397 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:08.160371    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41b1c2f5-a275-46d9-af66-4b6674a70abf-openshift-service-ca\") pod \"maas-api-7844d4b579-x7bqc\" (UID: \"41b1c2f5-a275-46d9-af66-4b6674a70abf\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-x7bqc"
Sep 07 21:37:08.162269 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:08.162235    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41b1c2f5-a275-46d9-af66-4b6674a70abf-maas-api-tls\") pod \"maas-api-7844d4b579-x7bqc\" (UID: \"41b1c2f5-a275-46d9-af66-4b6674a70abf\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-x7bqc"
Sep 07 21:37:08.162377 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:08.162323    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41b1c2f5-a275-46d9-af66-4b6674a70abf-metrics-certs\") pod \"maas-api-7844d4b579-x7bqc\" (UID: \"41b1c2f5-a275-46d9-af66-4b6674a70abf\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-x7bqc"
Sep 07 21:37:08.166812 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:08.166793    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxzcp\" (UniqueName: \"kubernetes.io/projected/41b1c2f5-a275-46d9-af66-4b6674a70abf-kube-api-access-wxzcp\") pod \"maas-api-7844d4b579-x7bqc\" (UID: \"41b1c2f5-a275-46d9-af66-4b6674a70abf\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-x7bqc"
Sep 07 21:37:08.257982 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:08.257892    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7844d4b579-x7bqc"
Sep 07 21:37:08.533716 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:08.533682    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7844d4b579-x7bqc"]
Sep 07 21:37:08.535147 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:37:08.535116    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b1c2f5_a275_46d9_af66_4b6674a70abf.slice/crio-6686d9ca6d7845d652f8283d4c52f046db4b2f2da891efc91ff79a6ce9a5bbb7 WatchSource:0}: Error finding container 6686d9ca6d7845d652f8283d4c52f046db4b2f2da891efc91ff79a6ce9a5bbb7: Status 404 returned error can't find the container with id 6686d9ca6d7845d652f8283d4c52f046db4b2f2da891efc91ff79a6ce9a5bbb7
Sep 07 21:37:09.158323 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:09.158263    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7844d4b579-x7bqc" event={"ID":"41b1c2f5-a275-46d9-af66-4b6674a70abf","Type":"ContainerStarted","Data":"1f47d592f791eaa05b82707d869af322fa6375270800bd50fc7c7295869a2157"}
Sep 07 21:37:09.158809 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:09.158353    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7844d4b579-x7bqc" event={"ID":"41b1c2f5-a275-46d9-af66-4b6674a70abf","Type":"ContainerStarted","Data":"6686d9ca6d7845d652f8283d4c52f046db4b2f2da891efc91ff79a6ce9a5bbb7"}
Sep 07 21:37:09.158809 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:09.158801    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7844d4b579-x7bqc"
Sep 07 21:37:09.177714 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:09.177657    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7844d4b579-x7bqc" podStartSLOduration=1.77661626 podStartE2EDuration="2.177635644s" totalImagesPullingTime="401.019384ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:37:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:37:09.176835265 +0000 UTC m=+2125.436652521" watchObservedRunningTime="2026-09-07 21:37:09.177635644 +0000 UTC m=+2125.437452888"
Sep 07 21:37:15.169676 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:15.169647    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7844d4b579-x7bqc"
Sep 07 21:37:15.216582 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:15.216550    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"]
Sep 07 21:37:15.216767 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:15.216742    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh" podUID="e06b20dc-b600-4188-adbd-1130b45a8114" containerName="maas-api" containerID="cri-o://7348d82cfe8e48250aca974edc0aa614cd843d8582e07886092c691669561293" gracePeriod=30
Sep 07 21:37:16.476807 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:16.476778    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"
Sep 07 21:37:16.644179 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:16.644140    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e06b20dc-b600-4188-adbd-1130b45a8114-maas-api-tls\") pod \"e06b20dc-b600-4188-adbd-1130b45a8114\" (UID: \"e06b20dc-b600-4188-adbd-1130b45a8114\") "
Sep 07 21:37:16.644407 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:16.644189    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2zv5\" (UniqueName: \"kubernetes.io/projected/e06b20dc-b600-4188-adbd-1130b45a8114-kube-api-access-c2zv5\") pod \"e06b20dc-b600-4188-adbd-1130b45a8114\" (UID: \"e06b20dc-b600-4188-adbd-1130b45a8114\") "
Sep 07 21:37:16.644407 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:16.644239    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e06b20dc-b600-4188-adbd-1130b45a8114-openshift-service-ca\") pod \"e06b20dc-b600-4188-adbd-1130b45a8114\" (UID: \"e06b20dc-b600-4188-adbd-1130b45a8114\") "
Sep 07 21:37:16.644407 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:16.644281    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e06b20dc-b600-4188-adbd-1130b45a8114-metrics-certs\") pod \"e06b20dc-b600-4188-adbd-1130b45a8114\" (UID: \"e06b20dc-b600-4188-adbd-1130b45a8114\") "
Sep 07 21:37:16.644666 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:16.644642    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e06b20dc-b600-4188-adbd-1130b45a8114-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e06b20dc-b600-4188-adbd-1130b45a8114" (UID: "e06b20dc-b600-4188-adbd-1130b45a8114"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:37:16.646357 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:16.646327    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e06b20dc-b600-4188-adbd-1130b45a8114-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e06b20dc-b600-4188-adbd-1130b45a8114" (UID: "e06b20dc-b600-4188-adbd-1130b45a8114"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:37:16.646476 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:16.646451    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e06b20dc-b600-4188-adbd-1130b45a8114-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e06b20dc-b600-4188-adbd-1130b45a8114" (UID: "e06b20dc-b600-4188-adbd-1130b45a8114"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:37:16.646732 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:16.646715    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e06b20dc-b600-4188-adbd-1130b45a8114-kube-api-access-c2zv5" (OuterVolumeSpecName: "kube-api-access-c2zv5") pod "e06b20dc-b600-4188-adbd-1130b45a8114" (UID: "e06b20dc-b600-4188-adbd-1130b45a8114"). InnerVolumeSpecName "kube-api-access-c2zv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:37:16.745145 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:16.745101    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e06b20dc-b600-4188-adbd-1130b45a8114-maas-api-tls\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:37:16.745145 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:16.745137    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2zv5\" (UniqueName: \"kubernetes.io/projected/e06b20dc-b600-4188-adbd-1130b45a8114-kube-api-access-c2zv5\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:37:16.745145 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:16.745150    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e06b20dc-b600-4188-adbd-1130b45a8114-openshift-service-ca\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:37:16.745425 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:16.745162    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e06b20dc-b600-4188-adbd-1130b45a8114-metrics-certs\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\""
Sep 07 21:37:17.206108 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:17.206074    2558 generic.go:356] "Generic (PLEG): container finished" podID="e06b20dc-b600-4188-adbd-1130b45a8114" containerID="7348d82cfe8e48250aca974edc0aa614cd843d8582e07886092c691669561293" exitCode=0
Sep 07 21:37:17.206290 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:17.206116    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"
Sep 07 21:37:17.206290 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:17.206155    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh" event={"ID":"e06b20dc-b600-4188-adbd-1130b45a8114","Type":"ContainerDied","Data":"7348d82cfe8e48250aca974edc0aa614cd843d8582e07886092c691669561293"}
Sep 07 21:37:17.206290 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:17.206209    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh" event={"ID":"e06b20dc-b600-4188-adbd-1130b45a8114","Type":"ContainerDied","Data":"8eb4cde15aafd0bb7b5d72d894de06711cbe6d6d28e7eed3c90ddf052eae02e8"}
Sep 07 21:37:17.206290 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:17.206232    2558 scope.go:117] "RemoveContainer" containerID="7348d82cfe8e48250aca974edc0aa614cd843d8582e07886092c691669561293"
Sep 07 21:37:17.216138 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:17.216121    2558 scope.go:117] "RemoveContainer" containerID="7348d82cfe8e48250aca974edc0aa614cd843d8582e07886092c691669561293"
Sep 07 21:37:17.216419 ip-10-0-143-142 kubenswrapper[2558]: E0907 21:37:17.216396    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7348d82cfe8e48250aca974edc0aa614cd843d8582e07886092c691669561293\": container with ID starting with 7348d82cfe8e48250aca974edc0aa614cd843d8582e07886092c691669561293 not found: ID does not exist" containerID="7348d82cfe8e48250aca974edc0aa614cd843d8582e07886092c691669561293"
Sep 07 21:37:17.216507 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:17.216424    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7348d82cfe8e48250aca974edc0aa614cd843d8582e07886092c691669561293"} err="failed to get container status \"7348d82cfe8e48250aca974edc0aa614cd843d8582e07886092c691669561293\": rpc error: code = NotFound desc = could not find container \"7348d82cfe8e48250aca974edc0aa614cd843d8582e07886092c691669561293\": container with ID starting with 7348d82cfe8e48250aca974edc0aa614cd843d8582e07886092c691669561293 not found: ID does not exist"
Sep 07 21:37:17.230735 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:17.230709    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"]
Sep 07 21:37:17.233983 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:17.233962    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7fd99f4487-75zrh"]
Sep 07 21:37:18.308687 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:18.308656    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e06b20dc-b600-4188-adbd-1130b45a8114" path="/var/lib/kubelet/pods/e06b20dc-b600-4188-adbd-1130b45a8114/volumes"
Sep 07 21:37:48.276358 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:48.276319    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59f5bb5dd-n8qwx_8a802688-72d0-42fc-951e-26e8f4c6d5f1/manager/0.log"
Sep 07 21:37:48.386895 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:48.386872    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-b48cx_693558c0-fde6-48d9-845f-21f2d3784c58/server/0.log"
Sep 07 21:37:48.505448 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:48.505411    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-6kmmw_12fd3d5d-1931-4dd1-9209-96bc9467e957/manager/0.log"
Sep 07 21:37:48.735102 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:48.735073    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56489b9975-l2tfx_387267bb-8c85-48ed-89f9-b6ecc8580e99/copy-manifests/0.log"
Sep 07 21:37:48.741581 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:48.741562    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56489b9975-l2tfx_387267bb-8c85-48ed-89f9-b6ecc8580e99/manager/0.log"
Sep 07 21:37:49.313290 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:49.313252    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7844d4b579-x7bqc_41b1c2f5-a275-46d9-af66-4b6674a70abf/maas-api/0.log"
Sep 07 21:37:49.644526 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:49.644452    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-mwzrx_e8f13238-2fdf-45ce-8a06-ffbd270b33ce/postgres/0.log"
Sep 07 21:37:50.508126 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:50.508095    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-tbpj2_c593e9e1-f878-4bdf-9df7-73d889296964/manager/0.log"
Sep 07 21:37:50.615659 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:50.615627    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-xg25t_089701ef-604b-4d35-a5b2-6cac3448486e/manager/0.log"
Sep 07 21:37:51.420253 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:51.420221    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b_54c7e865-1815-45a2-a362-fedd2c89aeed/istio-proxy/0.log"
Sep 07 21:37:51.534100 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:51.534067    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gpwnm_29063649-cdae-425f-bfa8-00eb70f6f132/discovery/0.log"
Sep 07 21:37:51.642500 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:51.642471    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58b8d644dc-6cm72_b82ae09f-78de-4419-a2d5-12e058c42486/kube-auth-proxy/0.log"
Sep 07 21:37:51.867897 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:51.867865    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-f8cm7_ef9ca3c5-5438-430a-8b66-8862c766feb8/istio-proxy/1.log"
Sep 07 21:37:51.978322 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:51.978281    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-98j97_6cbff39d-1a82-477b-bbab-d9ee5703f17d/payload-pre-processing/0.log"
Sep 07 21:37:52.537958 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:52.537930    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-5b9cb_ada87056-3aea-43b7-848b-1718c97b0ae5/main/0.log"
Sep 07 21:37:52.868806 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:52.868775    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-glhbx_73cc8345-f8db-40d7-9411-0f71b6ebc349/main/0.log"
Sep 07 21:37:52.974303 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:37:52.974273    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq4lzf_a228fe2f-5f72-4f10-8142-7c80edb731a9/main/0.log"
Sep 07 21:38:01.903395 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:01.903365    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-59tw4_fe0c1618-8f48-4a50-8791-83c8e388f13d/global-pull-secret-syncer/0.log"
Sep 07 21:38:02.066121 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:02.066086    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lpqw2_7d4745ec-df88-4612-ab32-e7760d88135f/konnectivity-agent/0.log"
Sep 07 21:38:02.171818 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:02.171714    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-142.ec2.internal_59c9c5e403678a260928e5c39ca263d2/haproxy/0.log"
Sep 07 21:38:06.534499 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:06.534456    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-tbpj2_c593e9e1-f878-4bdf-9df7-73d889296964/manager/0.log"
Sep 07 21:38:06.568714 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:06.568687    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-xg25t_089701ef-604b-4d35-a5b2-6cac3448486e/manager/0.log"
Sep 07 21:38:08.395700 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:08.395670    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-k6n9v_bb3aeff8-79f8-4dfd-8b1c-bdac3ff92b3b/cluster-monitoring-operator/0.log"
Sep 07 21:38:08.648830 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:08.648731    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k2wzp_d9dfd0ad-45b4-40b8-abd6-98f6130574a1/node-exporter/0.log"
Sep 07 21:38:08.677132 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:08.677111    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k2wzp_d9dfd0ad-45b4-40b8-abd6-98f6130574a1/kube-rbac-proxy/0.log"
Sep 07 21:38:08.702477 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:08.702453    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k2wzp_d9dfd0ad-45b4-40b8-abd6-98f6130574a1/init-textfile/0.log"
Sep 07 21:38:09.063953 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:09.063924    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-drfcd_e821c5fa-6b29-46b5-afe5-33be835f9f52/prometheus-operator/0.log"
Sep 07 21:38:09.087441 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:09.087395    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-drfcd_e821c5fa-6b29-46b5-afe5-33be835f9f52/kube-rbac-proxy/0.log"
Sep 07 21:38:11.591907 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:11.591862    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-kv96r_d804af86-d937-4ea6-afb8-760911a10437/console-operator/1.log"
Sep 07 21:38:11.596269 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:11.596246    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-kv96r_d804af86-d937-4ea6-afb8-760911a10437/console-operator/2.log"
Sep 07 21:38:12.113504 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.113472    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447"]
Sep 07 21:38:12.113854 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.113842    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e06b20dc-b600-4188-adbd-1130b45a8114" containerName="maas-api"
Sep 07 21:38:12.113898 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.113855    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e06b20dc-b600-4188-adbd-1130b45a8114" containerName="maas-api"
Sep 07 21:38:12.113934 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.113920    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e06b20dc-b600-4188-adbd-1130b45a8114" containerName="maas-api"
Sep 07 21:38:12.117248 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.117227    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447"
Sep 07 21:38:12.119577 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.119558    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z6sq6\"/\"openshift-service-ca.crt\""
Sep 07 21:38:12.119680 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.119595    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z6sq6\"/\"default-dockercfg-6fhnj\""
Sep 07 21:38:12.120435 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.120417    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z6sq6\"/\"kube-root-ca.crt\""
Sep 07 21:38:12.126773 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.126747    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447"]
Sep 07 21:38:12.149739 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.149712    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7527ec9-a76f-4740-8172-ac9c46103e1b-sys\") pod \"perf-node-gather-daemonset-2x447\" (UID: \"a7527ec9-a76f-4740-8172-ac9c46103e1b\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447"
Sep 07 21:38:12.149884 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.149743    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a7527ec9-a76f-4740-8172-ac9c46103e1b-proc\") pod \"perf-node-gather-daemonset-2x447\" (UID: \"a7527ec9-a76f-4740-8172-ac9c46103e1b\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447"
Sep 07 21:38:12.149884 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.149775    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7527ec9-a76f-4740-8172-ac9c46103e1b-lib-modules\") pod \"perf-node-gather-daemonset-2x447\" (UID: \"a7527ec9-a76f-4740-8172-ac9c46103e1b\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447"
Sep 07 21:38:12.149884 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.149805    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a7527ec9-a76f-4740-8172-ac9c46103e1b-podres\") pod \"perf-node-gather-daemonset-2x447\" (UID: \"a7527ec9-a76f-4740-8172-ac9c46103e1b\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447"
Sep 07 21:38:12.149884 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.149845    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdbmf\" (UniqueName: \"kubernetes.io/projected/a7527ec9-a76f-4740-8172-ac9c46103e1b-kube-api-access-fdbmf\") pod \"perf-node-gather-daemonset-2x447\" (UID: \"a7527ec9-a76f-4740-8172-ac9c46103e1b\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447"
Sep 07 21:38:12.250353 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.250293    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7527ec9-a76f-4740-8172-ac9c46103e1b-sys\") pod \"perf-node-gather-daemonset-2x447\" (UID: \"a7527ec9-a76f-4740-8172-ac9c46103e1b\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447"
Sep 07 21:38:12.250353 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.250353    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a7527ec9-a76f-4740-8172-ac9c46103e1b-proc\") pod \"perf-node-gather-daemonset-2x447\" (UID: \"a7527ec9-a76f-4740-8172-ac9c46103e1b\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447"
Sep 07 21:38:12.250584 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.250386    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7527ec9-a76f-4740-8172-ac9c46103e1b-lib-modules\") pod \"perf-node-gather-daemonset-2x447\" (UID: \"a7527ec9-a76f-4740-8172-ac9c46103e1b\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447"
Sep 07 21:38:12.250584 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.250410    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a7527ec9-a76f-4740-8172-ac9c46103e1b-podres\") pod \"perf-node-gather-daemonset-2x447\" (UID: \"a7527ec9-a76f-4740-8172-ac9c46103e1b\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447"
Sep 07 21:38:12.250584 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.250423    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7527ec9-a76f-4740-8172-ac9c46103e1b-sys\") pod \"perf-node-gather-daemonset-2x447\" (UID: \"a7527ec9-a76f-4740-8172-ac9c46103e1b\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447"
Sep 07 21:38:12.250584 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.250472    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdbmf\" (UniqueName: \"kubernetes.io/projected/a7527ec9-a76f-4740-8172-ac9c46103e1b-kube-api-access-fdbmf\") pod \"perf-node-gather-daemonset-2x447\" (UID: \"a7527ec9-a76f-4740-8172-ac9c46103e1b\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447"
Sep 07 21:38:12.250584 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.250505    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a7527ec9-a76f-4740-8172-ac9c46103e1b-proc\") pod \"perf-node-gather-daemonset-2x447\" (UID: \"a7527ec9-a76f-4740-8172-ac9c46103e1b\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447"
Sep 07 21:38:12.250584 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.250547    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a7527ec9-a76f-4740-8172-ac9c46103e1b-podres\") pod \"perf-node-gather-daemonset-2x447\" (UID: \"a7527ec9-a76f-4740-8172-ac9c46103e1b\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447"
Sep 07 21:38:12.250584 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.250547    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7527ec9-a76f-4740-8172-ac9c46103e1b-lib-modules\") pod \"perf-node-gather-daemonset-2x447\" (UID: \"a7527ec9-a76f-4740-8172-ac9c46103e1b\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447"
Sep 07 21:38:12.258497 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.258478    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdbmf\" (UniqueName: \"kubernetes.io/projected/a7527ec9-a76f-4740-8172-ac9c46103e1b-kube-api-access-fdbmf\") pod \"perf-node-gather-daemonset-2x447\" (UID: \"a7527ec9-a76f-4740-8172-ac9c46103e1b\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447"
Sep 07 21:38:12.427564 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.427467    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447"
Sep 07 21:38:12.700211 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.700090    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447"]
Sep 07 21:38:12.703840 ip-10-0-143-142 kubenswrapper[2558]: W0907 21:38:12.703802    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda7527ec9_a76f_4740_8172_ac9c46103e1b.slice/crio-4abecc289e3eea437aac2d180c789586f0c06c1c1f4d2dc5fe071e8e886b0d68 WatchSource:0}: Error finding container 4abecc289e3eea437aac2d180c789586f0c06c1c1f4d2dc5fe071e8e886b0d68: Status 404 returned error can't find the container with id 4abecc289e3eea437aac2d180c789586f0c06c1c1f4d2dc5fe071e8e886b0d68
Sep 07 21:38:12.879771 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:12.879739    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-cltp8_2ef590f6-875d-4b00-84fb-4a7457ba3c78/volume-data-source-validator/0.log"
Sep 07 21:38:13.524061 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:13.524027    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447" event={"ID":"a7527ec9-a76f-4740-8172-ac9c46103e1b","Type":"ContainerStarted","Data":"7f7296c08aabacb9df74884abb6a09c51ffca98987f08e52aadfd25ecd6f7d1d"}
Sep 07 21:38:13.524245 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:13.524081    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447" event={"ID":"a7527ec9-a76f-4740-8172-ac9c46103e1b","Type":"ContainerStarted","Data":"4abecc289e3eea437aac2d180c789586f0c06c1c1f4d2dc5fe071e8e886b0d68"}
Sep 07 21:38:13.524245 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:13.524113    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447"
Sep 07 21:38:13.540981 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:13.540926    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447" podStartSLOduration=1.54090304 podStartE2EDuration="1.54090304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:38:13.539468902 +0000 UTC m=+2189.799286142" watchObservedRunningTime="2026-09-07 21:38:13.54090304 +0000 UTC m=+2189.800720284"
Sep 07 21:38:14.089514 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:14.089485    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rzj7z_fbff6cc7-efb5-42e9-939f-df51e82cdfb4/dns/0.log"
Sep 07 21:38:14.110091 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:14.110069    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rzj7z_fbff6cc7-efb5-42e9-939f-df51e82cdfb4/kube-rbac-proxy/0.log"
Sep 07 21:38:14.206169 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:14.206131    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v85rk_6950b669-151a-4c2e-a928-be0eca0f92ee/dns-node-resolver/0.log"
Sep 07 21:38:14.771145 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:14.771110    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-785c8f8569-79wxv_3d5a0dcd-8707-41fc-8537-7584c84a02c0/registry/0.log"
Sep 07 21:38:14.838019 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:14.837992    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n9n5j_c90a86fc-5b8f-44e5-a429-1cd91bed305f/node-ca/0.log"
Sep 07 21:38:15.763064 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:15.763031    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b_54c7e865-1815-45a2-a362-fedd2c89aeed/istio-proxy/0.log"
Sep 07 21:38:16.046487 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:16.046406    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gpwnm_29063649-cdae-425f-bfa8-00eb70f6f132/discovery/0.log"
Sep 07 21:38:16.067872 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:16.067851    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58b8d644dc-6cm72_b82ae09f-78de-4419-a2d5-12e058c42486/kube-auth-proxy/0.log"
Sep 07 21:38:16.117737 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:16.117701    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-f8cm7_ef9ca3c5-5438-430a-8b66-8862c766feb8/istio-proxy/0.log"
Sep 07 21:38:16.127013 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:16.126985    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-f8cm7_ef9ca3c5-5438-430a-8b66-8862c766feb8/istio-proxy/1.log"
Sep 07 21:38:16.158523 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:16.158498    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-98j97_6cbff39d-1a82-477b-bbab-d9ee5703f17d/payload-pre-processing/0.log"
Sep 07 21:38:17.120778 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:17.120745    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xpdlp_f76762af-86f7-4a30-8dc8-020c23a07d5c/serve-healthcheck-canary/0.log"
Sep 07 21:38:17.663626 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:17.663598    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h564t_df6a2659-d7a1-4e72-93ec-5445745ac38a/kube-rbac-proxy/0.log"
Sep 07 21:38:17.683408 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:17.683389    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h564t_df6a2659-d7a1-4e72-93ec-5445745ac38a/exporter/0.log"
Sep 07 21:38:17.703459 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:17.703437    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h564t_df6a2659-d7a1-4e72-93ec-5445745ac38a/extractor/0.log"
Sep 07 21:38:19.545303 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:19.545277    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-2x447"
Sep 07 21:38:20.061632 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:20.061605    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59f5bb5dd-n8qwx_8a802688-72d0-42fc-951e-26e8f4c6d5f1/manager/0.log"
Sep 07 21:38:20.082014 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:20.081986    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-b48cx_693558c0-fde6-48d9-845f-21f2d3784c58/server/0.log"
Sep 07 21:38:20.157060 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:20.157031    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-6kmmw_12fd3d5d-1931-4dd1-9209-96bc9467e957/manager/0.log"
Sep 07 21:38:20.236475 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:20.236443    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56489b9975-l2tfx_387267bb-8c85-48ed-89f9-b6ecc8580e99/manager/0.log"
Sep 07 21:38:20.260342 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:20.260299    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56489b9975-l2tfx_387267bb-8c85-48ed-89f9-b6ecc8580e99/copy-manifests/0.log"
Sep 07 21:38:22.544526 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:22.544447    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b_54c7e865-1815-45a2-a362-fedd2c89aeed/istio-proxy/0.log"
Sep 07 21:38:22.811072 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:22.811029    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gpwnm_29063649-cdae-425f-bfa8-00eb70f6f132/discovery/0.log"
Sep 07 21:38:22.820691 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:22.820654    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58b8d644dc-6cm72_b82ae09f-78de-4419-a2d5-12e058c42486/kube-auth-proxy/0.log"
Sep 07 21:38:22.851653 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:22.851624    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-f8cm7_ef9ca3c5-5438-430a-8b66-8862c766feb8/istio-proxy/0.log"
Sep 07 21:38:22.860303 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:22.860261    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-f8cm7_ef9ca3c5-5438-430a-8b66-8862c766feb8/istio-proxy/1.log"
Sep 07 21:38:22.882942 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:22.882911    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-98j97_6cbff39d-1a82-477b-bbab-d9ee5703f17d/payload-pre-processing/0.log"
Sep 07 21:38:24.494022 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:24.493979    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b_54c7e865-1815-45a2-a362-fedd2c89aeed/istio-proxy/0.log"
Sep 07 21:38:24.772679 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:24.772584    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gpwnm_29063649-cdae-425f-bfa8-00eb70f6f132/discovery/0.log"
Sep 07 21:38:24.792852 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:24.792823    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58b8d644dc-6cm72_b82ae09f-78de-4419-a2d5-12e058c42486/kube-auth-proxy/0.log"
Sep 07 21:38:24.829659 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:24.829633    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-f8cm7_ef9ca3c5-5438-430a-8b66-8862c766feb8/istio-proxy/0.log"
Sep 07 21:38:24.842054 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:24.842022    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-f8cm7_ef9ca3c5-5438-430a-8b66-8862c766feb8/istio-proxy/1.log"
Sep 07 21:38:24.866028 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:24.866000    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-98j97_6cbff39d-1a82-477b-bbab-d9ee5703f17d/payload-pre-processing/0.log"
Sep 07 21:38:28.352328 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:28.352283    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-95cj9_c318991f-ebca-4f61-8ff5-c09ea86743fa/kube-multus/0.log"
Sep 07 21:38:28.673485 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:28.673404    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xgnwf_49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5/kube-multus-additional-cni-plugins/0.log"
Sep 07 21:38:28.696452 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:28.696422    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xgnwf_49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5/egress-router-binary-copy/0.log"
Sep 07 21:38:28.718510 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:28.718488    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xgnwf_49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5/cni-plugins/0.log"
Sep 07 21:38:28.740690 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:28.740664    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xgnwf_49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5/bond-cni-plugin/0.log"
Sep 07 21:38:28.765154 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:28.765129    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xgnwf_49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5/routeoverride-cni/0.log"
Sep 07 21:38:28.786862 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:28.786840    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xgnwf_49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5/whereabouts-cni-bincopy/0.log"
Sep 07 21:38:28.807412 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:28.807390    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xgnwf_49b7fb02-83fe-4bd2-a1cd-d51f05fe7ee5/whereabouts-cni/0.log"
Sep 07 21:38:28.910652 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:28.910623    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-67mj7_0439cb5a-ba34-4a77-9469-f790e6d37dbc/network-metrics-daemon/0.log"
Sep 07 21:38:28.929801 ip-10-0-143-142 kubenswrapper[2558]: I0907 21:38:28.929731    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-67mj7_0439cb5a-ba34-4a77-9469-f790e6d37dbc/kube-rbac-proxy/0.log"