Aug 04 18:27:59.357907 ip-10-0-132-214 systemd[1]: Starting Kubernetes Kubelet...
Aug 04 18:27:59.736173 ip-10-0-132-214 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 18:27:59.736173 ip-10-0-132-214 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 04 18:27:59.736173 ip-10-0-132-214 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 18:27:59.736173 ip-10-0-132-214 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 04 18:27:59.736173 ip-10-0-132-214 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 18:27:59.738187 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.738073    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 04 18:27:59.742252 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742235    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:27:59.742252 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742252    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:27:59.742322 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742256    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:27:59.742322 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742259    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:27:59.742322 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742263    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:27:59.742322 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742266    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:27:59.742322 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742268    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:27:59.742322 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742271    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:27:59.742322 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742276    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:27:59.742322 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742278    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:27:59.742322 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742281    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:27:59.742322 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742283    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:27:59.742322 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742286    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:27:59.742322 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742289    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:27:59.742322 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742292    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:27:59.742322 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742295    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:27:59.742322 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742297    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:27:59.742322 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742300    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:27:59.742322 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742303    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:27:59.742322 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742306    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:27:59.742322 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742309    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:27:59.742322 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742311    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:27:59.742811 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742314    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:27:59.742811 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742317    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:27:59.742811 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742320    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:27:59.742811 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742323    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:27:59.742811 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742326    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:27:59.742811 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742329    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:27:59.742811 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742331    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:27:59.742811 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742335    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:27:59.742811 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742338    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:27:59.742811 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742340    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:27:59.742811 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742344    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:27:59.742811 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742346    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:27:59.742811 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742349    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:27:59.742811 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742351    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:27:59.742811 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742354    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:27:59.742811 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742357    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:27:59.742811 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742359    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:27:59.742811 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742363    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:27:59.742811 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742365    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:27:59.742811 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742368    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:27:59.743386 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742372    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:27:59.743386 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742376    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:27:59.743386 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742380    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:27:59.743386 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742382    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:27:59.743386 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742385    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:27:59.743386 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742388    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:27:59.743386 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742390    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:27:59.743386 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742393    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:27:59.743386 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742396    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:27:59.743386 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742398    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:27:59.743386 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742401    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:27:59.743386 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742404    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:27:59.743386 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742406    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:27:59.743386 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742410    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:27:59.743386 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742413    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:27:59.743386 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742415    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:27:59.743386 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742419    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:27:59.743386 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742423    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:27:59.743386 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742426    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:27:59.743906 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742429    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:27:59.743906 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742432    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:27:59.743906 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742434    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:27:59.743906 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742437    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:27:59.743906 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742439    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:27:59.743906 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742442    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:27:59.743906 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742444    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:27:59.743906 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742447    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:27:59.743906 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742449    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:27:59.743906 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742452    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:27:59.743906 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742455    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:27:59.743906 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742458    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:27:59.743906 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742462    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:27:59.743906 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742464    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:27:59.743906 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742467    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:27:59.743906 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742470    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:27:59.743906 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742472    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:27:59.743906 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742475    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:27:59.743906 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742477    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:27:59.743906 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742480    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:27:59.744397 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742482    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:27:59.744397 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742485    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:27:59.744397 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742488    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:27:59.744397 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742490    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:27:59.744397 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742493    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:27:59.744397 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742495    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:27:59.744397 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742500    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:27:59.744397 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742503    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:27:59.744397 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742506    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:27:59.744397 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742508    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:27:59.744397 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742511    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:27:59.744397 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742515    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:27:59.744397 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742519    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:27:59.744397 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742522    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:27:59.744397 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742525    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:27:59.744397 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742528    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:27:59.744397 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742531    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:27:59.744397 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.742534    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:27:59.744397 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743271    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:27:59.744397 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743277    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:27:59.744884 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743281    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:27:59.744884 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743284    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:27:59.744884 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743287    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:27:59.744884 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743293    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:27:59.744884 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743296    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:27:59.744884 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743299    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:27:59.744884 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743302    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:27:59.744884 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743306    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:27:59.744884 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743308    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:27:59.744884 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743311    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:27:59.744884 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743314    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:27:59.744884 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743316    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:27:59.744884 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743319    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:27:59.744884 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743322    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:27:59.744884 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743326    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:27:59.744884 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743329    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:27:59.744884 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743332    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:27:59.744884 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743335    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:27:59.744884 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743339    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:27:59.745361 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743341    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:27:59.745361 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743344    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:27:59.745361 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743346    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:27:59.745361 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743349    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:27:59.745361 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743352    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:27:59.745361 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743354    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:27:59.745361 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743357    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:27:59.745361 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743359    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:27:59.745361 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743362    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:27:59.745361 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743364    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:27:59.745361 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743366    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:27:59.745361 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743369    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:27:59.745361 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743371    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:27:59.745361 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743374    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:27:59.745361 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743377    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:27:59.745361 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743379    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:27:59.745361 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743382    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:27:59.745361 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743384    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:27:59.745361 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743387    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:27:59.745361 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743390    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:27:59.745872 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743393    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:27:59.745872 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743395    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:27:59.745872 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743398    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:27:59.745872 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743401    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:27:59.745872 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743403    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:27:59.745872 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743406    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:27:59.745872 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743408    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:27:59.745872 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743412    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:27:59.745872 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743415    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:27:59.745872 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743418    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:27:59.745872 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743420    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:27:59.745872 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743423    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:27:59.745872 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743426    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:27:59.745872 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743429    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:27:59.745872 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743433    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:27:59.745872 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743437    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:27:59.745872 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743440    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:27:59.745872 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743443    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:27:59.745872 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743445    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:27:59.746342 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743448    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:27:59.746342 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743451    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:27:59.746342 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743454    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:27:59.746342 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743457    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:27:59.746342 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743459    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:27:59.746342 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743462    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:27:59.746342 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743465    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:27:59.746342 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743467    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:27:59.746342 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743470    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:27:59.746342 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743472    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:27:59.746342 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743474    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:27:59.746342 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743477    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:27:59.746342 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743480    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:27:59.746342 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743483    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:27:59.746342 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743485    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:27:59.746342 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743488    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:27:59.746342 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743491    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:27:59.746342 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743493    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:27:59.746342 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743497    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:27:59.746827 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743500    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:27:59.746827 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743503    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:27:59.746827 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743507    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:27:59.746827 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743509    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:27:59.746827 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743512    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:27:59.746827 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743515    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:27:59.746827 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743518    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:27:59.746827 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743520    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:27:59.746827 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743523    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:27:59.746827 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743525    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:27:59.746827 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743528    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:27:59.746827 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743530    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:27:59.746827 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743533    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:27:59.746827 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743535    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:27:59.746827 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743538    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:27:59.746827 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743540    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:27:59.746827 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743544    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:27:59.746827 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743547    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:27:59.746827 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743550    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:27:59.746827 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743553    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:27:59.747308 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743934    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:27:59.747308 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743940    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:27:59.747308 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743943    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:27:59.747308 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743945    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:27:59.747308 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743948    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:27:59.747308 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743952    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:27:59.747308 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743954    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:27:59.747308 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743957    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:27:59.747308 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743960    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:27:59.747308 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743962    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:27:59.747308 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743965    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:27:59.747308 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743968    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:27:59.747308 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743970    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:27:59.747308 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743973    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:27:59.747308 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743975    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:27:59.747308 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743979    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:27:59.747308 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743981    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:27:59.747308 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743984    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:27:59.747308 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743986    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:27:59.747774 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743989    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:27:59.747774 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743991    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:27:59.747774 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743995    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:27:59.747774 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.743997    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:27:59.747774 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744000    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:27:59.747774 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744002    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:27:59.747774 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744005    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:27:59.747774 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744007    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:27:59.747774 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744010    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:27:59.747774 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744012    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:27:59.747774 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744017    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:27:59.747774 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744020    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:27:59.747774 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744023    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:27:59.747774 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744026    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:27:59.747774 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744029    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:27:59.747774 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744031    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:27:59.747774 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744034    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:27:59.747774 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744037    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:27:59.747774 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744039    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:27:59.747774 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744042    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:27:59.748299 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744044    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:27:59.748299 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744047    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:27:59.748299 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744050    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:27:59.748299 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744052    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:27:59.748299 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744055    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:27:59.748299 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744057    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:27:59.748299 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744060    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:27:59.748299 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744062    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:27:59.748299 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744065    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:27:59.748299 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744068    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:27:59.748299 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744070    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:27:59.748299 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744073    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:27:59.748299 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744075    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:27:59.748299 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744078    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:27:59.748299 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744081    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:27:59.748299 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744084    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:27:59.748299 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744086    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:27:59.748299 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744089    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:27:59.748299 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744091    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:27:59.748299 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744094    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:27:59.748809 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744096    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:27:59.748809 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744099    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:27:59.748809 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744104    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:27:59.748809 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744107    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:27:59.748809 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744109    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:27:59.748809 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744112    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:27:59.748809 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744114    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:27:59.748809 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744117    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:27:59.748809 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744119    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:27:59.748809 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744122    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:27:59.748809 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744125    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:27:59.748809 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744128    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:27:59.748809 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744132    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:27:59.748809 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744137    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:27:59.748809 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744140    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:27:59.748809 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744142    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:27:59.748809 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744145    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:27:59.748809 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744147    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:27:59.748809 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744150    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:27:59.748809 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744152    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:27:59.749294 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744155    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:27:59.749294 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744157    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:27:59.749294 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744160    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:27:59.749294 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744162    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:27:59.749294 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744164    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:27:59.749294 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744167    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:27:59.749294 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744169    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:27:59.749294 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744172    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:27:59.749294 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744174    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:27:59.749294 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744177    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:27:59.749294 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744179    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:27:59.749294 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744182    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:27:59.749294 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744185    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:27:59.749294 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744187    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:27:59.749294 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744191    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:27:59.749294 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744193    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:27:59.749294 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744196    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:27:59.749294 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744200    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:27:59.749294 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744204    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744207    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744275    2558 flags.go:64] FLAG: --address="0.0.0.0"
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744281    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744288    2558 flags.go:64] FLAG: --anonymous-auth="true"
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744293    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744298    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744301    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744305    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744310    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744313    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744317    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744320    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744323    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744326    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744329    2558 flags.go:64] FLAG: --cgroup-root=""
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744332    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744335    2558 flags.go:64] FLAG: --client-ca-file=""
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744338    2558 flags.go:64] FLAG: --cloud-provider="external"
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744341    2558 flags.go:64] FLAG: --cluster-dns="[]"
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744345    2558 flags.go:64] FLAG: --cluster-domain=""
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744348    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744351    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744354    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 04 18:27:59.749777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744358    2558 flags.go:64] FLAG: --container-log-max-files="5"
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744361    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744364    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744368    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744372    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744375    2558 flags.go:64] FLAG: --contention-profiling="false"
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744378    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744382    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744385    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744388    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744392    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744395    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744398    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744403    2558 flags.go:64] FLAG: --enable-load-reader="false"
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744406    2558 flags.go:64] FLAG: --enable-server="true"
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744410    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744415    2558 flags.go:64] FLAG: --event-burst="100"
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744419    2558 flags.go:64] FLAG: --event-qps="50"
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744422    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744425    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744428    2558 flags.go:64] FLAG: --eviction-hard=""
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744432    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744435    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744438    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744441    2558 flags.go:64] FLAG: --eviction-soft=""
Aug 04 18:27:59.750365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744444    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744447    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744450    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744453    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744456    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744459    2558 flags.go:64] FLAG: --fail-swap-on="true"
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744462    2558 flags.go:64] FLAG: --feature-gates=""
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744466    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744469    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744472    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744475    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744479    2558 flags.go:64] FLAG: --healthz-port="10248"
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744495    2558 flags.go:64] FLAG: --help="false"
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744499    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-132-214.ec2.internal"
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744502    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744505    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744508    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744512    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744515    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744518    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744524    2558 flags.go:64] FLAG: --image-service-endpoint=""
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744527    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744530    2558 flags.go:64] FLAG: --kube-api-burst="100"
Aug 04 18:27:59.751020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744536    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744539    2558 flags.go:64] FLAG: --kube-api-qps="50"
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744542    2558 flags.go:64] FLAG: --kube-reserved=""
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744545    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744548    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744551    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744553    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744556    2558 flags.go:64] FLAG: --lock-file=""
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744559    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744562    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744565    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744570    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744573    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744576    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744579    2558 flags.go:64] FLAG: --logging-format="text"
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744582    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744585    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744588    2558 flags.go:64] FLAG: --manifest-url=""
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744592    2558 flags.go:64] FLAG: --manifest-url-header=""
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744596    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744600    2558 flags.go:64] FLAG: --max-open-files="1000000"
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744604    2558 flags.go:64] FLAG: --max-pods="110"
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744607    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744610    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744613    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 04 18:27:59.751718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744616    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744619    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744622    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744625    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744646    2558 flags.go:64] FLAG: --node-status-max-images="50"
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744649    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744652    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744655    2558 flags.go:64] FLAG: --pod-cidr=""
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744659    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744664    2558 flags.go:64] FLAG: --pod-manifest-path=""
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744668    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744671    2558 flags.go:64] FLAG: --pods-per-core="0"
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744675    2558 flags.go:64] FLAG: --port="10250"
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744678    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744681    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f1bb5eddf97391b3"
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744684    2558 flags.go:64] FLAG: --qos-reserved=""
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744687    2558 flags.go:64] FLAG: --read-only-port="10255"
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744690    2558 flags.go:64] FLAG: --register-node="true"
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744693    2558 flags.go:64] FLAG: --register-with-taints=""
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744697    2558 flags.go:64] FLAG: --registry-burst="10"
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744700    2558 flags.go:64] FLAG: --registry-qps="5"
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744703    2558 flags.go:64] FLAG: --reserved-cpus=""
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744706    2558 flags.go:64] FLAG: --reserved-memory=""
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744709    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744712    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 04 18:27:59.752462 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744715    2558 flags.go:64] FLAG: --rotate-certificates="false"
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744718    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744721    2558 flags.go:64] FLAG: --runonce="false"
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744725    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744728    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744731    2558 flags.go:64] FLAG: --seccomp-default="false"
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744734    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744737    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744740    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744743    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744746    2558 flags.go:64] FLAG: --storage-driver-password="root"
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744750    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744753    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744756    2558 flags.go:64] FLAG: --storage-driver-user="root"
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744759    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744762    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744766    2558 flags.go:64] FLAG: --system-cgroups=""
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744768    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744774    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744777    2558 flags.go:64] FLAG: --tls-cert-file=""
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744780    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744784    2558 flags.go:64] FLAG: --tls-min-version=""
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744786    2558 flags.go:64] FLAG: --tls-private-key-file=""
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744789    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744792    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 04 18:27:59.753171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744795    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 04 18:27:59.753877 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744798    2558 flags.go:64] FLAG: --v="2"
Aug 04 18:27:59.753877 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744802    2558 flags.go:64] FLAG: --version="false"
Aug 04 18:27:59.753877 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744806    2558 flags.go:64] FLAG: --vmodule=""
Aug 04 18:27:59.753877 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744810    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 04 18:27:59.753877 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.744813    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 04 18:27:59.753877 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744928    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:27:59.753877 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744931    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:27:59.753877 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744934    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:27:59.753877 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744937    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:27:59.753877 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744942    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:27:59.753877 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744945    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:27:59.753877 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744947    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:27:59.753877 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744950    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:27:59.753877 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744952    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:27:59.753877 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744955    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:27:59.753877 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744958    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:27:59.753877 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744960    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:27:59.753877 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744965    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:27:59.753877 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744968    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:27:59.753877 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744970    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:27:59.753877 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744973    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:27:59.754471 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744976    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:27:59.754471 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744978    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:27:59.754471 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744981    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:27:59.754471 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744984    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:27:59.754471 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744987    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:27:59.754471 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744991    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:27:59.754471 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744995    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:27:59.754471 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.744998    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:27:59.754471 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745000    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:27:59.754471 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745003    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:27:59.754471 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745005    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:27:59.754471 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745008    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:27:59.754471 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745011    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:27:59.754471 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745013    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:27:59.754471 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745016    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:27:59.754471 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745018    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:27:59.754471 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745021    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:27:59.754471 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745024    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:27:59.754471 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745026    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:27:59.754471 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745029    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:27:59.755040 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745032    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:27:59.755040 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745035    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:27:59.755040 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745037    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:27:59.755040 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745040    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:27:59.755040 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745043    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:27:59.755040 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745045    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:27:59.755040 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745048    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:27:59.755040 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745051    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:27:59.755040 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745055    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:27:59.755040 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745057    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:27:59.755040 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745060    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:27:59.755040 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745063    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:27:59.755040 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745065    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:27:59.755040 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745068    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:27:59.755040 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745070    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:27:59.755040 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745073    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:27:59.755040 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745076    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:27:59.755040 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745079    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:27:59.755040 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745082    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:27:59.755040 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745084    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:27:59.755549 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745087    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:27:59.755549 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745090    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:27:59.755549 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745093    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:27:59.755549 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745095    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:27:59.755549 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745098    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:27:59.755549 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745101    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:27:59.755549 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745105    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:27:59.755549 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745108    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:27:59.755549 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745111    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:27:59.755549 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745114    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:27:59.755549 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745117    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:27:59.755549 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745120    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:27:59.755549 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745123    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:27:59.755549 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745126    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:27:59.755549 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745129    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:27:59.755549 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745132    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:27:59.755549 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745135    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:27:59.755549 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745138    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:27:59.755549 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745141    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:27:59.756053 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745143    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:27:59.756053 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745147    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:27:59.756053 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745150    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:27:59.756053 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745153    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:27:59.756053 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745155    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:27:59.756053 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745158    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:27:59.756053 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745161    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:27:59.756053 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745164    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:27:59.756053 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745166    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:27:59.756053 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745169    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:27:59.756053 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745171    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:27:59.756053 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745174    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:27:59.756053 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745176    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:27:59.756053 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745179    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:27:59.756053 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745183    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:27:59.756053 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745186    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:27:59.756053 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745189    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:27:59.756053 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745193    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:27:59.756053 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745195    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:27:59.756523 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745198    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:27:59.756523 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745201    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:27:59.756523 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745204    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:27:59.756523 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745206    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:27:59.756523 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.745209    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:27:59.756523 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.745880    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 18:27:59.756523 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.753024    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 04 18:27:59.756523 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.753041    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 04 18:27:59.756523 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.753599    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 04 18:27:59.756523 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.753610    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 04 18:27:59.756523 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753693    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:27:59.756523 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753698    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:27:59.756523 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753701    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:27:59.756523 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753704    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:27:59.756523 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753707    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:27:59.757086 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753709    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:27:59.757086 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753712    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:27:59.757086 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753715    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:27:59.757086 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753718    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:27:59.757086 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753721    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:27:59.757086 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753724    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:27:59.757086 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753726    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:27:59.757086 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753729    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:27:59.757086 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753732    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:27:59.757086 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753735    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:27:59.757086 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753738    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:27:59.757086 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753741    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:27:59.757086 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753743    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:27:59.757086 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753746    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:27:59.757086 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753749    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:27:59.757086 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753751    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:27:59.757086 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753755    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:27:59.757086 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753759    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:27:59.757086 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753762    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:27:59.757086 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753765    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:27:59.757844 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753767    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:27:59.757844 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753770    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:27:59.757844 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753773    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:27:59.757844 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753775    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:27:59.757844 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753784    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:27:59.757844 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753788    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:27:59.757844 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753790    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:27:59.757844 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753793    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:27:59.757844 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753795    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:27:59.757844 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753798    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:27:59.757844 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753801    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:27:59.757844 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753803    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:27:59.757844 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753807    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:27:59.757844 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753812    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:27:59.757844 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753815    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:27:59.757844 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753818    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:27:59.757844 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753821    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:27:59.757844 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753824    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:27:59.757844 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753826    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:27:59.757844 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753828    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:27:59.758422 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753831    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:27:59.758422 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753834    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:27:59.758422 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753836    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:27:59.758422 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753839    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:27:59.758422 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753841    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:27:59.758422 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753844    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:27:59.758422 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753846    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:27:59.758422 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753849    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:27:59.758422 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753852    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:27:59.758422 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753854    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:27:59.758422 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753857    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:27:59.758422 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753859    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:27:59.758422 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753862    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:27:59.758422 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753864    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:27:59.758422 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753867    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:27:59.758422 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753869    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:27:59.758422 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753872    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:27:59.758422 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753881    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:27:59.758422 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753884    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:27:59.758922 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753887    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:27:59.758922 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753889    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:27:59.758922 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753892    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:27:59.758922 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753895    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:27:59.758922 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753898    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:27:59.758922 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753900    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:27:59.758922 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753903    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:27:59.758922 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753906    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:27:59.758922 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753909    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:27:59.758922 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753912    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:27:59.758922 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753915    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:27:59.758922 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753918    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:27:59.758922 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753920    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:27:59.758922 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753923    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:27:59.758922 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753925    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:27:59.758922 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753928    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:27:59.758922 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753930    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:27:59.758922 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753933    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:27:59.758922 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753935    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:27:59.759387 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753938    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:27:59.759387 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753940    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:27:59.759387 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753943    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:27:59.759387 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753945    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:27:59.759387 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753948    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:27:59.759387 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753950    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:27:59.759387 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753954    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:27:59.759387 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753957    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:27:59.759387 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753960    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:27:59.759387 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753963    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:27:59.759387 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753967    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:27:59.759387 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753969    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:27:59.759387 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753979    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:27:59.759387 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753982    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:27:59.759387 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753984    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:27:59.759387 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.753987    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:27:59.759870 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.753992    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 18:27:59.759870 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754151    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:27:59.759870 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754157    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:27:59.759870 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754160    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:27:59.759870 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754164    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:27:59.759870 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754166    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:27:59.759870 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754169    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:27:59.759870 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754171    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:27:59.759870 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754174    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:27:59.759870 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754176    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:27:59.759870 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754179    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:27:59.759870 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754183    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:27:59.759870 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754187    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:27:59.759870 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754190    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:27:59.759870 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754192    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:27:59.760238 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754195    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:27:59.760238 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754198    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:27:59.760238 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754201    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:27:59.760238 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754204    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:27:59.760238 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754207    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:27:59.760238 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754210    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:27:59.760238 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754213    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:27:59.760238 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754215    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:27:59.760238 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754219    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:27:59.760238 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754223    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:27:59.760238 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754226    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:27:59.760238 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754229    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:27:59.760238 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754232    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:27:59.760238 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754235    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:27:59.760238 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754245    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:27:59.760238 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754249    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:27:59.760238 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754251    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:27:59.760238 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754254    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:27:59.760238 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754257    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:27:59.760733 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754260    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:27:59.760733 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754264    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:27:59.760733 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754266    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:27:59.760733 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754269    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:27:59.760733 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754271    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:27:59.760733 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754274    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:27:59.760733 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754278    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:27:59.760733 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754281    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:27:59.760733 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754284    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:27:59.760733 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754286    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:27:59.760733 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754289    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:27:59.760733 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754291    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:27:59.760733 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754294    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:27:59.760733 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754297    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:27:59.760733 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754299    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:27:59.760733 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754302    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:27:59.760733 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754304    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:27:59.760733 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754307    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:27:59.760733 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754309    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:27:59.760733 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754312    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:27:59.761235 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754314    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:27:59.761235 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754317    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:27:59.761235 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754320    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:27:59.761235 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754323    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:27:59.761235 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754325    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:27:59.761235 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754328    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:27:59.761235 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754330    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:27:59.761235 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754333    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:27:59.761235 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754342    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:27:59.761235 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754344    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:27:59.761235 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754347    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:27:59.761235 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754349    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:27:59.761235 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754352    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:27:59.761235 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754355    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:27:59.761235 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754357    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:27:59.761235 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754360    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:27:59.761235 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754362    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:27:59.761235 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754365    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:27:59.761235 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754367    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:27:59.761235 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754370    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:27:59.761711 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754372    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:27:59.761711 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754375    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:27:59.761711 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754377    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:27:59.761711 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754380    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:27:59.761711 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754382    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:27:59.761711 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754385    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:27:59.761711 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754387    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:27:59.761711 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754390    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:27:59.761711 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754392    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:27:59.761711 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754395    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:27:59.761711 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754398    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:27:59.761711 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754400    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:27:59.761711 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754403    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:27:59.761711 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754406    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:27:59.761711 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754408    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:27:59.761711 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754411    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:27:59.761711 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754414    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:27:59.761711 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754416    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:27:59.761711 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754419    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:27:59.761711 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754421    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:27:59.762249 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754424    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:27:59.762249 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754433    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:27:59.762249 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754435    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:27:59.762249 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754438    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:27:59.762249 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754441    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:27:59.762249 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:27:59.754443    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:27:59.762249 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.754448    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 18:27:59.762249 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.754595    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 04 18:27:59.762249 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.756493    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 04 18:27:59.762249 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.758398    2558 server.go:1019] "Starting client certificate rotation"
Aug 04 18:27:59.762249 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.758448    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 18:27:59.762249 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.758626    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 18:27:59.762249 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.761291    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 18:27:59.765936 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.765922    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 18:27:59.774036 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.774013    2558 log.go:25] "Validated CRI v1 runtime API"
Aug 04 18:27:59.775993 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.775978    2558 log.go:25] "Validated CRI v1 image API"
Aug 04 18:27:59.776731 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.776705    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 04 18:27:59.779169 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.779151    2558 fs.go:135] Filesystem UUIDs: map[12f971de-61ed-4c16-b844-5a384b9f6b7f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c37d2c67-7a24-478a-90fc-9719d0c3384d:/dev/nvme0n1p3]
Aug 04 18:27:59.779226 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.779169    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 04 18:27:59.785890 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.785775    2558 manager.go:216] Machine: {Timestamp:2026-08-04 18:27:59.784442473 +0000 UTC m=+0.318625555 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3113283 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b60c1d0be25e4bbb26a915232945e SystemUUID:ec2b60c1-d0be-25e4-bbb2-6a915232945e BootID:753d67a5-8db8-41ab-a09f-73a02fde517d Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:82:2e:e6:27:b3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:82:2e:e6:27:b3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:c4:64:e0:a0:5a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 04 18:27:59.785890 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.785882    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 04 18:27:59.786014 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.785964    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 04 18:27:59.787137 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.787122    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 18:27:59.788912 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.788886    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 04 18:27:59.789054 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.788915    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-214.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 04 18:27:59.789520 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.789510    2558 topology_manager.go:138] "Creating topology manager with none policy"
Aug 04 18:27:59.789550 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.789523    2558 container_manager_linux.go:309] "Creating device plugin manager"
Aug 04 18:27:59.789550 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.789530    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 18:27:59.790216 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.790206    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 18:27:59.790892 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.790883    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 04 18:27:59.794829 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.794818    2558 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 18:27:59.794937 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.794927    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 04 18:27:59.794974 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.794955    2558 kubelet.go:486] "Attempting to sync node with API server"
Aug 04 18:27:59.794974 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.794964    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 04 18:27:59.794974 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.794974    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 04 18:27:59.795081 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.794985    2558 kubelet.go:398] "Adding apiserver pod source"
Aug 04 18:27:59.795081 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.794993    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 04 18:27:59.796885 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.796863    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 18:27:59.797002 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.796903    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 18:27:59.799864 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.799843    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 04 18:27:59.801526 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.801510    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 04 18:27:59.801613 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.801549    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 04 18:27:59.803147 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.803131    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 04 18:27:59.803231 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.803151    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 04 18:27:59.803231 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.803160    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 04 18:27:59.803231 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.803168    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 04 18:27:59.803231 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.803180    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 04 18:27:59.803231 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.803188    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 04 18:27:59.803231 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.803199    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 04 18:27:59.803231 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.803207    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 04 18:27:59.803231 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.803217    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 04 18:27:59.803231 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.803225    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 04 18:27:59.803494 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.803238    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 04 18:27:59.803494 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.803246    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 04 18:27:59.804128 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.804118    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 04 18:27:59.804183 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.804131    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 04 18:27:59.807610 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.807586    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-214.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 04 18:27:59.807610 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.807595    2558 server.go:1268] "Started kubelet"
Aug 04 18:27:59.807766 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.807692    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 04 18:27:59.807766 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:27:59.807708    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 04 18:27:59.807766 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:27:59.807602    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-214.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 04 18:27:59.808243 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.808211    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 04 18:27:59.808333 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.808263    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 04 18:27:59.808561 ip-10-0-132-214 systemd[1]: Started Kubernetes Kubelet.
Aug 04 18:27:59.809197 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.809142    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 04 18:27:59.810318 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.810291    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sjkzm"
Aug 04 18:27:59.810394 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.810384    2558 server.go:310] "Adding debug handlers to kubelet server"
Aug 04 18:27:59.813200 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.813181    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 04 18:27:59.813268 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.813183    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 04 18:27:59.813471 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:27:59.813447    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-214.ec2.internal\" not found"
Aug 04 18:27:59.813783 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.813769    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 04 18:27:59.813907 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.813893    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 04 18:27:59.813984 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.813971    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 04 18:27:59.814078 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.814057    2558 factory.go:55] Registering systemd factory
Aug 04 18:27:59.814078 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.814073    2558 reconstruct.go:97] "Volume reconstruction finished"
Aug 04 18:27:59.814078 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.814080    2558 factory.go:223] Registration of the systemd container factory successfully
Aug 04 18:27:59.814279 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.814085    2558 reconciler.go:29] "Reconciler: start to sync state"
Aug 04 18:27:59.814279 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:27:59.814227    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 04 18:27:59.814368 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.814292    2558 factory.go:153] Registering CRI-O factory
Aug 04 18:27:59.814368 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.814302    2558 factory.go:223] Registration of the crio container factory successfully
Aug 04 18:27:59.814368 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.814350    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 04 18:27:59.814451 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.814384    2558 factory.go:103] Registering Raw factory
Aug 04 18:27:59.814451 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.814402    2558 manager.go:1196] Started watching for new ooms in manager
Aug 04 18:27:59.815084 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:27:59.814001    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-214.ec2.internal.18c8ad8e80a38859  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-214.ec2.internal,UID:ip-10-0-132-214.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-214.ec2.internal,},FirstTimestamp:2026-08-04 18:27:59.807563865 +0000 UTC m=+0.341746949,LastTimestamp:2026-08-04 18:27:59.807563865 +0000 UTC m=+0.341746949,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-214.ec2.internal,}"
Aug 04 18:27:59.815189 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.815182    2558 manager.go:349] Starting recovery of all containers
Aug 04 18:27:59.819479 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.819456    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sjkzm"
Aug 04 18:27:59.823978 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:27:59.823953    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-214.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 04 18:27:59.824074 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:27:59.824052    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 04 18:27:59.827461 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.827286    2558 manager.go:354] Recovery completed
Aug 04 18:27:59.832160 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.832147    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:27:59.833922 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.833906    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:27:59.833999 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.833933    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:27:59.833999 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.833943    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:27:59.834499 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.834485    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 04 18:27:59.834562 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.834499    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 04 18:27:59.834562 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.834516    2558 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 18:27:59.834562 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.834499    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:27:59.835769 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.835424    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:27:59.835769 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.835450    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:27:59.835769 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.835461    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:27:59.837362 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.837347    2558 policy_none.go:49] "None policy: Start"
Aug 04 18:27:59.837445 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.837368    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 04 18:27:59.837445 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.837381    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 04 18:27:59.839337 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.839322    2558 policy_none.go:47] "Start"
Aug 04 18:27:59.871283 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.871266    2558 manager.go:337] "Starting Device Plugin manager"
Aug 04 18:27:59.871359 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:27:59.871298    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 04 18:27:59.871359 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.871310    2558 server.go:87] "Starting device plugin registration server"
Aug 04 18:27:59.871563 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.871552    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 04 18:27:59.871696 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.871565    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 04 18:27:59.871696 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.871687    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 04 18:27:59.871788 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.871763    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 04 18:27:59.871788 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.871772    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 04 18:27:59.872281 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:27:59.872263    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 04 18:27:59.872348 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:27:59.872314    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-214.ec2.internal\" not found"
Aug 04 18:27:59.955966 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.955928    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 04 18:27:59.958176 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.957045    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 04 18:27:59.958176 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.957076    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 04 18:27:59.958176 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.957097    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 04 18:27:59.958176 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:27:59.957134    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 04 18:27:59.959481 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.959464    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:27:59.972533 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.972516    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:27:59.973409 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.973386    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:27:59.973518 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.973421    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:27:59.973518 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.973436    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:27:59.973518 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.973464    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-214.ec2.internal"
Aug 04 18:27:59.981671 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:27:59.981655    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-214.ec2.internal"
Aug 04 18:27:59.981732 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:27:59.981677    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-214.ec2.internal\": node \"ip-10-0-132-214.ec2.internal\" not found"
Aug 04 18:28:00.004354 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:00.004292    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-214.ec2.internal\" not found"
Aug 04 18:28:00.057269 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.057235    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal"]
Aug 04 18:28:00.057406 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.057320    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:28:00.058855 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.058839    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:28:00.058922 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.058869    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:28:00.058922 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.058879    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:28:00.061075 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.061063    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:28:00.061187 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.061173    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal"
Aug 04 18:28:00.061252 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.061203    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:28:00.061842 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.061827    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:28:00.061945 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.061856    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:28:00.061945 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.061870    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:28:00.061945 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.061886    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:28:00.061945 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.061908    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:28:00.061945 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.061921    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:28:00.064054 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.064041    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal"
Aug 04 18:28:00.064117 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.064064    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:28:00.064740 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.064723    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:28:00.064834 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.064750    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:28:00.064834 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.064760    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:28:00.084163 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:00.084142    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-214.ec2.internal\" not found" node="ip-10-0-132-214.ec2.internal"
Aug 04 18:28:00.088146 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:00.088131    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-214.ec2.internal\" not found" node="ip-10-0-132-214.ec2.internal"
Aug 04 18:28:00.105070 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:00.105044    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-214.ec2.internal\" not found"
Aug 04 18:28:00.115586 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.115561    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e707b88f4e7c983d7d792d407b11403-config\") pod \"kube-apiserver-proxy-ip-10-0-132-214.ec2.internal\" (UID: \"5e707b88f4e7c983d7d792d407b11403\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal"
Aug 04 18:28:00.115687 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.115596    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd8ce69c906537611de113e005e48bc0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal\" (UID: \"cd8ce69c906537611de113e005e48bc0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal"
Aug 04 18:28:00.115687 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.115621    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd8ce69c906537611de113e005e48bc0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal\" (UID: \"cd8ce69c906537611de113e005e48bc0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal"
Aug 04 18:28:00.205226 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:00.205190    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-214.ec2.internal\" not found"
Aug 04 18:28:00.215922 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.215891    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e707b88f4e7c983d7d792d407b11403-config\") pod \"kube-apiserver-proxy-ip-10-0-132-214.ec2.internal\" (UID: \"5e707b88f4e7c983d7d792d407b11403\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal"
Aug 04 18:28:00.215922 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.215928    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd8ce69c906537611de113e005e48bc0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal\" (UID: \"cd8ce69c906537611de113e005e48bc0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal"
Aug 04 18:28:00.216058 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.215947    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd8ce69c906537611de113e005e48bc0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal\" (UID: \"cd8ce69c906537611de113e005e48bc0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal"
Aug 04 18:28:00.216058 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.215977    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd8ce69c906537611de113e005e48bc0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal\" (UID: \"cd8ce69c906537611de113e005e48bc0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal"
Aug 04 18:28:00.216058 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.215992    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e707b88f4e7c983d7d792d407b11403-config\") pod \"kube-apiserver-proxy-ip-10-0-132-214.ec2.internal\" (UID: \"5e707b88f4e7c983d7d792d407b11403\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal"
Aug 04 18:28:00.216058 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.215997    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd8ce69c906537611de113e005e48bc0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal\" (UID: \"cd8ce69c906537611de113e005e48bc0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal"
Aug 04 18:28:00.305963 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:00.305883    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-214.ec2.internal\" not found"
Aug 04 18:28:00.390910 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.390858    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal"
Aug 04 18:28:00.391039 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.390859    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal"
Aug 04 18:28:00.406400 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:00.406378    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-214.ec2.internal\" not found"
Aug 04 18:28:00.512918 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:00.512875    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-214.ec2.internal\" not found"
Aug 04 18:28:00.616202 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:00.616108    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-214.ec2.internal\" not found"
Aug 04 18:28:00.717229 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:00.717183    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-214.ec2.internal\" not found"
Aug 04 18:28:00.759770 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.759726    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 04 18:28:00.760373 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.759953    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 18:28:00.817606 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:00.817574    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-214.ec2.internal\" not found"
Aug 04 18:28:00.827467 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.827425    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-03 18:23:00 +0000 UTC" deadline="2028-03-03 14:55:04.382038111 +0000 UTC"
Aug 04 18:28:00.827467 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.827458    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13844h27m3.55458353s"
Aug 04 18:28:00.917937 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:00.917849    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-214.ec2.internal\" not found"
Aug 04 18:28:00.991032 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:00.990997    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:28:01.018304 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:01.018266    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-214.ec2.internal\" not found"
Aug 04 18:28:01.047901 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.047874    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:28:01.114370 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.114333    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal"
Aug 04 18:28:01.127505 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.127481    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 18:28:01.128622 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.128593    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal"
Aug 04 18:28:01.138276 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.138255    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 18:28:01.201146 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:28:01.201112    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e707b88f4e7c983d7d792d407b11403.slice/crio-843db91e1b155a6ceba0f3545549cb2b459077f41bd10bd3845be7f25140065f WatchSource:0}: Error finding container 843db91e1b155a6ceba0f3545549cb2b459077f41bd10bd3845be7f25140065f: Status 404 returned error can't find the container with id 843db91e1b155a6ceba0f3545549cb2b459077f41bd10bd3845be7f25140065f
Aug 04 18:28:01.206436 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.206411    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:28:01.213351 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:28:01.213327    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd8ce69c906537611de113e005e48bc0.slice/crio-8beee381c935b680cdddafdd752514d3e9062e887ac48f8fc6de1ba3a67785af WatchSource:0}: Error finding container 8beee381c935b680cdddafdd752514d3e9062e887ac48f8fc6de1ba3a67785af: Status 404 returned error can't find the container with id 8beee381c935b680cdddafdd752514d3e9062e887ac48f8fc6de1ba3a67785af
Aug 04 18:28:01.365881 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.365843    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:28:01.797507 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.797453    2558 apiserver.go:52] "Watching apiserver"
Aug 04 18:28:01.805041 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.805013    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 04 18:28:01.805525 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.805492    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal","openshift-multus/multus-6bz2q","openshift-network-diagnostics/network-check-target-6kqrt","openshift-network-operator/iptables-alerter-4mcrz","kube-system/konnectivity-agent-q6q26","kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth","openshift-cluster-node-tuning-operator/tuned-4lmn2","openshift-dns/node-resolver-z4mcd","openshift-multus/multus-additional-cni-plugins-drtj5","openshift-multus/network-metrics-daemon-mrvjt","openshift-ovn-kubernetes/ovnkube-node-dzrc4","kube-system/global-pull-secret-syncer-9jgn2","openshift-image-registry/node-ca-txv8p"]
Aug 04 18:28:01.808348 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.808324    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:01.810788 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.810676    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:01.810788 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.810736    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 04 18:28:01.810788 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:01.810755    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jgn2" podUID="587a9fe3-615e-41e1-bebf-6291030112c3"
Aug 04 18:28:01.810788 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.810771    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 04 18:28:01.811055 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.810805    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-662c4\""
Aug 04 18:28:01.811055 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.810999    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 04 18:28:01.813094 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.813072    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:01.813183 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:01.813129    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6kqrt" podUID="f300cb8a-fd83-4b82-9513-5cb728617244"
Aug 04 18:28:01.814011 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.813991    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 04 18:28:01.816003 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.815981    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4mcrz"
Aug 04 18:28:01.818269 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.818245    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pwq6c\""
Aug 04 18:28:01.818415 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.818293    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q6q26"
Aug 04 18:28:01.818415 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.818388    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 04 18:28:01.818635 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.818616    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 04 18:28:01.818785 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.818698    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 04 18:28:01.820419 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.820392    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 04 18:28:01.820760 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.820745    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-txv8p"
Aug 04 18:28:01.821195 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.821164    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hjl6l\""
Aug 04 18:28:01.821289 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.821265    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 04 18:28:01.823460 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.822793    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 04 18:28:01.823460 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.822944    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 04 18:28:01.823460 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.823090    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sgxzk\""
Aug 04 18:28:01.823460 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.823130    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z4mcd"
Aug 04 18:28:01.823771 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.823560    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 04 18:28:01.823935 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.823918    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 18:28:01.824951 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.824934    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-825pn\""
Aug 04 18:28:01.825450 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.825388    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 04 18:28:01.825450 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.825401    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 04 18:28:01.825798 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.825779    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:01.827243 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.827220    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg4xn\" (UniqueName: \"kubernetes.io/projected/99c3ba1d-fc95-4b55-8cfb-39257deb5f19-kube-api-access-hg4xn\") pod \"aws-ebs-csi-driver-node-s6qth\" (UID: \"99c3ba1d-fc95-4b55-8cfb-39257deb5f19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:01.827338 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.827271    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/587a9fe3-615e-41e1-bebf-6291030112c3-dbus\") pod \"global-pull-secret-syncer-9jgn2\" (UID: \"587a9fe3-615e-41e1-bebf-6291030112c3\") " pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:01.827338 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.827323    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/18143425-be80-4ac4-8d5f-f8835134a92c-iptables-alerter-script\") pod \"iptables-alerter-4mcrz\" (UID: \"18143425-be80-4ac4-8d5f-f8835134a92c\") " pod="openshift-network-operator/iptables-alerter-4mcrz"
Aug 04 18:28:01.827454 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.827358    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99c3ba1d-fc95-4b55-8cfb-39257deb5f19-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s6qth\" (UID: \"99c3ba1d-fc95-4b55-8cfb-39257deb5f19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:01.827454 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.827393    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99c3ba1d-fc95-4b55-8cfb-39257deb5f19-registration-dir\") pod \"aws-ebs-csi-driver-node-s6qth\" (UID: \"99c3ba1d-fc95-4b55-8cfb-39257deb5f19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:01.827454 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.827430    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99c3ba1d-fc95-4b55-8cfb-39257deb5f19-etc-selinux\") pod \"aws-ebs-csi-driver-node-s6qth\" (UID: \"99c3ba1d-fc95-4b55-8cfb-39257deb5f19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:01.827637 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.827456    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99c3ba1d-fc95-4b55-8cfb-39257deb5f19-device-dir\") pod \"aws-ebs-csi-driver-node-s6qth\" (UID: \"99c3ba1d-fc95-4b55-8cfb-39257deb5f19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:01.827637 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.827475    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/587a9fe3-615e-41e1-bebf-6291030112c3-kubelet-config\") pod \"global-pull-secret-syncer-9jgn2\" (UID: \"587a9fe3-615e-41e1-bebf-6291030112c3\") " pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:01.827637 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.827491    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret\") pod \"global-pull-secret-syncer-9jgn2\" (UID: \"587a9fe3-615e-41e1-bebf-6291030112c3\") " pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:01.827637 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.827517    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lmvg\" (UniqueName: \"kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg\") pod \"network-check-target-6kqrt\" (UID: \"f300cb8a-fd83-4b82-9513-5cb728617244\") " pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:01.827637 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.827597    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzdqk\" (UniqueName: \"kubernetes.io/projected/18143425-be80-4ac4-8d5f-f8835134a92c-kube-api-access-xzdqk\") pod \"iptables-alerter-4mcrz\" (UID: \"18143425-be80-4ac4-8d5f-f8835134a92c\") " pod="openshift-network-operator/iptables-alerter-4mcrz"
Aug 04 18:28:01.827637 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.827626    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99c3ba1d-fc95-4b55-8cfb-39257deb5f19-socket-dir\") pod \"aws-ebs-csi-driver-node-s6qth\" (UID: \"99c3ba1d-fc95-4b55-8cfb-39257deb5f19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:01.827960 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.827705    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99c3ba1d-fc95-4b55-8cfb-39257deb5f19-sys-fs\") pod \"aws-ebs-csi-driver-node-s6qth\" (UID: \"99c3ba1d-fc95-4b55-8cfb-39257deb5f19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:01.827960 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.827751    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18143425-be80-4ac4-8d5f-f8835134a92c-host-slash\") pod \"iptables-alerter-4mcrz\" (UID: \"18143425-be80-4ac4-8d5f-f8835134a92c\") " pod="openshift-network-operator/iptables-alerter-4mcrz"
Aug 04 18:28:01.828073 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.828009    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 04 18:28:01.828219 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.828198    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nrw74\""
Aug 04 18:28:01.828309 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.828281    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:01.828813 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.828792    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 04 18:28:01.831922 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.831246    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 04 18:28:01.831922 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.831364    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 04 18:28:01.831922 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.831516    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 04 18:28:01.834534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.832430    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:01.834534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.832510    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7scg9\""
Aug 04 18:28:01.834534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.833134    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 04 18:28:01.835440 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.835087    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 04 18:28:01.835440 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.835240    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 04 18:28:01.835440 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.835307    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-46922\""
Aug 04 18:28:01.836090 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.836052    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:01.836191 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:01.836136    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrvjt" podUID="54490a46-3a24-4059-87c8-850cc41a7459"
Aug 04 18:28:01.838964 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.838942    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:01.841749 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.841729    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 04 18:28:01.841897 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.841880    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 04 18:28:01.841967 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.841951    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-52qd8\""
Aug 04 18:28:01.842143 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.842128    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 04 18:28:01.842143 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.842137    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 04 18:28:01.842280 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.842186    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 04 18:28:01.842280 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.842258    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 04 18:28:01.853515 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.853488    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sz72h"
Aug 04 18:28:01.861937 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.861903    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sz72h"
Aug 04 18:28:01.915482 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.915439    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 04 18:28:01.928687 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.928655    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9bd4223d-7a9a-4ec4-9dea-c4ad74c6aa72-host\") pod \"node-ca-txv8p\" (UID: \"9bd4223d-7a9a-4ec4-9dea-c4ad74c6aa72\") " pod="openshift-image-registry/node-ca-txv8p"
Aug 04 18:28:01.928843 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.928694    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-run\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:01.928843 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.928713    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-host-run-k8s-cni-cncf-io\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:01.928843 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.928743    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18143425-be80-4ac4-8d5f-f8835134a92c-host-slash\") pod \"iptables-alerter-4mcrz\" (UID: \"18143425-be80-4ac4-8d5f-f8835134a92c\") " pod="openshift-network-operator/iptables-alerter-4mcrz"
Aug 04 18:28:01.928843 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.928804    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/31ea8e3e-777a-458b-93bf-67b8e504709c-konnectivity-ca\") pod \"konnectivity-agent-q6q26\" (UID: \"31ea8e3e-777a-458b-93bf-67b8e504709c\") " pod="kube-system/konnectivity-agent-q6q26"
Aug 04 18:28:01.929068 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.928858    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-etc-sysctl-conf\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:01.929068 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.928872    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18143425-be80-4ac4-8d5f-f8835134a92c-host-slash\") pod \"iptables-alerter-4mcrz\" (UID: \"18143425-be80-4ac4-8d5f-f8835134a92c\") " pod="openshift-network-operator/iptables-alerter-4mcrz"
Aug 04 18:28:01.929068 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.928886    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs\") pod \"network-metrics-daemon-mrvjt\" (UID: \"54490a46-3a24-4059-87c8-850cc41a7459\") " pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:01.929068 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.928946    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-hostroot\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:01.929068 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.928993    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83f378e2-4ae7-4f19-9897-9093a45fe8b6-cni-binary-copy\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:01.929068 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929021    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-host-run-netns\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:01.929068 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929047    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-run-ovn\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:01.929416 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929077    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99c3ba1d-fc95-4b55-8cfb-39257deb5f19-registration-dir\") pod \"aws-ebs-csi-driver-node-s6qth\" (UID: \"99c3ba1d-fc95-4b55-8cfb-39257deb5f19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:01.929416 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929104    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99c3ba1d-fc95-4b55-8cfb-39257deb5f19-etc-selinux\") pod \"aws-ebs-csi-driver-node-s6qth\" (UID: \"99c3ba1d-fc95-4b55-8cfb-39257deb5f19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:01.929416 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929130    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1fabac46-7d5e-4a66-81dc-3959f894fde3-cni-binary-copy\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:01.929416 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929156    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-host-run-netns\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:01.929416 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929196    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/83f378e2-4ae7-4f19-9897-9093a45fe8b6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:01.929416 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929232    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-run-openvswitch\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:01.929416 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929263    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99c3ba1d-fc95-4b55-8cfb-39257deb5f19-registration-dir\") pod \"aws-ebs-csi-driver-node-s6qth\" (UID: \"99c3ba1d-fc95-4b55-8cfb-39257deb5f19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:01.929416 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929276    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpknq\" (UniqueName: \"kubernetes.io/projected/9bd4223d-7a9a-4ec4-9dea-c4ad74c6aa72-kube-api-access-hpknq\") pod \"node-ca-txv8p\" (UID: \"9bd4223d-7a9a-4ec4-9dea-c4ad74c6aa72\") " pod="openshift-image-registry/node-ca-txv8p"
Aug 04 18:28:01.929416 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929283    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99c3ba1d-fc95-4b55-8cfb-39257deb5f19-etc-selinux\") pod \"aws-ebs-csi-driver-node-s6qth\" (UID: \"99c3ba1d-fc95-4b55-8cfb-39257deb5f19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:01.929416 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929314    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-etc-modprobe-d\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:01.929416 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929344    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-host-run-ovn-kubernetes\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:01.929416 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929375    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret\") pod \"global-pull-secret-syncer-9jgn2\" (UID: \"587a9fe3-615e-41e1-bebf-6291030112c3\") " pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:01.929416 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929400    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/31ea8e3e-777a-458b-93bf-67b8e504709c-agent-certs\") pod \"konnectivity-agent-q6q26\" (UID: \"31ea8e3e-777a-458b-93bf-67b8e504709c\") " pod="kube-system/konnectivity-agent-q6q26"
Aug 04 18:28:01.930156 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929443    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1fabac46-7d5e-4a66-81dc-3959f894fde3-multus-daemon-config\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:01.930156 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929496    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-etc-kubernetes\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:01.930156 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:01.929521    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:01.930156 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929525    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83f378e2-4ae7-4f19-9897-9093a45fe8b6-system-cni-dir\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:01.930156 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929552    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqpld\" (UniqueName: \"kubernetes.io/projected/83f378e2-4ae7-4f19-9897-9093a45fe8b6-kube-api-access-xqpld\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:01.930156 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:01.929616    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret podName:587a9fe3-615e-41e1-bebf-6291030112c3 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:02.429576313 +0000 UTC m=+2.963759397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret") pod "global-pull-secret-syncer-9jgn2" (UID: "587a9fe3-615e-41e1-bebf-6291030112c3") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:01.930156 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929636    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3268785b-ed87-4880-b7a7-baf5cc9366da-ovn-node-metrics-cert\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:01.930156 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929682    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-host-slash\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:01.930156 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929709    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83f378e2-4ae7-4f19-9897-9093a45fe8b6-cnibin\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:01.930156 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929744    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg4xn\" (UniqueName: \"kubernetes.io/projected/99c3ba1d-fc95-4b55-8cfb-39257deb5f19-kube-api-access-hg4xn\") pod \"aws-ebs-csi-driver-node-s6qth\" (UID: \"99c3ba1d-fc95-4b55-8cfb-39257deb5f19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:01.930156 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929786    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-os-release\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:01.930156 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929824    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-host-var-lib-kubelet\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:01.930156 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929855    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83f378e2-4ae7-4f19-9897-9093a45fe8b6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:01.930156 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929883    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-host\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:01.930156 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929909    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7e093c3f-6c17-49c3-a89a-acbd6552beb0-etc-tuned\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:01.930156 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929948    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e093c3f-6c17-49c3-a89a-acbd6552beb0-tmp\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:01.930915 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.929985    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99c3ba1d-fc95-4b55-8cfb-39257deb5f19-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s6qth\" (UID: \"99c3ba1d-fc95-4b55-8cfb-39257deb5f19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:01.930915 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930046    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99c3ba1d-fc95-4b55-8cfb-39257deb5f19-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s6qth\" (UID: \"99c3ba1d-fc95-4b55-8cfb-39257deb5f19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:01.930915 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930087    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-systemd-units\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:01.930915 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930140    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-run-systemd\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:01.930915 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930170    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsstj\" (UniqueName: \"kubernetes.io/projected/54490a46-3a24-4059-87c8-850cc41a7459-kube-api-access-zsstj\") pod \"network-metrics-daemon-mrvjt\" (UID: \"54490a46-3a24-4059-87c8-850cc41a7459\") " pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:01.930915 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930186    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-host-var-lib-cni-bin\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:01.930915 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930210    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/587a9fe3-615e-41e1-bebf-6291030112c3-kubelet-config\") pod \"global-pull-secret-syncer-9jgn2\" (UID: \"587a9fe3-615e-41e1-bebf-6291030112c3\") " pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:01.930915 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930243    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-host-var-lib-cni-multus\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:01.930915 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930330    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/587a9fe3-615e-41e1-bebf-6291030112c3-kubelet-config\") pod \"global-pull-secret-syncer-9jgn2\" (UID: \"587a9fe3-615e-41e1-bebf-6291030112c3\") " pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:01.930915 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930336    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-host-run-multus-certs\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:01.930915 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930369    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83f378e2-4ae7-4f19-9897-9093a45fe8b6-os-release\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:01.930915 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930396    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/83f378e2-4ae7-4f19-9897-9093a45fe8b6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:01.930915 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930424    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:01.930915 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930480    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-cnibin\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:01.930915 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930516    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr27c\" (UniqueName: \"kubernetes.io/projected/1fabac46-7d5e-4a66-81dc-3959f894fde3-kube-api-access-hr27c\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:01.930915 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930547    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf7mp\" (UniqueName: \"kubernetes.io/projected/e4dac435-5ca9-41af-b8f0-e3aaa5b57d7d-kube-api-access-wf7mp\") pod \"node-resolver-z4mcd\" (UID: \"e4dac435-5ca9-41af-b8f0-e3aaa5b57d7d\") " pod="openshift-dns/node-resolver-z4mcd"
Aug 04 18:28:01.931750 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930575    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-etc-sysconfig\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:01.931750 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930604    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/587a9fe3-615e-41e1-bebf-6291030112c3-dbus\") pod \"global-pull-secret-syncer-9jgn2\" (UID: \"587a9fe3-615e-41e1-bebf-6291030112c3\") " pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:01.931750 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930626    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/18143425-be80-4ac4-8d5f-f8835134a92c-iptables-alerter-script\") pod \"iptables-alerter-4mcrz\" (UID: \"18143425-be80-4ac4-8d5f-f8835134a92c\") " pod="openshift-network-operator/iptables-alerter-4mcrz"
Aug 04 18:28:01.931750 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930665    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9bd4223d-7a9a-4ec4-9dea-c4ad74c6aa72-serviceca\") pod \"node-ca-txv8p\" (UID: \"9bd4223d-7a9a-4ec4-9dea-c4ad74c6aa72\") " pod="openshift-image-registry/node-ca-txv8p"
Aug 04 18:28:01.931750 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930688    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3268785b-ed87-4880-b7a7-baf5cc9366da-ovnkube-script-lib\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:01.931750 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930722    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-etc-systemd\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:01.931750 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930741    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-lib-modules\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:01.931750 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930763    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbxxw\" (UniqueName: \"kubernetes.io/projected/7e093c3f-6c17-49c3-a89a-acbd6552beb0-kube-api-access-nbxxw\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:01.931750 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930792    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99c3ba1d-fc95-4b55-8cfb-39257deb5f19-device-dir\") pod \"aws-ebs-csi-driver-node-s6qth\" (UID: \"99c3ba1d-fc95-4b55-8cfb-39257deb5f19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:01.931750 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930802    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/587a9fe3-615e-41e1-bebf-6291030112c3-dbus\") pod \"global-pull-secret-syncer-9jgn2\" (UID: \"587a9fe3-615e-41e1-bebf-6291030112c3\") " pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:01.931750 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930921    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99c3ba1d-fc95-4b55-8cfb-39257deb5f19-device-dir\") pod \"aws-ebs-csi-driver-node-s6qth\" (UID: \"99c3ba1d-fc95-4b55-8cfb-39257deb5f19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:01.931750 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930818    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lmvg\" (UniqueName: \"kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg\") pod \"network-check-target-6kqrt\" (UID: \"f300cb8a-fd83-4b82-9513-5cb728617244\") " pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:01.931750 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930973    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzdqk\" (UniqueName: \"kubernetes.io/projected/18143425-be80-4ac4-8d5f-f8835134a92c-kube-api-access-xzdqk\") pod \"iptables-alerter-4mcrz\" (UID: \"18143425-be80-4ac4-8d5f-f8835134a92c\") " pod="openshift-network-operator/iptables-alerter-4mcrz"
Aug 04 18:28:01.931750 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.930999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-multus-cni-dir\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:01.931750 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931025    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3268785b-ed87-4880-b7a7-baf5cc9366da-env-overrides\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:01.931750 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931060    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-var-lib-openvswitch\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:01.931750 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931085    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99c3ba1d-fc95-4b55-8cfb-39257deb5f19-socket-dir\") pod \"aws-ebs-csi-driver-node-s6qth\" (UID: \"99c3ba1d-fc95-4b55-8cfb-39257deb5f19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:01.932487 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931110    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99c3ba1d-fc95-4b55-8cfb-39257deb5f19-sys-fs\") pod \"aws-ebs-csi-driver-node-s6qth\" (UID: \"99c3ba1d-fc95-4b55-8cfb-39257deb5f19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:01.932487 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931139    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-system-cni-dir\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:01.932487 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931163    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-multus-socket-dir-parent\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:01.932487 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931187    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e4dac435-5ca9-41af-b8f0-e3aaa5b57d7d-hosts-file\") pod \"node-resolver-z4mcd\" (UID: \"e4dac435-5ca9-41af-b8f0-e3aaa5b57d7d\") " pod="openshift-dns/node-resolver-z4mcd"
Aug 04 18:28:01.932487 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931211    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-etc-kubernetes\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:01.932487 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931287    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99c3ba1d-fc95-4b55-8cfb-39257deb5f19-sys-fs\") pod \"aws-ebs-csi-driver-node-s6qth\" (UID: \"99c3ba1d-fc95-4b55-8cfb-39257deb5f19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:01.932487 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931340    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99c3ba1d-fc95-4b55-8cfb-39257deb5f19-socket-dir\") pod \"aws-ebs-csi-driver-node-s6qth\" (UID: \"99c3ba1d-fc95-4b55-8cfb-39257deb5f19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:01.932487 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931397    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-host-kubelet\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:01.932487 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931427    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-node-log\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:01.932487 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931449    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-host-cni-bin\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:01.932487 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931473    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4dac435-5ca9-41af-b8f0-e3aaa5b57d7d-tmp-dir\") pod \"node-resolver-z4mcd\" (UID: \"e4dac435-5ca9-41af-b8f0-e3aaa5b57d7d\") " pod="openshift-dns/node-resolver-z4mcd"
Aug 04 18:28:01.932487 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931509    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-var-lib-kubelet\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:01.932487 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931552    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-host-cni-netd\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:01.932487 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931621    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3268785b-ed87-4880-b7a7-baf5cc9366da-ovnkube-config\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:01.932487 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931662    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/18143425-be80-4ac4-8d5f-f8835134a92c-iptables-alerter-script\") pod \"iptables-alerter-4mcrz\" (UID: \"18143425-be80-4ac4-8d5f-f8835134a92c\") " pod="openshift-network-operator/iptables-alerter-4mcrz"
Aug 04 18:28:01.932487 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931686    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkwzb\" (UniqueName: \"kubernetes.io/projected/3268785b-ed87-4880-b7a7-baf5cc9366da-kube-api-access-hkwzb\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:01.932487 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931717    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-etc-sysctl-d\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:01.933411 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931742    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-sys\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:01.933411 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931767    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-multus-conf-dir\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:01.933411 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931790    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-etc-openvswitch\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:01.933411 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.931826    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-log-socket\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:01.936805 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.936778    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 04 18:28:01.937910 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:01.937889    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:28:01.938031 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:01.937914    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:28:01.938031 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:01.937928    2558 projected.go:196] Error preparing data for projected volume kube-api-access-8lmvg for pod openshift-network-diagnostics/network-check-target-6kqrt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:01.938031 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:01.937992    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg podName:f300cb8a-fd83-4b82-9513-5cb728617244 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:02.437975299 +0000 UTC m=+2.972158389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8lmvg" (UniqueName: "kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg") pod "network-check-target-6kqrt" (UID: "f300cb8a-fd83-4b82-9513-5cb728617244") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:01.941119 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.941051    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzdqk\" (UniqueName: \"kubernetes.io/projected/18143425-be80-4ac4-8d5f-f8835134a92c-kube-api-access-xzdqk\") pod \"iptables-alerter-4mcrz\" (UID: \"18143425-be80-4ac4-8d5f-f8835134a92c\") " pod="openshift-network-operator/iptables-alerter-4mcrz"
Aug 04 18:28:01.941119 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.941057    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg4xn\" (UniqueName: \"kubernetes.io/projected/99c3ba1d-fc95-4b55-8cfb-39257deb5f19-kube-api-access-hg4xn\") pod \"aws-ebs-csi-driver-node-s6qth\" (UID: \"99c3ba1d-fc95-4b55-8cfb-39257deb5f19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:01.965074 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.964976    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal" event={"ID":"cd8ce69c906537611de113e005e48bc0","Type":"ContainerStarted","Data":"8beee381c935b680cdddafdd752514d3e9062e887ac48f8fc6de1ba3a67785af"}
Aug 04 18:28:01.966705 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:01.966671    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal" event={"ID":"5e707b88f4e7c983d7d792d407b11403","Type":"ContainerStarted","Data":"843db91e1b155a6ceba0f3545549cb2b459077f41bd10bd3845be7f25140065f"}
Aug 04 18:28:02.032433 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032351    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-run-ovn\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.032433 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032406    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1fabac46-7d5e-4a66-81dc-3959f894fde3-cni-binary-copy\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.032433 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032433    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-host-run-netns\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.032762 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032462    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/83f378e2-4ae7-4f19-9897-9093a45fe8b6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:02.032762 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032490    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-run-openvswitch\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.032762 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032517    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpknq\" (UniqueName: \"kubernetes.io/projected/9bd4223d-7a9a-4ec4-9dea-c4ad74c6aa72-kube-api-access-hpknq\") pod \"node-ca-txv8p\" (UID: \"9bd4223d-7a9a-4ec4-9dea-c4ad74c6aa72\") " pod="openshift-image-registry/node-ca-txv8p"
Aug 04 18:28:02.032762 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032543    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-etc-modprobe-d\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.032762 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032568    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-host-run-ovn-kubernetes\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.032762 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032619    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/31ea8e3e-777a-458b-93bf-67b8e504709c-agent-certs\") pod \"konnectivity-agent-q6q26\" (UID: \"31ea8e3e-777a-458b-93bf-67b8e504709c\") " pod="kube-system/konnectivity-agent-q6q26"
Aug 04 18:28:02.032762 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032642    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1fabac46-7d5e-4a66-81dc-3959f894fde3-multus-daemon-config\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.032762 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032667    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-etc-kubernetes\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.032762 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032702    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83f378e2-4ae7-4f19-9897-9093a45fe8b6-system-cni-dir\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:02.032762 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032719    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqpld\" (UniqueName: \"kubernetes.io/projected/83f378e2-4ae7-4f19-9897-9093a45fe8b6-kube-api-access-xqpld\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:02.032762 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032743    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3268785b-ed87-4880-b7a7-baf5cc9366da-ovn-node-metrics-cert\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.032762 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032758    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-host-slash\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.033349 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032776    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83f378e2-4ae7-4f19-9897-9093a45fe8b6-cnibin\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:02.033349 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032794    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-os-release\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.033349 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032819    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-host-var-lib-kubelet\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.033349 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032836    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83f378e2-4ae7-4f19-9897-9093a45fe8b6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:02.033349 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032855    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-host\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.033349 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032870    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7e093c3f-6c17-49c3-a89a-acbd6552beb0-etc-tuned\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.033349 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032886    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e093c3f-6c17-49c3-a89a-acbd6552beb0-tmp\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.033349 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032909    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-systemd-units\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.033349 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032924    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-run-systemd\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.033349 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032940    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsstj\" (UniqueName: \"kubernetes.io/projected/54490a46-3a24-4059-87c8-850cc41a7459-kube-api-access-zsstj\") pod \"network-metrics-daemon-mrvjt\" (UID: \"54490a46-3a24-4059-87c8-850cc41a7459\") " pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:02.033349 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032956    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-host-var-lib-cni-bin\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.033349 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.032993    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-host-var-lib-cni-multus\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.033349 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.033019    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-host-run-multus-certs\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.033349 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.033049    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83f378e2-4ae7-4f19-9897-9093a45fe8b6-os-release\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:02.033349 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.033055    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1fabac46-7d5e-4a66-81dc-3959f894fde3-cni-binary-copy\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.033349 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.033076    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/83f378e2-4ae7-4f19-9897-9093a45fe8b6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:02.033349 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.033106    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.034184 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.033126    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-run-ovn\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.034184 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.033135    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-cnibin\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.034184 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.033175    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr27c\" (UniqueName: \"kubernetes.io/projected/1fabac46-7d5e-4a66-81dc-3959f894fde3-kube-api-access-hr27c\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.034184 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.033194    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-host-run-netns\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.034184 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.033210    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf7mp\" (UniqueName: \"kubernetes.io/projected/e4dac435-5ca9-41af-b8f0-e3aaa5b57d7d-kube-api-access-wf7mp\") pod \"node-resolver-z4mcd\" (UID: \"e4dac435-5ca9-41af-b8f0-e3aaa5b57d7d\") " pod="openshift-dns/node-resolver-z4mcd"
Aug 04 18:28:02.034184 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.033503    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-cnibin\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.034184 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.033735    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/83f378e2-4ae7-4f19-9897-9093a45fe8b6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:02.034184 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.033783    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-etc-sysconfig\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.034184 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.033816    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9bd4223d-7a9a-4ec4-9dea-c4ad74c6aa72-serviceca\") pod \"node-ca-txv8p\" (UID: \"9bd4223d-7a9a-4ec4-9dea-c4ad74c6aa72\") " pod="openshift-image-registry/node-ca-txv8p"
Aug 04 18:28:02.034184 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.033854    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3268785b-ed87-4880-b7a7-baf5cc9366da-ovnkube-script-lib\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.034184 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.033893    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-etc-systemd\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.034184 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.033923    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-lib-modules\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.034184 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.033949    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbxxw\" (UniqueName: \"kubernetes.io/projected/7e093c3f-6c17-49c3-a89a-acbd6552beb0-kube-api-access-nbxxw\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.034184 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.033998    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-multus-cni-dir\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.034184 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034044    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3268785b-ed87-4880-b7a7-baf5cc9366da-env-overrides\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.034184 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034080    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-var-lib-openvswitch\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.034184 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034111    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-system-cni-dir\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.034184 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034137    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-multus-socket-dir-parent\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.034859 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034168    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e4dac435-5ca9-41af-b8f0-e3aaa5b57d7d-hosts-file\") pod \"node-resolver-z4mcd\" (UID: \"e4dac435-5ca9-41af-b8f0-e3aaa5b57d7d\") " pod="openshift-dns/node-resolver-z4mcd"
Aug 04 18:28:02.034859 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034200    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-etc-kubernetes\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.034859 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034226    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-host-kubelet\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.034859 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034251    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-node-log\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.034859 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034277    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-host-cni-bin\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.034859 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034304    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4dac435-5ca9-41af-b8f0-e3aaa5b57d7d-tmp-dir\") pod \"node-resolver-z4mcd\" (UID: \"e4dac435-5ca9-41af-b8f0-e3aaa5b57d7d\") " pod="openshift-dns/node-resolver-z4mcd"
Aug 04 18:28:02.034859 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034329    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-var-lib-kubelet\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.034859 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034354    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-host-cni-netd\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.034859 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034380    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3268785b-ed87-4880-b7a7-baf5cc9366da-ovnkube-config\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.034859 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034420    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkwzb\" (UniqueName: \"kubernetes.io/projected/3268785b-ed87-4880-b7a7-baf5cc9366da-kube-api-access-hkwzb\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.034859 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034445    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-etc-sysctl-d\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.034859 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034470    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-sys\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.034859 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034495    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-multus-conf-dir\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.034859 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034522    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-etc-openvswitch\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.034859 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034548    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-log-socket\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.034859 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034573    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9bd4223d-7a9a-4ec4-9dea-c4ad74c6aa72-host\") pod \"node-ca-txv8p\" (UID: \"9bd4223d-7a9a-4ec4-9dea-c4ad74c6aa72\") " pod="openshift-image-registry/node-ca-txv8p"
Aug 04 18:28:02.034859 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034600    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-run\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.034859 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034626    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-host-run-k8s-cni-cncf-io\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.035638 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034654    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/31ea8e3e-777a-458b-93bf-67b8e504709c-konnectivity-ca\") pod \"konnectivity-agent-q6q26\" (UID: \"31ea8e3e-777a-458b-93bf-67b8e504709c\") " pod="kube-system/konnectivity-agent-q6q26"
Aug 04 18:28:02.035638 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034680    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-etc-sysctl-conf\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.035638 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034736    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs\") pod \"network-metrics-daemon-mrvjt\" (UID: \"54490a46-3a24-4059-87c8-850cc41a7459\") " pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:02.035638 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034764    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-hostroot\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.035638 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034793    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83f378e2-4ae7-4f19-9897-9093a45fe8b6-cni-binary-copy\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:02.035638 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034821    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-host-run-netns\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.035638 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034918    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-host-run-netns\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.035638 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.034962    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-run-openvswitch\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.035638 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.035271    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-etc-modprobe-d\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.035638 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.035316    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-host-run-ovn-kubernetes\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.036125 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.035778    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-etc-kubernetes\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.036125 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.035860    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-multus-cni-dir\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.036248 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036228    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3268785b-ed87-4880-b7a7-baf5cc9366da-ovnkube-config\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.036313 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036296    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-host-kubelet\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.036370 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036301    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3268785b-ed87-4880-b7a7-baf5cc9366da-env-overrides\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.036370 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036343    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-var-lib-openvswitch\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.036370 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036363    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-node-log\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.036504 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036375    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1fabac46-7d5e-4a66-81dc-3959f894fde3-multus-daemon-config\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.036504 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036404    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-host-cni-bin\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.036504 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036405    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-system-cni-dir\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.036504 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036440    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-etc-kubernetes\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.036504 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036451    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-multus-socket-dir-parent\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.036504 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036492    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83f378e2-4ae7-4f19-9897-9093a45fe8b6-system-cni-dir\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:02.036804 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036503    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e4dac435-5ca9-41af-b8f0-e3aaa5b57d7d-hosts-file\") pod \"node-resolver-z4mcd\" (UID: \"e4dac435-5ca9-41af-b8f0-e3aaa5b57d7d\") " pod="openshift-dns/node-resolver-z4mcd"
Aug 04 18:28:02.036804 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036557    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-var-lib-kubelet\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.036804 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036661    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4dac435-5ca9-41af-b8f0-e3aaa5b57d7d-tmp-dir\") pod \"node-resolver-z4mcd\" (UID: \"e4dac435-5ca9-41af-b8f0-e3aaa5b57d7d\") " pod="openshift-dns/node-resolver-z4mcd"
Aug 04 18:28:02.036804 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036745    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-host-var-lib-cni-bin\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.036804 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036764    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-host-cni-netd\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.036804 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036794    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-host-var-lib-cni-multus\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.037087 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036812    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9bd4223d-7a9a-4ec4-9dea-c4ad74c6aa72-host\") pod \"node-ca-txv8p\" (UID: \"9bd4223d-7a9a-4ec4-9dea-c4ad74c6aa72\") " pod="openshift-image-registry/node-ca-txv8p"
Aug 04 18:28:02.037087 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036840    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-host-run-multus-certs\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.037087 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036872    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-host-slash\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.037087 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036917    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83f378e2-4ae7-4f19-9897-9093a45fe8b6-cnibin\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:02.037087 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036910    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83f378e2-4ae7-4f19-9897-9093a45fe8b6-os-release\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:02.037087 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.036981    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-os-release\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.037087 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.037034    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-host-var-lib-kubelet\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.037426 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.037140    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-etc-sysctl-d\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.037426 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.037174    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83f378e2-4ae7-4f19-9897-9093a45fe8b6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:02.037426 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.037198    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-sys\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.037426 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.037229    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-host\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.037426 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.037241    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-multus-conf-dir\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.037426 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.037284    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-etc-openvswitch\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.037426 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.037329    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-log-socket\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.037426 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.037388    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/83f378e2-4ae7-4f19-9897-9093a45fe8b6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:02.039598 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.037452    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.039598 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.037501    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-etc-sysconfig\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.039598 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.037753    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-etc-systemd\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.039598 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.037903    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9bd4223d-7a9a-4ec4-9dea-c4ad74c6aa72-serviceca\") pod \"node-ca-txv8p\" (UID: \"9bd4223d-7a9a-4ec4-9dea-c4ad74c6aa72\") " pod="openshift-image-registry/node-ca-txv8p"
Aug 04 18:28:02.039598 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.038026    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-lib-modules\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.039598 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.038074    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-systemd-units\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.039598 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.038338    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3268785b-ed87-4880-b7a7-baf5cc9366da-ovnkube-script-lib\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.039598 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.038383    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-etc-sysctl-conf\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.039598 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.038416    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-hostroot\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.039598 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.038448    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7e093c3f-6c17-49c3-a89a-acbd6552beb0-run\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.039598 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.038491    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1fabac46-7d5e-4a66-81dc-3959f894fde3-host-run-k8s-cni-cncf-io\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.039598 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:02.038501    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:02.039598 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:02.038567    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs podName:54490a46-3a24-4059-87c8-850cc41a7459 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:02.538549894 +0000 UTC m=+3.072732985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs") pod "network-metrics-daemon-mrvjt" (UID: "54490a46-3a24-4059-87c8-850cc41a7459") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:02.039598 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.039025    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/31ea8e3e-777a-458b-93bf-67b8e504709c-konnectivity-ca\") pod \"konnectivity-agent-q6q26\" (UID: \"31ea8e3e-777a-458b-93bf-67b8e504709c\") " pod="kube-system/konnectivity-agent-q6q26"
Aug 04 18:28:02.039598 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.039093    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3268785b-ed87-4880-b7a7-baf5cc9366da-run-systemd\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.039598 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.039254    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83f378e2-4ae7-4f19-9897-9093a45fe8b6-cni-binary-copy\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:02.040409 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.040077    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7e093c3f-6c17-49c3-a89a-acbd6552beb0-etc-tuned\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.040566 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.040499    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e093c3f-6c17-49c3-a89a-acbd6552beb0-tmp\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.041928 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.041837    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/31ea8e3e-777a-458b-93bf-67b8e504709c-agent-certs\") pod \"konnectivity-agent-q6q26\" (UID: \"31ea8e3e-777a-458b-93bf-67b8e504709c\") " pod="kube-system/konnectivity-agent-q6q26"
Aug 04 18:28:02.042348 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.042299    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3268785b-ed87-4880-b7a7-baf5cc9366da-ovn-node-metrics-cert\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.044647 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.044600    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr27c\" (UniqueName: \"kubernetes.io/projected/1fabac46-7d5e-4a66-81dc-3959f894fde3-kube-api-access-hr27c\") pod \"multus-6bz2q\" (UID: \"1fabac46-7d5e-4a66-81dc-3959f894fde3\") " pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.045120 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.044957    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpknq\" (UniqueName: \"kubernetes.io/projected/9bd4223d-7a9a-4ec4-9dea-c4ad74c6aa72-kube-api-access-hpknq\") pod \"node-ca-txv8p\" (UID: \"9bd4223d-7a9a-4ec4-9dea-c4ad74c6aa72\") " pod="openshift-image-registry/node-ca-txv8p"
Aug 04 18:28:02.045677 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.045633    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf7mp\" (UniqueName: \"kubernetes.io/projected/e4dac435-5ca9-41af-b8f0-e3aaa5b57d7d-kube-api-access-wf7mp\") pod \"node-resolver-z4mcd\" (UID: \"e4dac435-5ca9-41af-b8f0-e3aaa5b57d7d\") " pod="openshift-dns/node-resolver-z4mcd"
Aug 04 18:28:02.047183 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.046877    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsstj\" (UniqueName: \"kubernetes.io/projected/54490a46-3a24-4059-87c8-850cc41a7459-kube-api-access-zsstj\") pod \"network-metrics-daemon-mrvjt\" (UID: \"54490a46-3a24-4059-87c8-850cc41a7459\") " pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:02.047183 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.047141    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqpld\" (UniqueName: \"kubernetes.io/projected/83f378e2-4ae7-4f19-9897-9093a45fe8b6-kube-api-access-xqpld\") pod \"multus-additional-cni-plugins-drtj5\" (UID: \"83f378e2-4ae7-4f19-9897-9093a45fe8b6\") " pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:02.047316 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.047284    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbxxw\" (UniqueName: \"kubernetes.io/projected/7e093c3f-6c17-49c3-a89a-acbd6552beb0-kube-api-access-nbxxw\") pod \"tuned-4lmn2\" (UID: \"7e093c3f-6c17-49c3-a89a-acbd6552beb0\") " pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.047582 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.047511    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkwzb\" (UniqueName: \"kubernetes.io/projected/3268785b-ed87-4880-b7a7-baf5cc9366da-kube-api-access-hkwzb\") pod \"ovnkube-node-dzrc4\" (UID: \"3268785b-ed87-4880-b7a7-baf5cc9366da\") " pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.119996 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.119958    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth"
Aug 04 18:28:02.129811 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.129784    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4mcrz"
Aug 04 18:28:02.133130 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:28:02.133098    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99c3ba1d_fc95_4b55_8cfb_39257deb5f19.slice/crio-1f379a833f9481e67d193457ba3a2413182e39981cbb5e515de01869c1a044f2 WatchSource:0}: Error finding container 1f379a833f9481e67d193457ba3a2413182e39981cbb5e515de01869c1a044f2: Status 404 returned error can't find the container with id 1f379a833f9481e67d193457ba3a2413182e39981cbb5e515de01869c1a044f2
Aug 04 18:28:02.139906 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.139662    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q6q26"
Aug 04 18:28:02.140809 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:28:02.140695    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18143425_be80_4ac4_8d5f_f8835134a92c.slice/crio-c81c0123c6d6d6741afb8279cd557a71af355a0c61f30c18e51f612c0ca87fe1 WatchSource:0}: Error finding container c81c0123c6d6d6741afb8279cd557a71af355a0c61f30c18e51f612c0ca87fe1: Status 404 returned error can't find the container with id c81c0123c6d6d6741afb8279cd557a71af355a0c61f30c18e51f612c0ca87fe1
Aug 04 18:28:02.147532 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.147513    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-txv8p"
Aug 04 18:28:02.156684 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.156661    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z4mcd"
Aug 04 18:28:02.157452 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:28:02.157399    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd4223d_7a9a_4ec4_9dea_c4ad74c6aa72.slice/crio-d70ae4b8d2cb1c10b599f7195ae8a06fae762f4f021cb6d4fdb70c65d92f284b WatchSource:0}: Error finding container d70ae4b8d2cb1c10b599f7195ae8a06fae762f4f021cb6d4fdb70c65d92f284b: Status 404 returned error can't find the container with id d70ae4b8d2cb1c10b599f7195ae8a06fae762f4f021cb6d4fdb70c65d92f284b
Aug 04 18:28:02.164403 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.164376    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4lmn2"
Aug 04 18:28:02.169511 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:28:02.169486    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4dac435_5ca9_41af_b8f0_e3aaa5b57d7d.slice/crio-66a57347be2a6d61e1569d7ee03eac74105eb2937bb7dbd42fc127ff89f1b86f WatchSource:0}: Error finding container 66a57347be2a6d61e1569d7ee03eac74105eb2937bb7dbd42fc127ff89f1b86f: Status 404 returned error can't find the container with id 66a57347be2a6d61e1569d7ee03eac74105eb2937bb7dbd42fc127ff89f1b86f
Aug 04 18:28:02.173669 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.173646    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6bz2q"
Aug 04 18:28:02.181789 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.181762    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-drtj5"
Aug 04 18:28:02.188969 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.188947    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:02.217916 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.217889    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:28:02.437383 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.437297    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret\") pod \"global-pull-secret-syncer-9jgn2\" (UID: \"587a9fe3-615e-41e1-bebf-6291030112c3\") " pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:02.437564 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:02.437476    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:02.437564 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:02.437557    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret podName:587a9fe3-615e-41e1-bebf-6291030112c3 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:03.437535707 +0000 UTC m=+3.971718790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret") pod "global-pull-secret-syncer-9jgn2" (UID: "587a9fe3-615e-41e1-bebf-6291030112c3") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:02.538766 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.538725    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lmvg\" (UniqueName: \"kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg\") pod \"network-check-target-6kqrt\" (UID: \"f300cb8a-fd83-4b82-9513-5cb728617244\") " pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:02.538975 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.538806    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs\") pod \"network-metrics-daemon-mrvjt\" (UID: \"54490a46-3a24-4059-87c8-850cc41a7459\") " pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:02.538975 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:02.538968    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:02.539099 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:02.539054    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs podName:54490a46-3a24-4059-87c8-850cc41a7459 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:03.539020764 +0000 UTC m=+4.073203837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs") pod "network-metrics-daemon-mrvjt" (UID: "54490a46-3a24-4059-87c8-850cc41a7459") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:02.539213 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:02.539184    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:28:02.539213 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:02.539213    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:28:02.539329 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:02.539227    2558 projected.go:196] Error preparing data for projected volume kube-api-access-8lmvg for pod openshift-network-diagnostics/network-check-target-6kqrt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:02.539329 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:02.539287    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg podName:f300cb8a-fd83-4b82-9513-5cb728617244 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:03.539267559 +0000 UTC m=+4.073450644 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8lmvg" (UniqueName: "kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg") pod "network-check-target-6kqrt" (UID: "f300cb8a-fd83-4b82-9513-5cb728617244") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:02.583320 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:28:02.583287    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e093c3f_6c17_49c3_a89a_acbd6552beb0.slice/crio-0f2cfc2afb4f2249a6deae8703975a09cf771ce609d01b250cba00b66a3f0438 WatchSource:0}: Error finding container 0f2cfc2afb4f2249a6deae8703975a09cf771ce609d01b250cba00b66a3f0438: Status 404 returned error can't find the container with id 0f2cfc2afb4f2249a6deae8703975a09cf771ce609d01b250cba00b66a3f0438
Aug 04 18:28:02.865222 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.865109    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 18:23:02 +0000 UTC" deadline="2028-04-07 09:12:18.297249669 +0000 UTC"
Aug 04 18:28:02.865222 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.865165    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14678h44m15.432089777s"
Aug 04 18:28:02.970631 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.970593    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4lmn2" event={"ID":"7e093c3f-6c17-49c3-a89a-acbd6552beb0","Type":"ContainerStarted","Data":"0f2cfc2afb4f2249a6deae8703975a09cf771ce609d01b250cba00b66a3f0438"}
Aug 04 18:28:02.971868 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.971835    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z4mcd" event={"ID":"e4dac435-5ca9-41af-b8f0-e3aaa5b57d7d","Type":"ContainerStarted","Data":"66a57347be2a6d61e1569d7ee03eac74105eb2937bb7dbd42fc127ff89f1b86f"}
Aug 04 18:28:02.973188 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.973158    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-txv8p" event={"ID":"9bd4223d-7a9a-4ec4-9dea-c4ad74c6aa72","Type":"ContainerStarted","Data":"d70ae4b8d2cb1c10b599f7195ae8a06fae762f4f021cb6d4fdb70c65d92f284b"}
Aug 04 18:28:02.974605 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.974581    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q6q26" event={"ID":"31ea8e3e-777a-458b-93bf-67b8e504709c","Type":"ContainerStarted","Data":"f361de085c488d4688cc167d863443b3e47814b92fff8c4f2e998a93c67cd885"}
Aug 04 18:28:02.976904 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.976548    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4mcrz" event={"ID":"18143425-be80-4ac4-8d5f-f8835134a92c","Type":"ContainerStarted","Data":"c81c0123c6d6d6741afb8279cd557a71af355a0c61f30c18e51f612c0ca87fe1"}
Aug 04 18:28:02.978064 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:02.978040    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth" event={"ID":"99c3ba1d-fc95-4b55-8cfb-39257deb5f19","Type":"ContainerStarted","Data":"1f379a833f9481e67d193457ba3a2413182e39981cbb5e515de01869c1a044f2"}
Aug 04 18:28:03.447884 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:03.447826    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret\") pod \"global-pull-secret-syncer-9jgn2\" (UID: \"587a9fe3-615e-41e1-bebf-6291030112c3\") " pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:03.448109 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:03.448088    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:03.448183 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:03.448151    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret podName:587a9fe3-615e-41e1-bebf-6291030112c3 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:05.448134303 +0000 UTC m=+5.982317372 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret") pod "global-pull-secret-syncer-9jgn2" (UID: "587a9fe3-615e-41e1-bebf-6291030112c3") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:03.548362 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:03.548319    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lmvg\" (UniqueName: \"kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg\") pod \"network-check-target-6kqrt\" (UID: \"f300cb8a-fd83-4b82-9513-5cb728617244\") " pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:03.548538 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:03.548382    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs\") pod \"network-metrics-daemon-mrvjt\" (UID: \"54490a46-3a24-4059-87c8-850cc41a7459\") " pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:03.548538 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:03.548496    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:03.548619 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:03.548561    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs podName:54490a46-3a24-4059-87c8-850cc41a7459 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:05.548542535 +0000 UTC m=+6.082725620 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs") pod "network-metrics-daemon-mrvjt" (UID: "54490a46-3a24-4059-87c8-850cc41a7459") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:03.549179 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:03.549019    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:28:03.549179 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:03.549044    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:28:03.549179 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:03.549057    2558 projected.go:196] Error preparing data for projected volume kube-api-access-8lmvg for pod openshift-network-diagnostics/network-check-target-6kqrt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:03.549179 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:03.549108    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg podName:f300cb8a-fd83-4b82-9513-5cb728617244 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:05.549092725 +0000 UTC m=+6.083275797 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8lmvg" (UniqueName: "kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg") pod "network-check-target-6kqrt" (UID: "f300cb8a-fd83-4b82-9513-5cb728617244") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:03.677093 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:28:03.677059    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fabac46_7d5e_4a66_81dc_3959f894fde3.slice/crio-aadbb0d782433613f7fd9d79c8a14786fe881edaa0f93a9118f56475fdcb59e1 WatchSource:0}: Error finding container aadbb0d782433613f7fd9d79c8a14786fe881edaa0f93a9118f56475fdcb59e1: Status 404 returned error can't find the container with id aadbb0d782433613f7fd9d79c8a14786fe881edaa0f93a9118f56475fdcb59e1
Aug 04 18:28:03.865804 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:03.865699    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 18:23:02 +0000 UTC" deadline="2028-01-07 12:41:00.989481122 +0000 UTC"
Aug 04 18:28:03.865804 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:03.865747    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12498h12m57.123739974s"
Aug 04 18:28:03.962537 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:03.957880    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:03.962537 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:03.958170    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrvjt" podUID="54490a46-3a24-4059-87c8-850cc41a7459"
Aug 04 18:28:03.962537 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:03.958821    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:03.962537 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:03.958962    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6kqrt" podUID="f300cb8a-fd83-4b82-9513-5cb728617244"
Aug 04 18:28:03.962537 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:03.959053    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:03.962537 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:03.959192    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jgn2" podUID="587a9fe3-615e-41e1-bebf-6291030112c3"
Aug 04 18:28:03.984170 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:03.984130    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6bz2q" event={"ID":"1fabac46-7d5e-4a66-81dc-3959f894fde3","Type":"ContainerStarted","Data":"aadbb0d782433613f7fd9d79c8a14786fe881edaa0f93a9118f56475fdcb59e1"}
Aug 04 18:28:04.488903 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:28:04.488819    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3268785b_ed87_4880_b7a7_baf5cc9366da.slice/crio-7aa564e7b966eb4001e44abcc0fd2a67c030f1a2ceba0ec8e5d98e0096c81b97 WatchSource:0}: Error finding container 7aa564e7b966eb4001e44abcc0fd2a67c030f1a2ceba0ec8e5d98e0096c81b97: Status 404 returned error can't find the container with id 7aa564e7b966eb4001e44abcc0fd2a67c030f1a2ceba0ec8e5d98e0096c81b97
Aug 04 18:28:04.987507 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:04.987409    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4" event={"ID":"3268785b-ed87-4880-b7a7-baf5cc9366da","Type":"ContainerStarted","Data":"7aa564e7b966eb4001e44abcc0fd2a67c030f1a2ceba0ec8e5d98e0096c81b97"}
Aug 04 18:28:05.469144 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:05.469048    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret\") pod \"global-pull-secret-syncer-9jgn2\" (UID: \"587a9fe3-615e-41e1-bebf-6291030112c3\") " pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:05.469329 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:05.469285    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:05.469397 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:05.469357    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret podName:587a9fe3-615e-41e1-bebf-6291030112c3 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:09.469336598 +0000 UTC m=+10.003519672 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret") pod "global-pull-secret-syncer-9jgn2" (UID: "587a9fe3-615e-41e1-bebf-6291030112c3") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:05.570451 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:05.569792    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lmvg\" (UniqueName: \"kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg\") pod \"network-check-target-6kqrt\" (UID: \"f300cb8a-fd83-4b82-9513-5cb728617244\") " pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:05.570451 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:05.569861    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs\") pod \"network-metrics-daemon-mrvjt\" (UID: \"54490a46-3a24-4059-87c8-850cc41a7459\") " pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:05.570451 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:05.570037    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:05.570451 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:05.570102    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs podName:54490a46-3a24-4059-87c8-850cc41a7459 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:09.570081872 +0000 UTC m=+10.104264955 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs") pod "network-metrics-daemon-mrvjt" (UID: "54490a46-3a24-4059-87c8-850cc41a7459") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:05.570451 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:05.570244    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:28:05.570451 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:05.570266    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:28:05.570451 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:05.570279    2558 projected.go:196] Error preparing data for projected volume kube-api-access-8lmvg for pod openshift-network-diagnostics/network-check-target-6kqrt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:05.570451 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:05.570322    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg podName:f300cb8a-fd83-4b82-9513-5cb728617244 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:09.570308499 +0000 UTC m=+10.104491571 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8lmvg" (UniqueName: "kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg") pod "network-check-target-6kqrt" (UID: "f300cb8a-fd83-4b82-9513-5cb728617244") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:05.958643 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:05.958022    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:05.958643 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:05.958179    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6kqrt" podUID="f300cb8a-fd83-4b82-9513-5cb728617244"
Aug 04 18:28:05.958643 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:05.958023    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:05.958643 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:05.958344    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrvjt" podUID="54490a46-3a24-4059-87c8-850cc41a7459"
Aug 04 18:28:05.958643 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:05.958392    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:05.958643 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:05.958469    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jgn2" podUID="587a9fe3-615e-41e1-bebf-6291030112c3"
Aug 04 18:28:07.958166 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:07.957904    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:07.958618 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:07.958295    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jgn2" podUID="587a9fe3-615e-41e1-bebf-6291030112c3"
Aug 04 18:28:07.958618 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:07.957916    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:07.958618 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:07.957920    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:07.958618 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:07.958398    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6kqrt" podUID="f300cb8a-fd83-4b82-9513-5cb728617244"
Aug 04 18:28:07.958618 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:07.958482    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrvjt" podUID="54490a46-3a24-4059-87c8-850cc41a7459"
Aug 04 18:28:07.998677 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:07.998621    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-drtj5" event={"ID":"83f378e2-4ae7-4f19-9897-9093a45fe8b6","Type":"ContainerStarted","Data":"9d45fe15e70032a19638cba07748bb7089a5f103f065bbe44f54a7de0a0b9dc0"}
Aug 04 18:28:09.509331 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:09.509284    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret\") pod \"global-pull-secret-syncer-9jgn2\" (UID: \"587a9fe3-615e-41e1-bebf-6291030112c3\") " pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:09.509841 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:09.509465    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:09.509841 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:09.509532    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret podName:587a9fe3-615e-41e1-bebf-6291030112c3 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:17.509517617 +0000 UTC m=+18.043700688 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret") pod "global-pull-secret-syncer-9jgn2" (UID: "587a9fe3-615e-41e1-bebf-6291030112c3") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:09.610593 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:09.609735    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lmvg\" (UniqueName: \"kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg\") pod \"network-check-target-6kqrt\" (UID: \"f300cb8a-fd83-4b82-9513-5cb728617244\") " pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:09.610593 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:09.609816    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs\") pod \"network-metrics-daemon-mrvjt\" (UID: \"54490a46-3a24-4059-87c8-850cc41a7459\") " pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:09.610593 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:09.609953    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:09.610593 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:09.610021    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs podName:54490a46-3a24-4059-87c8-850cc41a7459 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:17.609999783 +0000 UTC m=+18.144182866 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs") pod "network-metrics-daemon-mrvjt" (UID: "54490a46-3a24-4059-87c8-850cc41a7459") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:09.610593 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:09.610471    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:28:09.610593 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:09.610491    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:28:09.610593 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:09.610505    2558 projected.go:196] Error preparing data for projected volume kube-api-access-8lmvg for pod openshift-network-diagnostics/network-check-target-6kqrt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:09.610593 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:09.610553    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg podName:f300cb8a-fd83-4b82-9513-5cb728617244 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:17.610537494 +0000 UTC m=+18.144720571 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8lmvg" (UniqueName: "kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg") pod "network-check-target-6kqrt" (UID: "f300cb8a-fd83-4b82-9513-5cb728617244") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:09.958846 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:09.958753    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:09.959012 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:09.958878    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jgn2" podUID="587a9fe3-615e-41e1-bebf-6291030112c3"
Aug 04 18:28:09.959303 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:09.959282    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:09.959407 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:09.959386    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6kqrt" podUID="f300cb8a-fd83-4b82-9513-5cb728617244"
Aug 04 18:28:09.959473 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:09.959448    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:09.959560 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:09.959529    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrvjt" podUID="54490a46-3a24-4059-87c8-850cc41a7459"
Aug 04 18:28:11.007085 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:11.007040    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal" event={"ID":"5e707b88f4e7c983d7d792d407b11403","Type":"ContainerStarted","Data":"c66e4bd20fa6e9b9c5e4a953a854e0f92bfdc4405f63ffe921e7b9cd2fc9b1db"}
Aug 04 18:28:11.011027 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:11.009723    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4lmn2" event={"ID":"7e093c3f-6c17-49c3-a89a-acbd6552beb0","Type":"ContainerStarted","Data":"217d69f57c42291cf7764025ca3646da07f64b5f2ef1ca795409df924c994084"}
Aug 04 18:28:11.012704 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:11.012285    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q6q26" event={"ID":"31ea8e3e-777a-458b-93bf-67b8e504709c","Type":"ContainerStarted","Data":"9ad318e0ebad8adeba8cde45910ba5431856fc1eab3aa0cc252c27a3ea7e728e"}
Aug 04 18:28:11.016451 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:11.016422    2558 generic.go:356] "Generic (PLEG): container finished" podID="cd8ce69c906537611de113e005e48bc0" containerID="13a953171d9d6bd664896f52a8dfbe032a10c36a64c58a012e463ef701c35a2f" exitCode=0
Aug 04 18:28:11.016624 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:11.016592    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal" event={"ID":"cd8ce69c906537611de113e005e48bc0","Type":"ContainerDied","Data":"13a953171d9d6bd664896f52a8dfbe032a10c36a64c58a012e463ef701c35a2f"}
Aug 04 18:28:11.019150 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:11.019128    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z4mcd" event={"ID":"e4dac435-5ca9-41af-b8f0-e3aaa5b57d7d","Type":"ContainerStarted","Data":"770ae897bfb881531ba37a42c45f0b40df181f5d3b48adefc049217b3fa2cb10"}
Aug 04 18:28:11.022229 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:11.021839    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-txv8p" event={"ID":"9bd4223d-7a9a-4ec4-9dea-c4ad74c6aa72","Type":"ContainerStarted","Data":"d81ca2feb0255b3cb5d85faf8fcaecee6dab0a2cbdbd3c576a6b60ee51fb8afd"}
Aug 04 18:28:11.026217 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:11.026163    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth" event={"ID":"99c3ba1d-fc95-4b55-8cfb-39257deb5f19","Type":"ContainerStarted","Data":"e6b5d205ffef4c82f4a4bc57f7639f51d886f82bab30bdf5f4628d4bac11e0c2"}
Aug 04 18:28:11.042297 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:11.042246    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal" podStartSLOduration=10.042227772 podStartE2EDuration="10.042227772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:28:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:11.025105178 +0000 UTC m=+11.559288267" watchObservedRunningTime="2026-08-04 18:28:11.042227772 +0000 UTC m=+11.576410863"
Aug 04 18:28:11.078262 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:11.078167    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-q6q26" podStartSLOduration=3.144218952 podStartE2EDuration="11.078145636s" totalImagesPullingTime="7.933926684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:11.060967656 +0000 UTC m=+11.595150944" watchObservedRunningTime="2026-08-04 18:28:11.078145636 +0000 UTC m=+11.612328726"
Aug 04 18:28:11.093266 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:11.093214    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z4mcd" podStartSLOduration=3.162470297 podStartE2EDuration="11.093194696s" totalImagesPullingTime="7.930724399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:11.078589399 +0000 UTC m=+11.612772489" watchObservedRunningTime="2026-08-04 18:28:11.093194696 +0000 UTC m=+11.627377785"
Aug 04 18:28:11.110960 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:11.110906    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-txv8p" podStartSLOduration=3.184944068 podStartE2EDuration="11.110885385s" totalImagesPullingTime="7.925941317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:11.094123994 +0000 UTC m=+11.628307083" watchObservedRunningTime="2026-08-04 18:28:11.110885385 +0000 UTC m=+11.645068476"
Aug 04 18:28:11.111461 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:11.111389    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4lmn2" podStartSLOduration=3.5759726499999998 podStartE2EDuration="11.111378514s" totalImagesPullingTime="7.535405864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:11.110165731 +0000 UTC m=+11.644348820" watchObservedRunningTime="2026-08-04 18:28:11.111378514 +0000 UTC m=+11.645561606"
Aug 04 18:28:11.957532 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:11.957274    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:11.957697 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:11.957576    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrvjt" podUID="54490a46-3a24-4059-87c8-850cc41a7459"
Aug 04 18:28:11.957697 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:11.957313    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:11.957697 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:11.957658    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jgn2" podUID="587a9fe3-615e-41e1-bebf-6291030112c3"
Aug 04 18:28:11.957697 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:11.957274    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:11.958019 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:11.957705    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6kqrt" podUID="f300cb8a-fd83-4b82-9513-5cb728617244"
Aug 04 18:28:12.031659 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:12.031263    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4mcrz" event={"ID":"18143425-be80-4ac4-8d5f-f8835134a92c","Type":"ContainerStarted","Data":"9b85059515e629cf2fa9e3497218ee6bd563d6c24221628edad093dc42455f07"}
Aug 04 18:28:12.034987 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:12.034960    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal" event={"ID":"cd8ce69c906537611de113e005e48bc0","Type":"ContainerStarted","Data":"b8ad15821083b7072b3e8f2dd1c0018eccf43a8ff6aec450c479d20dd33f563a"}
Aug 04 18:28:12.045045 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:12.044993    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4mcrz" podStartSLOduration=4.091713859 podStartE2EDuration="12.044973323s" totalImagesPullingTime="7.953259464s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:12.044891514 +0000 UTC m=+12.579074618" watchObservedRunningTime="2026-08-04 18:28:12.044973323 +0000 UTC m=+12.579156410"
Aug 04 18:28:12.060296 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:12.060243    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal" podStartSLOduration=11.060224854 podStartE2EDuration="11.060224854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:28:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:12.059859953 +0000 UTC m=+12.594043042" watchObservedRunningTime="2026-08-04 18:28:12.060224854 +0000 UTC m=+12.594407942"
Aug 04 18:28:13.958218 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:13.958186    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:13.958716 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:13.958186    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:13.958716 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:13.958317    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jgn2" podUID="587a9fe3-615e-41e1-bebf-6291030112c3"
Aug 04 18:28:13.958716 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:13.958424    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrvjt" podUID="54490a46-3a24-4059-87c8-850cc41a7459"
Aug 04 18:28:13.958716 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:13.958187    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:13.958716 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:13.958536    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6kqrt" podUID="f300cb8a-fd83-4b82-9513-5cb728617244"
Aug 04 18:28:13.984216 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:13.984186    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-q6q26"
Aug 04 18:28:13.984863 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:13.984836    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-q6q26"
Aug 04 18:28:15.957562 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:15.957528    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:15.958292 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:15.957539    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:15.958292 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:15.957543    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:15.958292 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:15.957674    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrvjt" podUID="54490a46-3a24-4059-87c8-850cc41a7459"
Aug 04 18:28:15.958292 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:15.957732    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6kqrt" podUID="f300cb8a-fd83-4b82-9513-5cb728617244"
Aug 04 18:28:15.958292 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:15.957840    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jgn2" podUID="587a9fe3-615e-41e1-bebf-6291030112c3"
Aug 04 18:28:17.566494 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:17.566450    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret\") pod \"global-pull-secret-syncer-9jgn2\" (UID: \"587a9fe3-615e-41e1-bebf-6291030112c3\") " pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:17.567146 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:17.566593    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:17.567146 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:17.566674    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret podName:587a9fe3-615e-41e1-bebf-6291030112c3 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:33.566657687 +0000 UTC m=+34.100840758 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret") pod "global-pull-secret-syncer-9jgn2" (UID: "587a9fe3-615e-41e1-bebf-6291030112c3") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:17.667409 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:17.667379    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs\") pod \"network-metrics-daemon-mrvjt\" (UID: \"54490a46-3a24-4059-87c8-850cc41a7459\") " pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:17.667561 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:17.667434    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lmvg\" (UniqueName: \"kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg\") pod \"network-check-target-6kqrt\" (UID: \"f300cb8a-fd83-4b82-9513-5cb728617244\") " pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:17.667561 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:17.667528    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:17.667561 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:17.667542    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:28:17.667561 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:17.667554    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:28:17.667561 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:17.667563    2558 projected.go:196] Error preparing data for projected volume kube-api-access-8lmvg for pod openshift-network-diagnostics/network-check-target-6kqrt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:17.667738 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:17.667587    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs podName:54490a46-3a24-4059-87c8-850cc41a7459 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:33.667572595 +0000 UTC m=+34.201755662 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs") pod "network-metrics-daemon-mrvjt" (UID: "54490a46-3a24-4059-87c8-850cc41a7459") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:17.667738 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:17.667603    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg podName:f300cb8a-fd83-4b82-9513-5cb728617244 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:33.667592786 +0000 UTC m=+34.201775875 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8lmvg" (UniqueName: "kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg") pod "network-check-target-6kqrt" (UID: "f300cb8a-fd83-4b82-9513-5cb728617244") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:17.951461 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:17.951366    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-q6q26"
Aug 04 18:28:17.951643 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:17.951521    2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Aug 04 18:28:17.952055 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:17.952033    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-q6q26"
Aug 04 18:28:17.957317 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:17.957287    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:17.957317 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:17.957310    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:17.957488 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:17.957310    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:17.957488 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:17.957392    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jgn2" podUID="587a9fe3-615e-41e1-bebf-6291030112c3"
Aug 04 18:28:17.957596 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:17.957509    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6kqrt" podUID="f300cb8a-fd83-4b82-9513-5cb728617244"
Aug 04 18:28:17.957669 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:17.957600    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrvjt" podUID="54490a46-3a24-4059-87c8-850cc41a7459"
Aug 04 18:28:19.960802 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:19.960763    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:19.961362 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:19.960806    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:19.961362 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:19.960806    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:19.961362 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:19.960882    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6kqrt" podUID="f300cb8a-fd83-4b82-9513-5cb728617244"
Aug 04 18:28:19.961362 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:19.960994    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrvjt" podUID="54490a46-3a24-4059-87c8-850cc41a7459"
Aug 04 18:28:19.961362 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:19.961084    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jgn2" podUID="587a9fe3-615e-41e1-bebf-6291030112c3"
Aug 04 18:28:21.847148 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:21.847121    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 04 18:28:21.891803 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:21.891683    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-04T18:28:21.847144001Z","UUID":"5f5671ed-b074-4d25-bc37-ba17761deac2","Handler":null,"Name":"","Endpoint":""}
Aug 04 18:28:21.893187 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:21.893169    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 04 18:28:21.893282 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:21.893204    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 04 18:28:21.957581 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:21.957555    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:21.957716 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:21.957555    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:21.957716 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:21.957687    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jgn2" podUID="587a9fe3-615e-41e1-bebf-6291030112c3"
Aug 04 18:28:21.957835 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:21.957807    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6kqrt" podUID="f300cb8a-fd83-4b82-9513-5cb728617244"
Aug 04 18:28:21.957890 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:21.957874    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:21.957989 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:21.957971    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrvjt" podUID="54490a46-3a24-4059-87c8-850cc41a7459"
Aug 04 18:28:22.056720 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:22.056693    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6bz2q" event={"ID":"1fabac46-7d5e-4a66-81dc-3959f894fde3","Type":"ContainerStarted","Data":"055c6115efe754d3b834b8c70dd36f22e4fdc11df8d7df4b284d6219163db48c"}
Aug 04 18:28:22.058682 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:22.058656    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4" event={"ID":"3268785b-ed87-4880-b7a7-baf5cc9366da","Type":"ContainerStarted","Data":"c557be4b588bc0685323c898a42349c2eea3508393bc4811b0b68f7198b8f68e"}
Aug 04 18:28:22.058776 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:22.058727    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4" event={"ID":"3268785b-ed87-4880-b7a7-baf5cc9366da","Type":"ContainerStarted","Data":"d141ca1f3624890fe5174949fe098cac407f491eef59f6516c2e73416f031849"}
Aug 04 18:28:22.058821 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:22.058794    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4" event={"ID":"3268785b-ed87-4880-b7a7-baf5cc9366da","Type":"ContainerStarted","Data":"ca680e7c30b52944c6b2bd6538cfd73ac7b6a9cf6fd40a3422c675eaeaf439cf"}
Aug 04 18:28:22.060324 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:22.060298    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth" event={"ID":"99c3ba1d-fc95-4b55-8cfb-39257deb5f19","Type":"ContainerStarted","Data":"295f92c68dcdff34f8c1f5d741c78486eace5b3edcd766f61ccacde1d44d49e9"}
Aug 04 18:28:22.061586 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:22.061561    2558 generic.go:356] "Generic (PLEG): container finished" podID="83f378e2-4ae7-4f19-9897-9093a45fe8b6" containerID="f0be85e914c7fa9be2e19dff2208ac5c957b54c64cfbac9426e5577d85e4c201" exitCode=0
Aug 04 18:28:22.061678 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:22.061599    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-drtj5" event={"ID":"83f378e2-4ae7-4f19-9897-9093a45fe8b6","Type":"ContainerDied","Data":"f0be85e914c7fa9be2e19dff2208ac5c957b54c64cfbac9426e5577d85e4c201"}
Aug 04 18:28:22.074848 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:22.074809    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6bz2q" podStartSLOduration=3.984746674 podStartE2EDuration="22.074795895s" totalImagesPullingTime="18.090049221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:22.074472515 +0000 UTC m=+22.608655604" watchObservedRunningTime="2026-08-04 18:28:22.074795895 +0000 UTC m=+22.608978984"
Aug 04 18:28:23.067346 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:23.067252    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4" event={"ID":"3268785b-ed87-4880-b7a7-baf5cc9366da","Type":"ContainerStarted","Data":"ef2543bcca7844f359d672a8e909d445f007fab5566c0efd0ca5544b20209612"}
Aug 04 18:28:23.067346 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:23.067317    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4" event={"ID":"3268785b-ed87-4880-b7a7-baf5cc9366da","Type":"ContainerStarted","Data":"afe2cf95ebea5c84e29680778c0212a7b8d18bcb5a2493dc9a52108c46ae41f7"}
Aug 04 18:28:23.067917 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:23.067354    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4" event={"ID":"3268785b-ed87-4880-b7a7-baf5cc9366da","Type":"ContainerStarted","Data":"7e01e605f420eacda2f33f262ed465425928347c6215cdfc07026e04c379145c"}
Aug 04 18:28:23.069219 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:23.069182    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth" event={"ID":"99c3ba1d-fc95-4b55-8cfb-39257deb5f19","Type":"ContainerStarted","Data":"ce98bfdaa3d7c62480f72c251df046352d75a2ab38f661b7ce40d4a690924e1f"}
Aug 04 18:28:23.087794 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:23.087756    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qth" podStartSLOduration=2.9991770410000003 podStartE2EDuration="23.087740333s" totalImagesPullingTime="20.088563292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:28:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:23.087736612 +0000 UTC m=+23.621919700" watchObservedRunningTime="2026-08-04 18:28:23.087740333 +0000 UTC m=+23.621923422"
Aug 04 18:28:23.957909 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:23.957879    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:23.957909 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:23.957909    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:23.958216 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:23.958005    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrvjt" podUID="54490a46-3a24-4059-87c8-850cc41a7459"
Aug 04 18:28:23.958216 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:23.958091    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jgn2" podUID="587a9fe3-615e-41e1-bebf-6291030112c3"
Aug 04 18:28:23.958216 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:23.958132    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:23.958216 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:23.958204    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6kqrt" podUID="f300cb8a-fd83-4b82-9513-5cb728617244"
Aug 04 18:28:25.077915 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:25.077879    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4" event={"ID":"3268785b-ed87-4880-b7a7-baf5cc9366da","Type":"ContainerStarted","Data":"340a19de28edaf1a0f05b5ad3d2feb9029fe65c25027f63eae9f86fe0148a646"}
Aug 04 18:28:25.960325 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:25.960292    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:25.960325 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:25.960329    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:25.960581 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:25.960395    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:25.960581 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:25.960413    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrvjt" podUID="54490a46-3a24-4059-87c8-850cc41a7459"
Aug 04 18:28:25.960581 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:25.960458    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jgn2" podUID="587a9fe3-615e-41e1-bebf-6291030112c3"
Aug 04 18:28:25.960581 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:25.960543    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6kqrt" podUID="f300cb8a-fd83-4b82-9513-5cb728617244"
Aug 04 18:28:27.957774 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:27.957504    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:27.958401 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:27.957502    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:27.958401 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:27.957540    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:27.958401 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:27.957909    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jgn2" podUID="587a9fe3-615e-41e1-bebf-6291030112c3"
Aug 04 18:28:27.958401 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:27.957980    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6kqrt" podUID="f300cb8a-fd83-4b82-9513-5cb728617244"
Aug 04 18:28:27.958401 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:27.958078    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrvjt" podUID="54490a46-3a24-4059-87c8-850cc41a7459"
Aug 04 18:28:28.085645 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:28.085603    2558 generic.go:356] "Generic (PLEG): container finished" podID="83f378e2-4ae7-4f19-9897-9093a45fe8b6" containerID="4200ac83881cf1df6bebd48ac16a9fae5a3460a187dd54b83345ae32a95c58e9" exitCode=0
Aug 04 18:28:28.085871 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:28.085692    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-drtj5" event={"ID":"83f378e2-4ae7-4f19-9897-9093a45fe8b6","Type":"ContainerDied","Data":"4200ac83881cf1df6bebd48ac16a9fae5a3460a187dd54b83345ae32a95c58e9"}
Aug 04 18:28:28.089855 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:28.089829    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4" event={"ID":"3268785b-ed87-4880-b7a7-baf5cc9366da","Type":"ContainerStarted","Data":"e82f47b5e8d5696f097146705c2e555779dabd6cfe0da26cee819f1c8abb6f80"}
Aug 04 18:28:28.093451 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:28.091801    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:28.093451 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:28.092182    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:28.108345 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:28.108317    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:29.097869 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:29.095758    2558 generic.go:356] "Generic (PLEG): container finished" podID="83f378e2-4ae7-4f19-9897-9093a45fe8b6" containerID="b88d4c4b640205d87e9dfd671640b48bc3b38a8d6395e0772fbdee7a9ffa9315" exitCode=0
Aug 04 18:28:29.097869 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:29.097450    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-drtj5" event={"ID":"83f378e2-4ae7-4f19-9897-9093a45fe8b6","Type":"ContainerDied","Data":"b88d4c4b640205d87e9dfd671640b48bc3b38a8d6395e0772fbdee7a9ffa9315"}
Aug 04 18:28:29.097869 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:29.097730    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:29.118293 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:29.118265    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:28:29.120500 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:29.120457    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4" podStartSLOduration=11.789329034 podStartE2EDuration="29.120441779s" totalImagesPullingTime="17.331112745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:28.136664287 +0000 UTC m=+28.670847377" watchObservedRunningTime="2026-08-04 18:28:29.120441779 +0000 UTC m=+29.654624866"
Aug 04 18:28:29.772039 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:29.772007    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9jgn2"]
Aug 04 18:28:29.772216 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:29.772133    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:29.772282 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:29.772226    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jgn2" podUID="587a9fe3-615e-41e1-bebf-6291030112c3"
Aug 04 18:28:29.778403 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:29.778309    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mrvjt"]
Aug 04 18:28:29.778813 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:29.778794    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:29.778912 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:29.778892    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrvjt" podUID="54490a46-3a24-4059-87c8-850cc41a7459"
Aug 04 18:28:29.787986 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:29.787969    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6kqrt"]
Aug 04 18:28:29.788068 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:29.788055    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:29.788146 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:29.788127    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6kqrt" podUID="f300cb8a-fd83-4b82-9513-5cb728617244"
Aug 04 18:28:30.100834 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:30.100569    2558 generic.go:356] "Generic (PLEG): container finished" podID="83f378e2-4ae7-4f19-9897-9093a45fe8b6" containerID="d3c77bd60985270907f8411a03a99204cdbc66c538a6ce55cb66a58b0a1c1bbb" exitCode=0
Aug 04 18:28:30.100834 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:30.100628    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-drtj5" event={"ID":"83f378e2-4ae7-4f19-9897-9093a45fe8b6","Type":"ContainerDied","Data":"d3c77bd60985270907f8411a03a99204cdbc66c538a6ce55cb66a58b0a1c1bbb"}
Aug 04 18:28:31.957984 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:31.957947    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:31.958613 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:31.957948    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:31.958613 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:31.958107    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrvjt" podUID="54490a46-3a24-4059-87c8-850cc41a7459"
Aug 04 18:28:31.958613 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:31.958159    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:31.958613 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:31.958296    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6kqrt" podUID="f300cb8a-fd83-4b82-9513-5cb728617244"
Aug 04 18:28:31.958613 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:31.958414    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jgn2" podUID="587a9fe3-615e-41e1-bebf-6291030112c3"
Aug 04 18:28:33.580694 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:33.580649    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret\") pod \"global-pull-secret-syncer-9jgn2\" (UID: \"587a9fe3-615e-41e1-bebf-6291030112c3\") " pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:33.581240 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:33.580753    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:33.581240 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:33.580835    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret podName:587a9fe3-615e-41e1-bebf-6291030112c3 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:05.580817904 +0000 UTC m=+66.115000972 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret") pod "global-pull-secret-syncer-9jgn2" (UID: "587a9fe3-615e-41e1-bebf-6291030112c3") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:28:33.681033 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:33.680996    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lmvg\" (UniqueName: \"kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg\") pod \"network-check-target-6kqrt\" (UID: \"f300cb8a-fd83-4b82-9513-5cb728617244\") " pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:33.681227 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:33.681044    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs\") pod \"network-metrics-daemon-mrvjt\" (UID: \"54490a46-3a24-4059-87c8-850cc41a7459\") " pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:33.681227 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:33.681175    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:33.681350 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:33.681232    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs podName:54490a46-3a24-4059-87c8-850cc41a7459 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:05.681215469 +0000 UTC m=+66.215398535 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs") pod "network-metrics-daemon-mrvjt" (UID: "54490a46-3a24-4059-87c8-850cc41a7459") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:28:33.681350 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:33.681180    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:28:33.681350 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:33.681273    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:28:33.681350 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:33.681287    2558 projected.go:196] Error preparing data for projected volume kube-api-access-8lmvg for pod openshift-network-diagnostics/network-check-target-6kqrt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:33.681350 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:33.681341    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg podName:f300cb8a-fd83-4b82-9513-5cb728617244 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:05.681329372 +0000 UTC m=+66.215512451 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8lmvg" (UniqueName: "kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg") pod "network-check-target-6kqrt" (UID: "f300cb8a-fd83-4b82-9513-5cb728617244") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:28:33.957714 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:33.957674    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:33.957909 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:33.957674    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:33.957909 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:33.957820    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6kqrt" podUID="f300cb8a-fd83-4b82-9513-5cb728617244"
Aug 04 18:28:33.957909 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:33.957674    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:33.957909 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:33.957886    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jgn2" podUID="587a9fe3-615e-41e1-bebf-6291030112c3"
Aug 04 18:28:33.958134 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:33.957969    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrvjt" podUID="54490a46-3a24-4059-87c8-850cc41a7459"
Aug 04 18:28:34.327947 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.327863    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeReady"
Aug 04 18:28:34.328116 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.328023    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 04 18:28:34.375156 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.375121    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mw7k5"]
Aug 04 18:28:34.406314 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.406271    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xzrg5"]
Aug 04 18:28:34.406484 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.406433    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:28:34.409857 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.409831    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 04 18:28:34.410213 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.410189    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t8fxw\""
Aug 04 18:28:34.410929 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.410908    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 04 18:28:34.426087 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.426059    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mw7k5"]
Aug 04 18:28:34.426213 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.426104    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xzrg5"]
Aug 04 18:28:34.426213 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.426170    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xzrg5"
Aug 04 18:28:34.428319 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.428299    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 04 18:28:34.428493 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.428474    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ss77g\""
Aug 04 18:28:34.428573 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.428503    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 04 18:28:34.428676 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.428660    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 04 18:28:34.487443 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.487407    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls\") pod \"dns-default-mw7k5\" (UID: \"ac598b4f-20e2-402e-90d9-b57c4c511880\") " pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:28:34.487443 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.487449    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ac598b4f-20e2-402e-90d9-b57c4c511880-config-volume\") pod \"dns-default-mw7k5\" (UID: \"ac598b4f-20e2-402e-90d9-b57c4c511880\") " pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:28:34.487687 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.487496    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fz8k\" (UniqueName: \"kubernetes.io/projected/ac598b4f-20e2-402e-90d9-b57c4c511880-kube-api-access-7fz8k\") pod \"dns-default-mw7k5\" (UID: \"ac598b4f-20e2-402e-90d9-b57c4c511880\") " pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:28:34.487687 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.487554    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac598b4f-20e2-402e-90d9-b57c4c511880-tmp-dir\") pod \"dns-default-mw7k5\" (UID: \"ac598b4f-20e2-402e-90d9-b57c4c511880\") " pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:28:34.588805 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.588716    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac598b4f-20e2-402e-90d9-b57c4c511880-tmp-dir\") pod \"dns-default-mw7k5\" (UID: \"ac598b4f-20e2-402e-90d9-b57c4c511880\") " pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:28:34.589259 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.588878    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls\") pod \"dns-default-mw7k5\" (UID: \"ac598b4f-20e2-402e-90d9-b57c4c511880\") " pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:28:34.589259 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.588899    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ac598b4f-20e2-402e-90d9-b57c4c511880-config-volume\") pod \"dns-default-mw7k5\" (UID: \"ac598b4f-20e2-402e-90d9-b57c4c511880\") " pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:28:34.589259 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.588918    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e7ba757-2c66-4408-9bf9-4ba84e9ea85d-cert\") pod \"ingress-canary-xzrg5\" (UID: \"5e7ba757-2c66-4408-9bf9-4ba84e9ea85d\") " pod="openshift-ingress-canary/ingress-canary-xzrg5"
Aug 04 18:28:34.589259 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.588942    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fz8k\" (UniqueName: \"kubernetes.io/projected/ac598b4f-20e2-402e-90d9-b57c4c511880-kube-api-access-7fz8k\") pod \"dns-default-mw7k5\" (UID: \"ac598b4f-20e2-402e-90d9-b57c4c511880\") " pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:28:34.589259 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.588963    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnlwx\" (UniqueName: \"kubernetes.io/projected/5e7ba757-2c66-4408-9bf9-4ba84e9ea85d-kube-api-access-mnlwx\") pod \"ingress-canary-xzrg5\" (UID: \"5e7ba757-2c66-4408-9bf9-4ba84e9ea85d\") " pod="openshift-ingress-canary/ingress-canary-xzrg5"
Aug 04 18:28:34.589259 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:34.589059    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 18:28:34.589259 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.589090    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac598b4f-20e2-402e-90d9-b57c4c511880-tmp-dir\") pod \"dns-default-mw7k5\" (UID: \"ac598b4f-20e2-402e-90d9-b57c4c511880\") " pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:28:34.589259 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:34.589120    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls podName:ac598b4f-20e2-402e-90d9-b57c4c511880 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:35.08909966 +0000 UTC m=+35.623282736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls") pod "dns-default-mw7k5" (UID: "ac598b4f-20e2-402e-90d9-b57c4c511880") : secret "dns-default-metrics-tls" not found
Aug 04 18:28:34.589700 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.589397    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ac598b4f-20e2-402e-90d9-b57c4c511880-config-volume\") pod \"dns-default-mw7k5\" (UID: \"ac598b4f-20e2-402e-90d9-b57c4c511880\") " pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:28:34.602681 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.602652    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fz8k\" (UniqueName: \"kubernetes.io/projected/ac598b4f-20e2-402e-90d9-b57c4c511880-kube-api-access-7fz8k\") pod \"dns-default-mw7k5\" (UID: \"ac598b4f-20e2-402e-90d9-b57c4c511880\") " pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:28:34.689797 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.689764    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e7ba757-2c66-4408-9bf9-4ba84e9ea85d-cert\") pod \"ingress-canary-xzrg5\" (UID: \"5e7ba757-2c66-4408-9bf9-4ba84e9ea85d\") " pod="openshift-ingress-canary/ingress-canary-xzrg5"
Aug 04 18:28:34.689978 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.689820    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnlwx\" (UniqueName: \"kubernetes.io/projected/5e7ba757-2c66-4408-9bf9-4ba84e9ea85d-kube-api-access-mnlwx\") pod \"ingress-canary-xzrg5\" (UID: \"5e7ba757-2c66-4408-9bf9-4ba84e9ea85d\") " pod="openshift-ingress-canary/ingress-canary-xzrg5"
Aug 04 18:28:34.692473 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.692445    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e7ba757-2c66-4408-9bf9-4ba84e9ea85d-cert\") pod \"ingress-canary-xzrg5\" (UID: \"5e7ba757-2c66-4408-9bf9-4ba84e9ea85d\") " pod="openshift-ingress-canary/ingress-canary-xzrg5"
Aug 04 18:28:34.700368 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.700339    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnlwx\" (UniqueName: \"kubernetes.io/projected/5e7ba757-2c66-4408-9bf9-4ba84e9ea85d-kube-api-access-mnlwx\") pod \"ingress-canary-xzrg5\" (UID: \"5e7ba757-2c66-4408-9bf9-4ba84e9ea85d\") " pod="openshift-ingress-canary/ingress-canary-xzrg5"
Aug 04 18:28:34.735269 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:34.735230    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xzrg5"
Aug 04 18:28:35.093355 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:35.093179    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls\") pod \"dns-default-mw7k5\" (UID: \"ac598b4f-20e2-402e-90d9-b57c4c511880\") " pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:28:35.093528 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:35.093291    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 18:28:35.093528 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:35.093459    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls podName:ac598b4f-20e2-402e-90d9-b57c4c511880 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:36.09344304 +0000 UTC m=+36.627626106 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls") pod "dns-default-mw7k5" (UID: "ac598b4f-20e2-402e-90d9-b57c4c511880") : secret "dns-default-metrics-tls" not found
Aug 04 18:28:35.096656 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:35.096613    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xzrg5"]
Aug 04 18:28:35.220686 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:28:35.220580    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e7ba757_2c66_4408_9bf9_4ba84e9ea85d.slice/crio-f402ef26f9acfb80cb38a38e1dc0a5f64873ac16d8657c029c8799e61d00cf5e WatchSource:0}: Error finding container f402ef26f9acfb80cb38a38e1dc0a5f64873ac16d8657c029c8799e61d00cf5e: Status 404 returned error can't find the container with id f402ef26f9acfb80cb38a38e1dc0a5f64873ac16d8657c029c8799e61d00cf5e
Aug 04 18:28:35.958007 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:35.957964    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:28:35.958809 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:35.957979    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:28:35.958809 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:35.957978    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:28:35.965687 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:35.965662    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 18:28:35.965687 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:35.965681    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 18:28:35.965886 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:35.965710    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 18:28:35.966063 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:35.966044    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zw2lq\""
Aug 04 18:28:35.966178 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:35.966097    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 18:28:35.966178 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:35.966169    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bpqnp\""
Aug 04 18:28:36.101169 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:36.101133    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls\") pod \"dns-default-mw7k5\" (UID: \"ac598b4f-20e2-402e-90d9-b57c4c511880\") " pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:28:36.101367 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:36.101263    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 18:28:36.101367 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:36.101330    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls podName:ac598b4f-20e2-402e-90d9-b57c4c511880 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:38.101311856 +0000 UTC m=+38.635494935 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls") pod "dns-default-mw7k5" (UID: "ac598b4f-20e2-402e-90d9-b57c4c511880") : secret "dns-default-metrics-tls" not found
Aug 04 18:28:36.118870 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:36.118835    2558 generic.go:356] "Generic (PLEG): container finished" podID="83f378e2-4ae7-4f19-9897-9093a45fe8b6" containerID="a19c5004f97a72017c6b4e7ffa2b0f681e0d38d5cf88662d2ab2f55ab2906c46" exitCode=0
Aug 04 18:28:36.119056 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:36.118919    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-drtj5" event={"ID":"83f378e2-4ae7-4f19-9897-9093a45fe8b6","Type":"ContainerDied","Data":"a19c5004f97a72017c6b4e7ffa2b0f681e0d38d5cf88662d2ab2f55ab2906c46"}
Aug 04 18:28:36.120223 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:36.120194    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xzrg5" event={"ID":"5e7ba757-2c66-4408-9bf9-4ba84e9ea85d","Type":"ContainerStarted","Data":"f402ef26f9acfb80cb38a38e1dc0a5f64873ac16d8657c029c8799e61d00cf5e"}
Aug 04 18:28:37.125959 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:37.125922    2558 generic.go:356] "Generic (PLEG): container finished" podID="83f378e2-4ae7-4f19-9897-9093a45fe8b6" containerID="e62bfe60c1885143c5eccf6e965c87357458018897d58c1d8d7aed8d5e2a2a7f" exitCode=0
Aug 04 18:28:37.126530 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:37.125993    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-drtj5" event={"ID":"83f378e2-4ae7-4f19-9897-9093a45fe8b6","Type":"ContainerDied","Data":"e62bfe60c1885143c5eccf6e965c87357458018897d58c1d8d7aed8d5e2a2a7f"}
Aug 04 18:28:38.121271 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:38.121225    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls\") pod \"dns-default-mw7k5\" (UID: \"ac598b4f-20e2-402e-90d9-b57c4c511880\") " pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:28:38.121457 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:38.121396    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 18:28:38.121522 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:38.121476    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls podName:ac598b4f-20e2-402e-90d9-b57c4c511880 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:42.121452303 +0000 UTC m=+42.655635370 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls") pod "dns-default-mw7k5" (UID: "ac598b4f-20e2-402e-90d9-b57c4c511880") : secret "dns-default-metrics-tls" not found
Aug 04 18:28:38.132669 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:38.132607    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-drtj5" event={"ID":"83f378e2-4ae7-4f19-9897-9093a45fe8b6","Type":"ContainerStarted","Data":"936e01254ec033c6df804c2397d3cc7cb92dec78c2bcad05f61d94a870329e3d"}
Aug 04 18:28:38.157531 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:38.157472    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-drtj5" podStartSLOduration=11.527112317 podStartE2EDuration="38.157453861s" totalImagesPullingTime="26.630341544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:28:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:38.155950685 +0000 UTC m=+38.690133773" watchObservedRunningTime="2026-08-04 18:28:38.157453861 +0000 UTC m=+38.691636950"
Aug 04 18:28:39.136613 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:39.136348    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xzrg5" event={"ID":"5e7ba757-2c66-4408-9bf9-4ba84e9ea85d","Type":"ContainerStarted","Data":"9f639214cbd06d10abf380c0239cc46a7cd68fcb4a20fa5cad62b784fc32998a"}
Aug 04 18:28:39.153820 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:39.153766    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xzrg5" podStartSLOduration=1.796558791 podStartE2EDuration="5.15374227s" totalImagesPullingTime="3.357183479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:28:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:28:39.153498093 +0000 UTC m=+39.687681181" watchObservedRunningTime="2026-08-04 18:28:39.15374227 +0000 UTC m=+39.687925360"
Aug 04 18:28:42.152235 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:42.152197    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls\") pod \"dns-default-mw7k5\" (UID: \"ac598b4f-20e2-402e-90d9-b57c4c511880\") " pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:28:42.152806 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:42.152351    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 18:28:42.152806 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:42.152432    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls podName:ac598b4f-20e2-402e-90d9-b57c4c511880 nodeName:}" failed. No retries permitted until 2026-08-04 18:28:50.152414651 +0000 UTC m=+50.686597721 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls") pod "dns-default-mw7k5" (UID: "ac598b4f-20e2-402e-90d9-b57c4c511880") : secret "dns-default-metrics-tls" not found
Aug 04 18:28:50.207439 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:28:50.207396    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls\") pod \"dns-default-mw7k5\" (UID: \"ac598b4f-20e2-402e-90d9-b57c4c511880\") " pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:28:50.207925 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:50.207546    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 18:28:50.207925 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:28:50.207610    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls podName:ac598b4f-20e2-402e-90d9-b57c4c511880 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:06.207593354 +0000 UTC m=+66.741776421 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls") pod "dns-default-mw7k5" (UID: "ac598b4f-20e2-402e-90d9-b57c4c511880") : secret "dns-default-metrics-tls" not found
Aug 04 18:29:01.112818 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:01.112787    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dzrc4"
Aug 04 18:29:05.612582 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:05.612530    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret\") pod \"global-pull-secret-syncer-9jgn2\" (UID: \"587a9fe3-615e-41e1-bebf-6291030112c3\") " pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:29:05.615136 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:05.615106    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 18:29:05.626738 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:05.626717    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/587a9fe3-615e-41e1-bebf-6291030112c3-original-pull-secret\") pod \"global-pull-secret-syncer-9jgn2\" (UID: \"587a9fe3-615e-41e1-bebf-6291030112c3\") " pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:29:05.683040 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:05.683003    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jgn2"
Aug 04 18:29:05.713761 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:05.713725    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs\") pod \"network-metrics-daemon-mrvjt\" (UID: \"54490a46-3a24-4059-87c8-850cc41a7459\") " pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:29:05.713894 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:05.713784    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lmvg\" (UniqueName: \"kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg\") pod \"network-check-target-6kqrt\" (UID: \"f300cb8a-fd83-4b82-9513-5cb728617244\") " pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:29:05.716218 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:05.716199    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 18:29:05.716379 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:05.716362    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 18:29:05.724992 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:05.724969    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 04 18:29:05.725112 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:05.725036    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs podName:54490a46-3a24-4059-87c8-850cc41a7459 nodeName:}" failed. No retries permitted until 2026-08-04 18:30:09.725014882 +0000 UTC m=+130.259197948 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs") pod "network-metrics-daemon-mrvjt" (UID: "54490a46-3a24-4059-87c8-850cc41a7459") : secret "metrics-daemon-secret" not found
Aug 04 18:29:05.727348 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:05.727332    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 18:29:05.738250 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:05.738221    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lmvg\" (UniqueName: \"kubernetes.io/projected/f300cb8a-fd83-4b82-9513-5cb728617244-kube-api-access-8lmvg\") pod \"network-check-target-6kqrt\" (UID: \"f300cb8a-fd83-4b82-9513-5cb728617244\") " pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:29:05.804312 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:05.804282    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9jgn2"]
Aug 04 18:29:05.808912 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:29:05.808881    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod587a9fe3_615e_41e1_bebf_6291030112c3.slice/crio-f90b9ab7fcd2b136c8a648bbb81e4d37afc0529e66f7ea418b62958234f312b4 WatchSource:0}: Error finding container f90b9ab7fcd2b136c8a648bbb81e4d37afc0529e66f7ea418b62958234f312b4: Status 404 returned error can't find the container with id f90b9ab7fcd2b136c8a648bbb81e4d37afc0529e66f7ea418b62958234f312b4
Aug 04 18:29:05.973361 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:05.973329    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bpqnp\""
Aug 04 18:29:05.981304 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:05.981284    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:29:06.102590 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:06.102557    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6kqrt"]
Aug 04 18:29:06.105248 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:29:06.105211    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf300cb8a_fd83_4b82_9513_5cb728617244.slice/crio-1959bb7f77fb427a94ee77bb05a139e778386c8bdc226196215f61df686a707f WatchSource:0}: Error finding container 1959bb7f77fb427a94ee77bb05a139e778386c8bdc226196215f61df686a707f: Status 404 returned error can't find the container with id 1959bb7f77fb427a94ee77bb05a139e778386c8bdc226196215f61df686a707f
Aug 04 18:29:06.196646 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:06.196592    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6kqrt" event={"ID":"f300cb8a-fd83-4b82-9513-5cb728617244","Type":"ContainerStarted","Data":"1959bb7f77fb427a94ee77bb05a139e778386c8bdc226196215f61df686a707f"}
Aug 04 18:29:06.197612 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:06.197592    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9jgn2" event={"ID":"587a9fe3-615e-41e1-bebf-6291030112c3","Type":"ContainerStarted","Data":"f90b9ab7fcd2b136c8a648bbb81e4d37afc0529e66f7ea418b62958234f312b4"}
Aug 04 18:29:06.222129 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:06.222104    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls\") pod \"dns-default-mw7k5\" (UID: \"ac598b4f-20e2-402e-90d9-b57c4c511880\") " pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:29:06.222232 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:06.222220    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 18:29:06.222281 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:06.222273    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls podName:ac598b4f-20e2-402e-90d9-b57c4c511880 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:38.222253711 +0000 UTC m=+98.756436777 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls") pod "dns-default-mw7k5" (UID: "ac598b4f-20e2-402e-90d9-b57c4c511880") : secret "dns-default-metrics-tls" not found
Aug 04 18:29:10.273226 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.273169    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7cd44fddd-7k9f2"]
Aug 04 18:29:10.287768 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.287738    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-48gmb"]
Aug 04 18:29:10.287925 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.287877    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:10.290622 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.290595    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 04 18:29:10.290775 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.290672    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Aug 04 18:29:10.290775 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.290692    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xjrh2\""
Aug 04 18:29:10.291255 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.290953    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Aug 04 18:29:10.291255 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.291007    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 04 18:29:10.291255 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.291162    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Aug 04 18:29:10.291255 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.291169    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Aug 04 18:29:10.301805 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.301783    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-5d4wq"]
Aug 04 18:29:10.301922 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.301898    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-48gmb"
Aug 04 18:29:10.303801 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.303780    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Aug 04 18:29:10.305977 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.304200    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 04 18:29:10.305977 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.304473    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 04 18:29:10.305977 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.305082    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4b248\""
Aug 04 18:29:10.305977 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.305797    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Aug 04 18:29:10.311476 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.311456    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-48gmb"]
Aug 04 18:29:10.312108 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.311488    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7cd44fddd-7k9f2"]
Aug 04 18:29:10.312108 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.311503    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-5d4wq"]
Aug 04 18:29:10.312108 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.311587    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-5d4wq"
Aug 04 18:29:10.314115 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.314095    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xlx9c\""
Aug 04 18:29:10.314206 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.314099    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Aug 04 18:29:10.314269 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.314255    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Aug 04 18:29:10.356520 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.356489    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-default-certificate\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:10.356664 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.356562    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0319a4e0-2f16-49bb-863b-c563db4af7f4-service-ca-bundle\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:10.356664 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.356617    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-stats-auth\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:10.356773 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.356665    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-metrics-certs\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:10.356773 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.356693    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwt4x\" (UniqueName: \"kubernetes.io/projected/48a0eece-a584-4a2e-83d5-ea0a82b42f85-kube-api-access-lwt4x\") pod \"volume-data-source-validator-5b8776669-5d4wq\" (UID: \"48a0eece-a584-4a2e-83d5-ea0a82b42f85\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-5d4wq"
Aug 04 18:29:10.356773 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.356709    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dbe35e11-686b-4b4d-8211-ab29d33e0de3-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-48gmb\" (UID: \"dbe35e11-686b-4b4d-8211-ab29d33e0de3\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-48gmb"
Aug 04 18:29:10.356773 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.356743    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d54nv\" (UniqueName: \"kubernetes.io/projected/dbe35e11-686b-4b4d-8211-ab29d33e0de3-kube-api-access-d54nv\") pod \"cluster-monitoring-operator-6f55c4f58d-48gmb\" (UID: \"dbe35e11-686b-4b4d-8211-ab29d33e0de3\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-48gmb"
Aug 04 18:29:10.356773 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.356763    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr4kf\" (UniqueName: \"kubernetes.io/projected/0319a4e0-2f16-49bb-863b-c563db4af7f4-kube-api-access-sr4kf\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:10.356960 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.356785    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbe35e11-686b-4b4d-8211-ab29d33e0de3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-48gmb\" (UID: \"dbe35e11-686b-4b4d-8211-ab29d33e0de3\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-48gmb"
Aug 04 18:29:10.374948 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.374922    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-x6hzq"]
Aug 04 18:29:10.395225 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.395204    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-x6hzq"
Aug 04 18:29:10.397525 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.397502    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-x6hzq"]
Aug 04 18:29:10.398716 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.398693    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Aug 04 18:29:10.398825 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.398806    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-f68pw\""
Aug 04 18:29:10.399959 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.399940    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Aug 04 18:29:10.400050 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.399940    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Aug 04 18:29:10.400396 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.400376    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Aug 04 18:29:10.458071 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.458034    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0319a4e0-2f16-49bb-863b-c563db4af7f4-service-ca-bundle\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:10.458259 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.458082    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-stats-auth\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:10.458259 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.458122    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-metrics-certs\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:10.458259 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.458163    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwt4x\" (UniqueName: \"kubernetes.io/projected/48a0eece-a584-4a2e-83d5-ea0a82b42f85-kube-api-access-lwt4x\") pod \"volume-data-source-validator-5b8776669-5d4wq\" (UID: \"48a0eece-a584-4a2e-83d5-ea0a82b42f85\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-5d4wq"
Aug 04 18:29:10.458259 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:10.458199    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0319a4e0-2f16-49bb-863b-c563db4af7f4-service-ca-bundle podName:0319a4e0-2f16-49bb-863b-c563db4af7f4 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:10.958176499 +0000 UTC m=+71.492359584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0319a4e0-2f16-49bb-863b-c563db4af7f4-service-ca-bundle") pod "router-default-7cd44fddd-7k9f2" (UID: "0319a4e0-2f16-49bb-863b-c563db4af7f4") : configmap references non-existent config key: service-ca.crt
Aug 04 18:29:10.458259 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.458231    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dbe35e11-686b-4b4d-8211-ab29d33e0de3-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-48gmb\" (UID: \"dbe35e11-686b-4b4d-8211-ab29d33e0de3\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-48gmb"
Aug 04 18:29:10.458259 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:10.458251    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 04 18:29:10.458534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.458280    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d54nv\" (UniqueName: \"kubernetes.io/projected/dbe35e11-686b-4b4d-8211-ab29d33e0de3-kube-api-access-d54nv\") pod \"cluster-monitoring-operator-6f55c4f58d-48gmb\" (UID: \"dbe35e11-686b-4b4d-8211-ab29d33e0de3\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-48gmb"
Aug 04 18:29:10.458534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.458306    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de65c70b-694d-43ab-a65a-59056697a7b9-config\") pod \"service-ca-operator-784f97bcf6-x6hzq\" (UID: \"de65c70b-694d-43ab-a65a-59056697a7b9\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-x6hzq"
Aug 04 18:29:10.458534 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:10.458315    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-metrics-certs podName:0319a4e0-2f16-49bb-863b-c563db4af7f4 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:10.958299454 +0000 UTC m=+71.492482538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-metrics-certs") pod "router-default-7cd44fddd-7k9f2" (UID: "0319a4e0-2f16-49bb-863b-c563db4af7f4") : secret "router-metrics-certs-default" not found
Aug 04 18:29:10.458534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.458350    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8lc7\" (UniqueName: \"kubernetes.io/projected/de65c70b-694d-43ab-a65a-59056697a7b9-kube-api-access-q8lc7\") pod \"service-ca-operator-784f97bcf6-x6hzq\" (UID: \"de65c70b-694d-43ab-a65a-59056697a7b9\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-x6hzq"
Aug 04 18:29:10.458534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.458403    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr4kf\" (UniqueName: \"kubernetes.io/projected/0319a4e0-2f16-49bb-863b-c563db4af7f4-kube-api-access-sr4kf\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:10.458534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.458428    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbe35e11-686b-4b4d-8211-ab29d33e0de3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-48gmb\" (UID: \"dbe35e11-686b-4b4d-8211-ab29d33e0de3\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-48gmb"
Aug 04 18:29:10.458534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.458451    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de65c70b-694d-43ab-a65a-59056697a7b9-serving-cert\") pod \"service-ca-operator-784f97bcf6-x6hzq\" (UID: \"de65c70b-694d-43ab-a65a-59056697a7b9\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-x6hzq"
Aug 04 18:29:10.458534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.458497    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-default-certificate\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:10.458940 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:10.458618    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 18:29:10.458940 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:10.458682    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbe35e11-686b-4b4d-8211-ab29d33e0de3-cluster-monitoring-operator-tls podName:dbe35e11-686b-4b4d-8211-ab29d33e0de3 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:10.958667026 +0000 UTC m=+71.492850108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dbe35e11-686b-4b4d-8211-ab29d33e0de3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-48gmb" (UID: "dbe35e11-686b-4b4d-8211-ab29d33e0de3") : secret "cluster-monitoring-operator-tls" not found
Aug 04 18:29:10.459044 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.459030    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dbe35e11-686b-4b4d-8211-ab29d33e0de3-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-48gmb\" (UID: \"dbe35e11-686b-4b4d-8211-ab29d33e0de3\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-48gmb"
Aug 04 18:29:10.461137 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.461112    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-default-certificate\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:10.461395 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.461377    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-stats-auth\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:10.470752 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.470720    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr4kf\" (UniqueName: \"kubernetes.io/projected/0319a4e0-2f16-49bb-863b-c563db4af7f4-kube-api-access-sr4kf\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:10.471080 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.471053    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwt4x\" (UniqueName: \"kubernetes.io/projected/48a0eece-a584-4a2e-83d5-ea0a82b42f85-kube-api-access-lwt4x\") pod \"volume-data-source-validator-5b8776669-5d4wq\" (UID: \"48a0eece-a584-4a2e-83d5-ea0a82b42f85\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-5d4wq"
Aug 04 18:29:10.472613 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.472586    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d54nv\" (UniqueName: \"kubernetes.io/projected/dbe35e11-686b-4b4d-8211-ab29d33e0de3-kube-api-access-d54nv\") pod \"cluster-monitoring-operator-6f55c4f58d-48gmb\" (UID: \"dbe35e11-686b-4b4d-8211-ab29d33e0de3\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-48gmb"
Aug 04 18:29:10.559334 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.559255    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de65c70b-694d-43ab-a65a-59056697a7b9-config\") pod \"service-ca-operator-784f97bcf6-x6hzq\" (UID: \"de65c70b-694d-43ab-a65a-59056697a7b9\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-x6hzq"
Aug 04 18:29:10.559334 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.559296    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8lc7\" (UniqueName: \"kubernetes.io/projected/de65c70b-694d-43ab-a65a-59056697a7b9-kube-api-access-q8lc7\") pod \"service-ca-operator-784f97bcf6-x6hzq\" (UID: \"de65c70b-694d-43ab-a65a-59056697a7b9\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-x6hzq"
Aug 04 18:29:10.559334 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.559335    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de65c70b-694d-43ab-a65a-59056697a7b9-serving-cert\") pod \"service-ca-operator-784f97bcf6-x6hzq\" (UID: \"de65c70b-694d-43ab-a65a-59056697a7b9\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-x6hzq"
Aug 04 18:29:10.559904 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.559876    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de65c70b-694d-43ab-a65a-59056697a7b9-config\") pod \"service-ca-operator-784f97bcf6-x6hzq\" (UID: \"de65c70b-694d-43ab-a65a-59056697a7b9\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-x6hzq"
Aug 04 18:29:10.562306 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.562285    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de65c70b-694d-43ab-a65a-59056697a7b9-serving-cert\") pod \"service-ca-operator-784f97bcf6-x6hzq\" (UID: \"de65c70b-694d-43ab-a65a-59056697a7b9\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-x6hzq"
Aug 04 18:29:10.568555 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.568521    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8lc7\" (UniqueName: \"kubernetes.io/projected/de65c70b-694d-43ab-a65a-59056697a7b9-kube-api-access-q8lc7\") pod \"service-ca-operator-784f97bcf6-x6hzq\" (UID: \"de65c70b-694d-43ab-a65a-59056697a7b9\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-x6hzq"
Aug 04 18:29:10.621592 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.621557    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-5d4wq"
Aug 04 18:29:10.706851 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.706815    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-x6hzq"
Aug 04 18:29:10.962079 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.962050    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0319a4e0-2f16-49bb-863b-c563db4af7f4-service-ca-bundle\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:10.962079 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.962082    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-metrics-certs\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:10.962300 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:10.962119    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbe35e11-686b-4b4d-8211-ab29d33e0de3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-48gmb\" (UID: \"dbe35e11-686b-4b4d-8211-ab29d33e0de3\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-48gmb"
Aug 04 18:29:10.962300 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:10.962211    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 18:29:10.962300 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:10.962222    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0319a4e0-2f16-49bb-863b-c563db4af7f4-service-ca-bundle podName:0319a4e0-2f16-49bb-863b-c563db4af7f4 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:11.962205842 +0000 UTC m=+72.496388908 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0319a4e0-2f16-49bb-863b-c563db4af7f4-service-ca-bundle") pod "router-default-7cd44fddd-7k9f2" (UID: "0319a4e0-2f16-49bb-863b-c563db4af7f4") : configmap references non-existent config key: service-ca.crt
Aug 04 18:29:10.962300 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:10.962255    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbe35e11-686b-4b4d-8211-ab29d33e0de3-cluster-monitoring-operator-tls podName:dbe35e11-686b-4b4d-8211-ab29d33e0de3 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:11.962243896 +0000 UTC m=+72.496426962 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dbe35e11-686b-4b4d-8211-ab29d33e0de3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-48gmb" (UID: "dbe35e11-686b-4b4d-8211-ab29d33e0de3") : secret "cluster-monitoring-operator-tls" not found
Aug 04 18:29:10.962300 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:10.962211    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 04 18:29:10.962300 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:10.962287    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-metrics-certs podName:0319a4e0-2f16-49bb-863b-c563db4af7f4 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:11.962271379 +0000 UTC m=+72.496454520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-metrics-certs") pod "router-default-7cd44fddd-7k9f2" (UID: "0319a4e0-2f16-49bb-863b-c563db4af7f4") : secret "router-metrics-certs-default" not found
Aug 04 18:29:11.281605 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:11.281580    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-x6hzq"]
Aug 04 18:29:11.285479 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:29:11.285454    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde65c70b_694d_43ab_a65a_59056697a7b9.slice/crio-f1490f0f6f4215010a508701a1fed1bec313172573c0a17e720eeadd7f76bb5d WatchSource:0}: Error finding container f1490f0f6f4215010a508701a1fed1bec313172573c0a17e720eeadd7f76bb5d: Status 404 returned error can't find the container with id f1490f0f6f4215010a508701a1fed1bec313172573c0a17e720eeadd7f76bb5d
Aug 04 18:29:11.295899 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:11.295859    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-5d4wq"]
Aug 04 18:29:11.298727 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:29:11.298699    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a0eece_a584_4a2e_83d5_ea0a82b42f85.slice/crio-185986fcd49901b69a5646f227c3d538d91d0ccd29b9f0aa856e3ebc4868ab42 WatchSource:0}: Error finding container 185986fcd49901b69a5646f227c3d538d91d0ccd29b9f0aa856e3ebc4868ab42: Status 404 returned error can't find the container with id 185986fcd49901b69a5646f227c3d538d91d0ccd29b9f0aa856e3ebc4868ab42
Aug 04 18:29:11.970415 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:11.970379    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbe35e11-686b-4b4d-8211-ab29d33e0de3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-48gmb\" (UID: \"dbe35e11-686b-4b4d-8211-ab29d33e0de3\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-48gmb"
Aug 04 18:29:11.970714 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:11.970545    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 18:29:11.970714 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:11.970566    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0319a4e0-2f16-49bb-863b-c563db4af7f4-service-ca-bundle\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:11.970714 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:11.970611    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbe35e11-686b-4b4d-8211-ab29d33e0de3-cluster-monitoring-operator-tls podName:dbe35e11-686b-4b4d-8211-ab29d33e0de3 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:13.970591561 +0000 UTC m=+74.504774643 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dbe35e11-686b-4b4d-8211-ab29d33e0de3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-48gmb" (UID: "dbe35e11-686b-4b4d-8211-ab29d33e0de3") : secret "cluster-monitoring-operator-tls" not found
Aug 04 18:29:11.970714 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:11.970648    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-metrics-certs\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:11.970714 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:11.970684    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0319a4e0-2f16-49bb-863b-c563db4af7f4-service-ca-bundle podName:0319a4e0-2f16-49bb-863b-c563db4af7f4 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:13.970673562 +0000 UTC m=+74.504856636 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0319a4e0-2f16-49bb-863b-c563db4af7f4-service-ca-bundle") pod "router-default-7cd44fddd-7k9f2" (UID: "0319a4e0-2f16-49bb-863b-c563db4af7f4") : configmap references non-existent config key: service-ca.crt
Aug 04 18:29:11.970916 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:11.970727    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 04 18:29:11.970916 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:11.970769    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-metrics-certs podName:0319a4e0-2f16-49bb-863b-c563db4af7f4 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:13.970756699 +0000 UTC m=+74.504939771 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-metrics-certs") pod "router-default-7cd44fddd-7k9f2" (UID: "0319a4e0-2f16-49bb-863b-c563db4af7f4") : secret "router-metrics-certs-default" not found
Aug 04 18:29:12.216785 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:12.216751    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-x6hzq" event={"ID":"de65c70b-694d-43ab-a65a-59056697a7b9","Type":"ContainerStarted","Data":"f1490f0f6f4215010a508701a1fed1bec313172573c0a17e720eeadd7f76bb5d"}
Aug 04 18:29:12.218419 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:12.218274    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9jgn2" event={"ID":"587a9fe3-615e-41e1-bebf-6291030112c3","Type":"ContainerStarted","Data":"1c39f5c55544cb5d1ec6ed3745bb9dd13edfbde833d73f109cd517d9253d5d69"}
Aug 04 18:29:12.219532 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:12.219493    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-5d4wq" event={"ID":"48a0eece-a584-4a2e-83d5-ea0a82b42f85","Type":"ContainerStarted","Data":"185986fcd49901b69a5646f227c3d538d91d0ccd29b9f0aa856e3ebc4868ab42"}
Aug 04 18:29:12.221037 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:12.220973    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6kqrt" event={"ID":"f300cb8a-fd83-4b82-9513-5cb728617244","Type":"ContainerStarted","Data":"978a5b7b305437c99ad898083786d17f0bb4d37895dbc8ff9748dda24006f5eb"}
Aug 04 18:29:12.221115 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:12.221088    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:29:12.234993 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:12.234905    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9jgn2" podStartSLOduration=66.906860891 podStartE2EDuration="1m12.234891902s" totalImagesPullingTime="5.328031011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:12.233998298 +0000 UTC m=+72.768181385" watchObservedRunningTime="2026-08-04 18:29:12.234891902 +0000 UTC m=+72.769074992"
Aug 04 18:29:12.248425 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:12.248331    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6kqrt" podStartSLOduration=67.208953521 podStartE2EDuration="1m12.248315041s" totalImagesPullingTime="5.03936152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:12.247798813 +0000 UTC m=+72.781981902" watchObservedRunningTime="2026-08-04 18:29:12.248315041 +0000 UTC m=+72.782498128"
Aug 04 18:29:13.225587 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:13.225552    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-5d4wq" event={"ID":"48a0eece-a584-4a2e-83d5-ea0a82b42f85","Type":"ContainerStarted","Data":"d384902faeee6e33c025d57d0e3e23aefd438b97bf4b58baf02a07e08bb755c9"}
Aug 04 18:29:13.241290 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:13.241236    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-5d4wq" podStartSLOduration=2.051966549 podStartE2EDuration="3.241217151s" totalImagesPullingTime="1.189250602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:13.240918971 +0000 UTC m=+73.775102058" watchObservedRunningTime="2026-08-04 18:29:13.241217151 +0000 UTC m=+73.775400241"
Aug 04 18:29:13.986374 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:13.986334    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbe35e11-686b-4b4d-8211-ab29d33e0de3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-48gmb\" (UID: \"dbe35e11-686b-4b4d-8211-ab29d33e0de3\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-48gmb"
Aug 04 18:29:13.986536 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:13.986416    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0319a4e0-2f16-49bb-863b-c563db4af7f4-service-ca-bundle\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:13.986536 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:13.986445    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-metrics-certs\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:13.986536 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:13.986482    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 18:29:13.986659 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:13.986544    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 04 18:29:13.986659 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:13.986547    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbe35e11-686b-4b4d-8211-ab29d33e0de3-cluster-monitoring-operator-tls podName:dbe35e11-686b-4b4d-8211-ab29d33e0de3 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:17.986527461 +0000 UTC m=+78.520710541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dbe35e11-686b-4b4d-8211-ab29d33e0de3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-48gmb" (UID: "dbe35e11-686b-4b4d-8211-ab29d33e0de3") : secret "cluster-monitoring-operator-tls" not found
Aug 04 18:29:13.986659 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:13.986600    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0319a4e0-2f16-49bb-863b-c563db4af7f4-service-ca-bundle podName:0319a4e0-2f16-49bb-863b-c563db4af7f4 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:17.986589523 +0000 UTC m=+78.520772590 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0319a4e0-2f16-49bb-863b-c563db4af7f4-service-ca-bundle") pod "router-default-7cd44fddd-7k9f2" (UID: "0319a4e0-2f16-49bb-863b-c563db4af7f4") : configmap references non-existent config key: service-ca.crt
Aug 04 18:29:13.986659 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:13.986615    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-metrics-certs podName:0319a4e0-2f16-49bb-863b-c563db4af7f4 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:17.986606294 +0000 UTC m=+78.520789365 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-metrics-certs") pod "router-default-7cd44fddd-7k9f2" (UID: "0319a4e0-2f16-49bb-863b-c563db4af7f4") : secret "router-metrics-certs-default" not found
Aug 04 18:29:14.229870 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:14.229836    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-x6hzq" event={"ID":"de65c70b-694d-43ab-a65a-59056697a7b9","Type":"ContainerStarted","Data":"708fed1be6ae642a707074ad5d651ebcd827076ec2fc7e0890c713d35e664852"}
Aug 04 18:29:14.246790 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:14.246696    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-x6hzq" podStartSLOduration=2.010717682 podStartE2EDuration="4.246681259s" totalImagesPullingTime="2.235963577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:14.245297836 +0000 UTC m=+74.779480924" watchObservedRunningTime="2026-08-04 18:29:14.246681259 +0000 UTC m=+74.780864347"
Aug 04 18:29:15.485296 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:15.485263    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-kvgmn"]
Aug 04 18:29:15.487150 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:15.487135    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kvgmn"
Aug 04 18:29:15.489961 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:15.489940    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Aug 04 18:29:15.490507 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:15.490488    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Aug 04 18:29:15.491827 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:15.491812    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pwcl6\""
Aug 04 18:29:15.500815 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:15.500797    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-kvgmn"]
Aug 04 18:29:15.598197 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:15.598168    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmwjw\" (UniqueName: \"kubernetes.io/projected/68eccac8-1e33-4075-96d7-820bb0ab0484-kube-api-access-kmwjw\") pod \"migrator-68bc745d87-kvgmn\" (UID: \"68eccac8-1e33-4075-96d7-820bb0ab0484\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kvgmn"
Aug 04 18:29:15.699518 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:15.699486    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmwjw\" (UniqueName: \"kubernetes.io/projected/68eccac8-1e33-4075-96d7-820bb0ab0484-kube-api-access-kmwjw\") pod \"migrator-68bc745d87-kvgmn\" (UID: \"68eccac8-1e33-4075-96d7-820bb0ab0484\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kvgmn"
Aug 04 18:29:15.707342 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:15.707315    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmwjw\" (UniqueName: \"kubernetes.io/projected/68eccac8-1e33-4075-96d7-820bb0ab0484-kube-api-access-kmwjw\") pod \"migrator-68bc745d87-kvgmn\" (UID: \"68eccac8-1e33-4075-96d7-820bb0ab0484\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kvgmn"
Aug 04 18:29:15.795671 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:15.795600    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kvgmn"
Aug 04 18:29:15.917677 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:15.917650    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-kvgmn"]
Aug 04 18:29:15.920764 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:29:15.920738    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68eccac8_1e33_4075_96d7_820bb0ab0484.slice/crio-0599c40c5ba1863ae9fee760b14c5918c138843ea695394c09e57f80f62c9699 WatchSource:0}: Error finding container 0599c40c5ba1863ae9fee760b14c5918c138843ea695394c09e57f80f62c9699: Status 404 returned error can't find the container with id 0599c40c5ba1863ae9fee760b14c5918c138843ea695394c09e57f80f62c9699
Aug 04 18:29:16.004020 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.003990    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gdx9z"]
Aug 04 18:29:16.006394 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.006370    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:16.008819 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.008797    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 04 18:29:16.008921 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.008886    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 04 18:29:16.008921 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.008902    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hcmth\""
Aug 04 18:29:16.009472 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.009458    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 04 18:29:16.009549 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.009463    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 04 18:29:16.023233 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.023213    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gdx9z"]
Aug 04 18:29:16.103740 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.103677    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26d48b41-f890-442b-8ac3-63e065232cf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:16.103740 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.103716    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/26d48b41-f890-442b-8ac3-63e065232cf3-crio-socket\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:16.103883 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.103743    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvrkn\" (UniqueName: \"kubernetes.io/projected/26d48b41-f890-442b-8ac3-63e065232cf3-kube-api-access-kvrkn\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:16.103883 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.103809    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/26d48b41-f890-442b-8ac3-63e065232cf3-data-volume\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:16.103883 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.103855    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26d48b41-f890-442b-8ac3-63e065232cf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:16.204144 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.204114    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26d48b41-f890-442b-8ac3-63e065232cf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:16.204267 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.204158    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/26d48b41-f890-442b-8ac3-63e065232cf3-crio-socket\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:16.204267 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.204231    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/26d48b41-f890-442b-8ac3-63e065232cf3-crio-socket\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:16.204267 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:16.204253    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 18:29:16.204381 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.204282    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvrkn\" (UniqueName: \"kubernetes.io/projected/26d48b41-f890-442b-8ac3-63e065232cf3-kube-api-access-kvrkn\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:16.204381 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.204312    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/26d48b41-f890-442b-8ac3-63e065232cf3-data-volume\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:16.204381 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:16.204350    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26d48b41-f890-442b-8ac3-63e065232cf3-insights-runtime-extractor-tls podName:26d48b41-f890-442b-8ac3-63e065232cf3 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:16.704336359 +0000 UTC m=+77.238519429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/26d48b41-f890-442b-8ac3-63e065232cf3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gdx9z" (UID: "26d48b41-f890-442b-8ac3-63e065232cf3") : secret "insights-runtime-extractor-tls" not found
Aug 04 18:29:16.204381 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.204375    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26d48b41-f890-442b-8ac3-63e065232cf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:16.204557 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:16.204443    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 18:29:16.204557 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:16.204471    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26d48b41-f890-442b-8ac3-63e065232cf3-kube-rbac-proxy-cm podName:26d48b41-f890-442b-8ac3-63e065232cf3 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:16.704464003 +0000 UTC m=+77.238647069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/26d48b41-f890-442b-8ac3-63e065232cf3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gdx9z" (UID: "26d48b41-f890-442b-8ac3-63e065232cf3") : configmap "kube-rbac-proxy" not found
Aug 04 18:29:16.204676 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.204585    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/26d48b41-f890-442b-8ac3-63e065232cf3-data-volume\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:16.215448 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.215428    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvrkn\" (UniqueName: \"kubernetes.io/projected/26d48b41-f890-442b-8ac3-63e065232cf3-kube-api-access-kvrkn\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:16.236531 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.236504    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kvgmn" event={"ID":"68eccac8-1e33-4075-96d7-820bb0ab0484","Type":"ContainerStarted","Data":"0599c40c5ba1863ae9fee760b14c5918c138843ea695394c09e57f80f62c9699"}
Aug 04 18:29:16.709417 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.709379    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26d48b41-f890-442b-8ac3-63e065232cf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:16.709848 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:16.709523    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26d48b41-f890-442b-8ac3-63e065232cf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:16.709848 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:16.709562    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 18:29:16.709848 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:16.709623    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 18:29:16.709848 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:16.709668    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26d48b41-f890-442b-8ac3-63e065232cf3-insights-runtime-extractor-tls podName:26d48b41-f890-442b-8ac3-63e065232cf3 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:17.709622498 +0000 UTC m=+78.243805586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/26d48b41-f890-442b-8ac3-63e065232cf3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gdx9z" (UID: "26d48b41-f890-442b-8ac3-63e065232cf3") : secret "insights-runtime-extractor-tls" not found
Aug 04 18:29:16.709848 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:16.709691    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26d48b41-f890-442b-8ac3-63e065232cf3-kube-rbac-proxy-cm podName:26d48b41-f890-442b-8ac3-63e065232cf3 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:17.709680322 +0000 UTC m=+78.243863389 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/26d48b41-f890-442b-8ac3-63e065232cf3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gdx9z" (UID: "26d48b41-f890-442b-8ac3-63e065232cf3") : configmap "kube-rbac-proxy" not found
Aug 04 18:29:17.554460 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:17.554343    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-tn29d"]
Aug 04 18:29:17.557357 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:17.557331    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-tn29d"
Aug 04 18:29:17.559601 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:17.559582    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Aug 04 18:29:17.560206 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:17.560190    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Aug 04 18:29:17.560305 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:17.560286    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Aug 04 18:29:17.560358 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:17.560294    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xsxqc\""
Aug 04 18:29:17.560358 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:17.560307    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Aug 04 18:29:17.564136 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:17.564107    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-tn29d"]
Aug 04 18:29:17.617455 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:17.617425    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/20467b44-db71-4065-9ec7-1fc733d80a96-signing-key\") pod \"service-ca-98c88fbb5-tn29d\" (UID: \"20467b44-db71-4065-9ec7-1fc733d80a96\") " pod="openshift-service-ca/service-ca-98c88fbb5-tn29d"
Aug 04 18:29:17.617589 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:17.617547    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/20467b44-db71-4065-9ec7-1fc733d80a96-signing-cabundle\") pod \"service-ca-98c88fbb5-tn29d\" (UID: \"20467b44-db71-4065-9ec7-1fc733d80a96\") " pod="openshift-service-ca/service-ca-98c88fbb5-tn29d"
Aug 04 18:29:17.617589 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:17.617575    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fclxx\" (UniqueName: \"kubernetes.io/projected/20467b44-db71-4065-9ec7-1fc733d80a96-kube-api-access-fclxx\") pod \"service-ca-98c88fbb5-tn29d\" (UID: \"20467b44-db71-4065-9ec7-1fc733d80a96\") " pod="openshift-service-ca/service-ca-98c88fbb5-tn29d"
Aug 04 18:29:17.717949 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:17.717916    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/20467b44-db71-4065-9ec7-1fc733d80a96-signing-cabundle\") pod \"service-ca-98c88fbb5-tn29d\" (UID: \"20467b44-db71-4065-9ec7-1fc733d80a96\") " pod="openshift-service-ca/service-ca-98c88fbb5-tn29d"
Aug 04 18:29:17.717949 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:17.717951    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fclxx\" (UniqueName: \"kubernetes.io/projected/20467b44-db71-4065-9ec7-1fc733d80a96-kube-api-access-fclxx\") pod \"service-ca-98c88fbb5-tn29d\" (UID: \"20467b44-db71-4065-9ec7-1fc733d80a96\") " pod="openshift-service-ca/service-ca-98c88fbb5-tn29d"
Aug 04 18:29:17.718436 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:17.718011    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26d48b41-f890-442b-8ac3-63e065232cf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:17.718436 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:17.718036    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/20467b44-db71-4065-9ec7-1fc733d80a96-signing-key\") pod \"service-ca-98c88fbb5-tn29d\" (UID: \"20467b44-db71-4065-9ec7-1fc733d80a96\") " pod="openshift-service-ca/service-ca-98c88fbb5-tn29d"
Aug 04 18:29:17.718436 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:17.718100    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26d48b41-f890-442b-8ac3-63e065232cf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:17.718436 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:17.718177    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 18:29:17.718436 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:17.718227    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 18:29:17.718436 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:17.718260    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26d48b41-f890-442b-8ac3-63e065232cf3-kube-rbac-proxy-cm podName:26d48b41-f890-442b-8ac3-63e065232cf3 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:19.718237945 +0000 UTC m=+80.252421012 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/26d48b41-f890-442b-8ac3-63e065232cf3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gdx9z" (UID: "26d48b41-f890-442b-8ac3-63e065232cf3") : configmap "kube-rbac-proxy" not found
Aug 04 18:29:17.718436 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:17.718280    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26d48b41-f890-442b-8ac3-63e065232cf3-insights-runtime-extractor-tls podName:26d48b41-f890-442b-8ac3-63e065232cf3 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:19.718270739 +0000 UTC m=+80.252453811 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/26d48b41-f890-442b-8ac3-63e065232cf3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gdx9z" (UID: "26d48b41-f890-442b-8ac3-63e065232cf3") : secret "insights-runtime-extractor-tls" not found
Aug 04 18:29:17.718756 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:17.718737    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/20467b44-db71-4065-9ec7-1fc733d80a96-signing-cabundle\") pod \"service-ca-98c88fbb5-tn29d\" (UID: \"20467b44-db71-4065-9ec7-1fc733d80a96\") " pod="openshift-service-ca/service-ca-98c88fbb5-tn29d"
Aug 04 18:29:17.720372 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:17.720351    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/20467b44-db71-4065-9ec7-1fc733d80a96-signing-key\") pod \"service-ca-98c88fbb5-tn29d\" (UID: \"20467b44-db71-4065-9ec7-1fc733d80a96\") " pod="openshift-service-ca/service-ca-98c88fbb5-tn29d"
Aug 04 18:29:17.727065 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:17.727045    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fclxx\" (UniqueName: \"kubernetes.io/projected/20467b44-db71-4065-9ec7-1fc733d80a96-kube-api-access-fclxx\") pod \"service-ca-98c88fbb5-tn29d\" (UID: \"20467b44-db71-4065-9ec7-1fc733d80a96\") " pod="openshift-service-ca/service-ca-98c88fbb5-tn29d"
Aug 04 18:29:17.866066 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:17.865981    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-tn29d"
Aug 04 18:29:17.985243 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:17.985216    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-tn29d"]
Aug 04 18:29:17.988776 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:29:17.988752    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20467b44_db71_4065_9ec7_1fc733d80a96.slice/crio-279328e6a175e6c874a901d9c79b94828b188f48af43e8250cb6b727c1ed46bb WatchSource:0}: Error finding container 279328e6a175e6c874a901d9c79b94828b188f48af43e8250cb6b727c1ed46bb: Status 404 returned error can't find the container with id 279328e6a175e6c874a901d9c79b94828b188f48af43e8250cb6b727c1ed46bb
Aug 04 18:29:18.021221 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:18.021184    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0319a4e0-2f16-49bb-863b-c563db4af7f4-service-ca-bundle\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:18.021347 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:18.021243    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbe35e11-686b-4b4d-8211-ab29d33e0de3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-48gmb\" (UID: \"dbe35e11-686b-4b4d-8211-ab29d33e0de3\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-48gmb"
Aug 04 18:29:18.021347 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:18.021278    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-metrics-certs\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:18.021450 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:18.021369    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 04 18:29:18.021450 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:18.021386    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 18:29:18.021450 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:18.021370    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0319a4e0-2f16-49bb-863b-c563db4af7f4-service-ca-bundle podName:0319a4e0-2f16-49bb-863b-c563db4af7f4 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:26.021348496 +0000 UTC m=+86.555531570 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0319a4e0-2f16-49bb-863b-c563db4af7f4-service-ca-bundle") pod "router-default-7cd44fddd-7k9f2" (UID: "0319a4e0-2f16-49bb-863b-c563db4af7f4") : configmap references non-existent config key: service-ca.crt
Aug 04 18:29:18.021450 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:18.021414    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-metrics-certs podName:0319a4e0-2f16-49bb-863b-c563db4af7f4 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:26.021402834 +0000 UTC m=+86.555585901 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-metrics-certs") pod "router-default-7cd44fddd-7k9f2" (UID: "0319a4e0-2f16-49bb-863b-c563db4af7f4") : secret "router-metrics-certs-default" not found
Aug 04 18:29:18.021450 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:18.021425    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbe35e11-686b-4b4d-8211-ab29d33e0de3-cluster-monitoring-operator-tls podName:dbe35e11-686b-4b4d-8211-ab29d33e0de3 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:26.021419246 +0000 UTC m=+86.555602312 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dbe35e11-686b-4b4d-8211-ab29d33e0de3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-48gmb" (UID: "dbe35e11-686b-4b4d-8211-ab29d33e0de3") : secret "cluster-monitoring-operator-tls" not found
Aug 04 18:29:18.244125 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:18.244082    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kvgmn" event={"ID":"68eccac8-1e33-4075-96d7-820bb0ab0484","Type":"ContainerStarted","Data":"02df2bcd18cabd176303adef7b1cad8162f1fce4b33271fbb3e1c66e57804fdb"}
Aug 04 18:29:18.244320 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:18.244147    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kvgmn" event={"ID":"68eccac8-1e33-4075-96d7-820bb0ab0484","Type":"ContainerStarted","Data":"faa4c23955f0e34f56fb930f837c981acfaa4c5ed301c56e611de5a23aab1134"}
Aug 04 18:29:18.245615 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:18.245591    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-tn29d" event={"ID":"20467b44-db71-4065-9ec7-1fc733d80a96","Type":"ContainerStarted","Data":"28261441daf4b38b14438b2ff2df10b6bc85f9309f4c934cd09e023a2e93b6b2"}
Aug 04 18:29:18.245738 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:18.245628    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-tn29d" event={"ID":"20467b44-db71-4065-9ec7-1fc733d80a96","Type":"ContainerStarted","Data":"279328e6a175e6c874a901d9c79b94828b188f48af43e8250cb6b727c1ed46bb"}
Aug 04 18:29:18.264149 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:18.264040    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kvgmn" podStartSLOduration=1.993676765 podStartE2EDuration="3.2640215s" totalImagesPullingTime="1.270344735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:18.262201766 +0000 UTC m=+78.796384853" watchObservedRunningTime="2026-08-04 18:29:18.2640215 +0000 UTC m=+78.798204589"
Aug 04 18:29:18.945993 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:18.945951    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z4mcd_e4dac435-5ca9-41af-b8f0-e3aaa5b57d7d/dns-node-resolver/0.log"
Aug 04 18:29:19.736961 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:19.736905    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26d48b41-f890-442b-8ac3-63e065232cf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:19.737102 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:19.736978    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26d48b41-f890-442b-8ac3-63e065232cf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:19.737102 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:19.737061    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 18:29:19.737102 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:19.737077    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 18:29:19.737208 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:19.737116    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26d48b41-f890-442b-8ac3-63e065232cf3-kube-rbac-proxy-cm podName:26d48b41-f890-442b-8ac3-63e065232cf3 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:23.737102901 +0000 UTC m=+84.271285968 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/26d48b41-f890-442b-8ac3-63e065232cf3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gdx9z" (UID: "26d48b41-f890-442b-8ac3-63e065232cf3") : configmap "kube-rbac-proxy" not found
Aug 04 18:29:19.737208 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:19.737134    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26d48b41-f890-442b-8ac3-63e065232cf3-insights-runtime-extractor-tls podName:26d48b41-f890-442b-8ac3-63e065232cf3 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:23.7371207 +0000 UTC m=+84.271303770 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/26d48b41-f890-442b-8ac3-63e065232cf3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gdx9z" (UID: "26d48b41-f890-442b-8ac3-63e065232cf3") : secret "insights-runtime-extractor-tls" not found
Aug 04 18:29:19.744446 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:19.744424    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-txv8p_9bd4223d-7a9a-4ec4-9dea-c4ad74c6aa72/node-ca/0.log"
Aug 04 18:29:20.746808 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:20.746772    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xzrg5_5e7ba757-2c66-4408-9bf9-4ba84e9ea85d/serve-healthcheck-canary/0.log"
Aug 04 18:29:20.946033 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:20.945996    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-kvgmn_68eccac8-1e33-4075-96d7-820bb0ab0484/migrator/0.log"
Aug 04 18:29:21.144953 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:21.144930    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-kvgmn_68eccac8-1e33-4075-96d7-820bb0ab0484/graceful-termination/0.log"
Aug 04 18:29:23.765654 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:23.765505    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26d48b41-f890-442b-8ac3-63e065232cf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:23.765654 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:23.765587    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26d48b41-f890-442b-8ac3-63e065232cf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:23.766241 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:23.765666    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 18:29:23.766241 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:23.765690    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 18:29:23.766241 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:23.765722    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26d48b41-f890-442b-8ac3-63e065232cf3-kube-rbac-proxy-cm podName:26d48b41-f890-442b-8ac3-63e065232cf3 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:31.765708542 +0000 UTC m=+92.299891609 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/26d48b41-f890-442b-8ac3-63e065232cf3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gdx9z" (UID: "26d48b41-f890-442b-8ac3-63e065232cf3") : configmap "kube-rbac-proxy" not found
Aug 04 18:29:23.766241 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:23.765751    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26d48b41-f890-442b-8ac3-63e065232cf3-insights-runtime-extractor-tls podName:26d48b41-f890-442b-8ac3-63e065232cf3 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:31.765733184 +0000 UTC m=+92.299916259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/26d48b41-f890-442b-8ac3-63e065232cf3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gdx9z" (UID: "26d48b41-f890-442b-8ac3-63e065232cf3") : secret "insights-runtime-extractor-tls" not found
Aug 04 18:29:26.083861 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:26.083823    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-metrics-certs\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:26.084396 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:26.083911    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0319a4e0-2f16-49bb-863b-c563db4af7f4-service-ca-bundle\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:26.084396 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:26.083983    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbe35e11-686b-4b4d-8211-ab29d33e0de3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-48gmb\" (UID: \"dbe35e11-686b-4b4d-8211-ab29d33e0de3\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-48gmb"
Aug 04 18:29:26.085264 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:26.085234    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0319a4e0-2f16-49bb-863b-c563db4af7f4-service-ca-bundle\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:26.086361 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:26.086339    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0319a4e0-2f16-49bb-863b-c563db4af7f4-metrics-certs\") pod \"router-default-7cd44fddd-7k9f2\" (UID: \"0319a4e0-2f16-49bb-863b-c563db4af7f4\") " pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:26.086447 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:26.086405    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbe35e11-686b-4b4d-8211-ab29d33e0de3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-48gmb\" (UID: \"dbe35e11-686b-4b4d-8211-ab29d33e0de3\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-48gmb"
Aug 04 18:29:26.200832 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:26.200803    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:26.212201 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:26.212173    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-48gmb"
Aug 04 18:29:26.349368 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:26.349268    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-tn29d" podStartSLOduration=9.34925165 podStartE2EDuration="9.34925165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:18.289071889 +0000 UTC m=+78.823254978" watchObservedRunningTime="2026-08-04 18:29:26.34925165 +0000 UTC m=+86.883434739"
Aug 04 18:29:26.350374 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:26.350336    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7cd44fddd-7k9f2"]
Aug 04 18:29:26.353760 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:29:26.353731    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0319a4e0_2f16_49bb_863b_c563db4af7f4.slice/crio-dfa6b108b7dc23de711214953c247ffb95ea6db6f469190b29a56aadd20b4247 WatchSource:0}: Error finding container dfa6b108b7dc23de711214953c247ffb95ea6db6f469190b29a56aadd20b4247: Status 404 returned error can't find the container with id dfa6b108b7dc23de711214953c247ffb95ea6db6f469190b29a56aadd20b4247
Aug 04 18:29:26.364563 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:26.364540    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-48gmb"]
Aug 04 18:29:26.368030 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:29:26.368006    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbe35e11_686b_4b4d_8211_ab29d33e0de3.slice/crio-5f5b379838189604d5b7f912b75d0214110dece239946565100baa728edbb9b5 WatchSource:0}: Error finding container 5f5b379838189604d5b7f912b75d0214110dece239946565100baa728edbb9b5: Status 404 returned error can't find the container with id 5f5b379838189604d5b7f912b75d0214110dece239946565100baa728edbb9b5
Aug 04 18:29:27.282188 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:27.282145    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7cd44fddd-7k9f2" event={"ID":"0319a4e0-2f16-49bb-863b-c563db4af7f4","Type":"ContainerStarted","Data":"c472cadc8693cc4c403508cf4e418e2055844ac181bd04c0e45b9d3cc61993bf"}
Aug 04 18:29:27.282669 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:27.282212    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7cd44fddd-7k9f2" event={"ID":"0319a4e0-2f16-49bb-863b-c563db4af7f4","Type":"ContainerStarted","Data":"dfa6b108b7dc23de711214953c247ffb95ea6db6f469190b29a56aadd20b4247"}
Aug 04 18:29:27.283509 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:27.283480    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-48gmb" event={"ID":"dbe35e11-686b-4b4d-8211-ab29d33e0de3","Type":"ContainerStarted","Data":"5f5b379838189604d5b7f912b75d0214110dece239946565100baa728edbb9b5"}
Aug 04 18:29:27.305548 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:27.305482    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7cd44fddd-7k9f2" podStartSLOduration=17.305462392 podStartE2EDuration="17.305462392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:27.304680336 +0000 UTC m=+87.838863424" watchObservedRunningTime="2026-08-04 18:29:27.305462392 +0000 UTC m=+87.839645484"
Aug 04 18:29:28.201455 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:28.201423    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:28.204168 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:28.204143    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:28.288374 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:28.288342    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-48gmb" event={"ID":"dbe35e11-686b-4b4d-8211-ab29d33e0de3","Type":"ContainerStarted","Data":"920b2b5ff7894fab6590792bd5deb515b81e47cd7ba2e5c9b38c7b37c7cc1de3"}
Aug 04 18:29:28.288728 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:28.288454    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:28.289789 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:28.289768    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7cd44fddd-7k9f2"
Aug 04 18:29:28.322282 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:28.322233    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-48gmb" podStartSLOduration=16.467213208 podStartE2EDuration="18.322218973s" totalImagesPullingTime="1.855005765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:28.303995581 +0000 UTC m=+88.838178670" watchObservedRunningTime="2026-08-04 18:29:28.322218973 +0000 UTC m=+88.856402061"
Aug 04 18:29:31.829074 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:31.829029    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26d48b41-f890-442b-8ac3-63e065232cf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:31.829564 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:31.829084    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26d48b41-f890-442b-8ac3-63e065232cf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:31.829741 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:31.829717    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26d48b41-f890-442b-8ac3-63e065232cf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:31.831355 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:31.831336    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26d48b41-f890-442b-8ac3-63e065232cf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gdx9z\" (UID: \"26d48b41-f890-442b-8ac3-63e065232cf3\") " pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:31.915297 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:31.915266    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gdx9z"
Aug 04 18:29:32.041577 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:32.041549    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gdx9z"]
Aug 04 18:29:32.044926 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:29:32.044904    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d48b41_f890_442b_8ac3_63e065232cf3.slice/crio-5e39e95cb145b8abca8f558bb866e756cc4947bfdf969e2ccfa57a82942b6822 WatchSource:0}: Error finding container 5e39e95cb145b8abca8f558bb866e756cc4947bfdf969e2ccfa57a82942b6822: Status 404 returned error can't find the container with id 5e39e95cb145b8abca8f558bb866e756cc4947bfdf969e2ccfa57a82942b6822
Aug 04 18:29:32.304923 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:32.304888    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gdx9z" event={"ID":"26d48b41-f890-442b-8ac3-63e065232cf3","Type":"ContainerStarted","Data":"723765a922a5038d6dea20415bd25f80bc6433818a6e92227452b530906a0b39"}
Aug 04 18:29:32.305086 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:32.304942    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gdx9z" event={"ID":"26d48b41-f890-442b-8ac3-63e065232cf3","Type":"ContainerStarted","Data":"5e39e95cb145b8abca8f558bb866e756cc4947bfdf969e2ccfa57a82942b6822"}
Aug 04 18:29:33.311134 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:33.311047    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gdx9z" event={"ID":"26d48b41-f890-442b-8ac3-63e065232cf3","Type":"ContainerStarted","Data":"f792fbfc1661f0a1284d643fe8bd1ea23d4a364e42528261f9b7df5b0f663c20"}
Aug 04 18:29:35.319865 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:35.319831    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gdx9z" event={"ID":"26d48b41-f890-442b-8ac3-63e065232cf3","Type":"ContainerStarted","Data":"6487a8fbf18dce8f2963790529b255ca1412069e45e5e7d851208bf0a38ab775"}
Aug 04 18:29:35.342365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:35.342309    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gdx9z" podStartSLOduration=17.939422679 podStartE2EDuration="20.342294856s" totalImagesPullingTime="2.402872177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:29:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:35.341214832 +0000 UTC m=+95.875397915" watchObservedRunningTime="2026-08-04 18:29:35.342294856 +0000 UTC m=+95.876477992"
Aug 04 18:29:36.869853 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:36.869818    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-ckj9k"]
Aug 04 18:29:36.872870 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:36.872853    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-ckj9k"
Aug 04 18:29:36.877364 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:36.877342    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-ld2n4\""
Aug 04 18:29:36.898175 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:36.898137    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-ckj9k"]
Aug 04 18:29:36.937911 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:36.937883    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77d9fc6d5f-9v958"]
Aug 04 18:29:36.940842 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:36.940825    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:36.943838 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:36.943792    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 04 18:29:36.943988 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:36.943930    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 04 18:29:36.944128 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:36.944106    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-87ls6\""
Aug 04 18:29:36.944560 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:36.944538    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 04 18:29:36.951319 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:36.951302    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 04 18:29:36.968707 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:36.968683    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr8xx\" (UniqueName: \"kubernetes.io/projected/d6148e97-1a1a-4300-b6b8-baf17a6246c2-kube-api-access-qr8xx\") pod \"network-check-source-65bdbbff45-ckj9k\" (UID: \"d6148e97-1a1a-4300-b6b8-baf17a6246c2\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-ckj9k"
Aug 04 18:29:36.972911 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:36.972893    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77d9fc6d5f-9v958"]
Aug 04 18:29:37.069324 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.069235    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-image-registry-private-configuration\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.069324 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.069290    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-registry-tls\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.069324 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.069312    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr8xx\" (UniqueName: \"kubernetes.io/projected/d6148e97-1a1a-4300-b6b8-baf17a6246c2-kube-api-access-qr8xx\") pod \"network-check-source-65bdbbff45-ckj9k\" (UID: \"d6148e97-1a1a-4300-b6b8-baf17a6246c2\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-ckj9k"
Aug 04 18:29:37.069531 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.069327    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvszk\" (UniqueName: \"kubernetes.io/projected/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-kube-api-access-xvszk\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.069531 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.069435    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-ca-trust-extracted\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.069531 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.069469    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-installation-pull-secrets\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.069531 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.069493    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-registry-certificates\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.069705 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.069579    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-bound-sa-token\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.069705 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.069615    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-trusted-ca\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.085145 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.085118    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr8xx\" (UniqueName: \"kubernetes.io/projected/d6148e97-1a1a-4300-b6b8-baf17a6246c2-kube-api-access-qr8xx\") pod \"network-check-source-65bdbbff45-ckj9k\" (UID: \"d6148e97-1a1a-4300-b6b8-baf17a6246c2\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-ckj9k"
Aug 04 18:29:37.170679 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.170624    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-bound-sa-token\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.170896 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.170687    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-trusted-ca\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.170896 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.170729    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-image-registry-private-configuration\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.170896 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.170771    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-registry-tls\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.171045 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.170900    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvszk\" (UniqueName: \"kubernetes.io/projected/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-kube-api-access-xvszk\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.171045 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.170952    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-ca-trust-extracted\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.171045 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.171008    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-installation-pull-secrets\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.171198 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.171045    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-registry-certificates\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.171458 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.171429    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-ca-trust-extracted\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.171864 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.171843    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-trusted-ca\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.171954 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.171843    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-registry-certificates\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.173284 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.173264    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-registry-tls\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.173429 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.173409    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-image-registry-private-configuration\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.173473 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.173434    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-installation-pull-secrets\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.181081 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.181059    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-ckj9k"
Aug 04 18:29:37.181320 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.181301    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvszk\" (UniqueName: \"kubernetes.io/projected/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-kube-api-access-xvszk\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.181397 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.181331    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc-bound-sa-token\") pod \"image-registry-77d9fc6d5f-9v958\" (UID: \"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc\") " pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.249798 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.249775    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:37.311069 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.311035    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-ckj9k"]
Aug 04 18:29:37.315141 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:29:37.315109    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6148e97_1a1a_4300_b6b8_baf17a6246c2.slice/crio-5e3246b5b45d99bc9dd88dd3ef113cc6f2a51c2c76dd7d18a642ada66dc12f76 WatchSource:0}: Error finding container 5e3246b5b45d99bc9dd88dd3ef113cc6f2a51c2c76dd7d18a642ada66dc12f76: Status 404 returned error can't find the container with id 5e3246b5b45d99bc9dd88dd3ef113cc6f2a51c2c76dd7d18a642ada66dc12f76
Aug 04 18:29:37.329784 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.329750    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-ckj9k" event={"ID":"d6148e97-1a1a-4300-b6b8-baf17a6246c2","Type":"ContainerStarted","Data":"5e3246b5b45d99bc9dd88dd3ef113cc6f2a51c2c76dd7d18a642ada66dc12f76"}
Aug 04 18:29:37.386182 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:37.386152    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77d9fc6d5f-9v958"]
Aug 04 18:29:37.388695 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:29:37.388658    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca6410ad_8cc7_4dc7_a6b1_50d28f87d2bc.slice/crio-37e0791178364d8fffc727d2a64f82168a9b2542d43a2ae027afdbc8fc2e6203 WatchSource:0}: Error finding container 37e0791178364d8fffc727d2a64f82168a9b2542d43a2ae027afdbc8fc2e6203: Status 404 returned error can't find the container with id 37e0791178364d8fffc727d2a64f82168a9b2542d43a2ae027afdbc8fc2e6203
Aug 04 18:29:38.281818 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:38.281205    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls\") pod \"dns-default-mw7k5\" (UID: \"ac598b4f-20e2-402e-90d9-b57c4c511880\") " pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:29:38.284959 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:38.284924    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac598b4f-20e2-402e-90d9-b57c4c511880-metrics-tls\") pod \"dns-default-mw7k5\" (UID: \"ac598b4f-20e2-402e-90d9-b57c4c511880\") " pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:29:38.323036 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:38.323004    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t8fxw\""
Aug 04 18:29:38.330799 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:38.330767    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:29:38.334933 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:38.334903    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958" event={"ID":"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc","Type":"ContainerStarted","Data":"d14f483315b8ba7f8caa849deed07fa94227afe90745d5c2d945c62ced3dd0af"}
Aug 04 18:29:38.335082 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:38.334960    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958" event={"ID":"ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc","Type":"ContainerStarted","Data":"37e0791178364d8fffc727d2a64f82168a9b2542d43a2ae027afdbc8fc2e6203"}
Aug 04 18:29:38.335082 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:38.334985    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:38.336428 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:38.336408    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-ckj9k" event={"ID":"d6148e97-1a1a-4300-b6b8-baf17a6246c2","Type":"ContainerStarted","Data":"63515525c4641b4ec4d92a08a607ba631ee6f94aeb4d186762d880650f457a95"}
Aug 04 18:29:38.355818 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:38.355750    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958" podStartSLOduration=2.35573246 podStartE2EDuration="2.35573246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:38.3547908 +0000 UTC m=+98.888973891" watchObservedRunningTime="2026-08-04 18:29:38.35573246 +0000 UTC m=+98.889915599"
Aug 04 18:29:38.370351 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:38.370290    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-ckj9k" podStartSLOduration=2.370273588 podStartE2EDuration="2.370273588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:38.368948405 +0000 UTC m=+98.903131495" watchObservedRunningTime="2026-08-04 18:29:38.370273588 +0000 UTC m=+98.904456676"
Aug 04 18:29:38.458183 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:38.458151    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mw7k5"]
Aug 04 18:29:38.460996 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:29:38.460966    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac598b4f_20e2_402e_90d9_b57c4c511880.slice/crio-d42487e7fe3888af5fa5140227691ca86f5e10e0f304c2101609bf4c24e73e43 WatchSource:0}: Error finding container d42487e7fe3888af5fa5140227691ca86f5e10e0f304c2101609bf4c24e73e43: Status 404 returned error can't find the container with id d42487e7fe3888af5fa5140227691ca86f5e10e0f304c2101609bf4c24e73e43
Aug 04 18:29:39.341875 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:39.341836    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mw7k5" event={"ID":"ac598b4f-20e2-402e-90d9-b57c4c511880","Type":"ContainerStarted","Data":"d42487e7fe3888af5fa5140227691ca86f5e10e0f304c2101609bf4c24e73e43"}
Aug 04 18:29:41.350101 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:41.350060    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mw7k5" event={"ID":"ac598b4f-20e2-402e-90d9-b57c4c511880","Type":"ContainerStarted","Data":"e4dd4bdc83b92d0f219bd3d8d6c97a781e3bd3ed4ee2cf08bceb322f7f4dfd7f"}
Aug 04 18:29:41.350505 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:41.350156    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mw7k5" event={"ID":"ac598b4f-20e2-402e-90d9-b57c4c511880","Type":"ContainerStarted","Data":"20f5bb00e8eafbb9acf3347441b6162af1c9893f2de8fa07d8af6d53f0ffa081"}
Aug 04 18:29:41.350505 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:41.350186    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:29:41.371550 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:41.371494    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mw7k5" podStartSLOduration=65.245174531 podStartE2EDuration="1m7.371479774s" totalImagesPullingTime="2.126305243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:28:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:41.369621865 +0000 UTC m=+101.903804953" watchObservedRunningTime="2026-08-04 18:29:41.371479774 +0000 UTC m=+101.905662863"
Aug 04 18:29:43.228263 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:43.228237    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6kqrt"
Aug 04 18:29:46.296413 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.296375    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kv5wg"]
Aug 04 18:29:46.331127 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.331093    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.333704 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.333683    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 04 18:29:46.335684 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.335123    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tl7g6\""
Aug 04 18:29:46.335684 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.335185    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 04 18:29:46.335684 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.335387    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 04 18:29:46.340404 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.337691    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 04 18:29:46.445910 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.445874    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db101da5-7c37-432e-933f-ab952094713e-metrics-client-ca\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.446077 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.445920    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db101da5-7c37-432e-933f-ab952094713e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.446077 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.445950    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/db101da5-7c37-432e-933f-ab952094713e-node-exporter-accelerators-collector-config\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.446077 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.445984    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/db101da5-7c37-432e-933f-ab952094713e-root\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.446077 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.446026    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/db101da5-7c37-432e-933f-ab952094713e-node-exporter-textfile\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.446243 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.446110    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db101da5-7c37-432e-933f-ab952094713e-sys\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.446243 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.446149    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/db101da5-7c37-432e-933f-ab952094713e-node-exporter-tls\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.446243 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.446182    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/db101da5-7c37-432e-933f-ab952094713e-node-exporter-wtmp\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.446353 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.446256    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9nmk\" (UniqueName: \"kubernetes.io/projected/db101da5-7c37-432e-933f-ab952094713e-kube-api-access-q9nmk\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.547148 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.547062    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9nmk\" (UniqueName: \"kubernetes.io/projected/db101da5-7c37-432e-933f-ab952094713e-kube-api-access-q9nmk\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.547148 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.547113    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db101da5-7c37-432e-933f-ab952094713e-metrics-client-ca\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.547148 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.547144    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db101da5-7c37-432e-933f-ab952094713e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.547373 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.547169    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/db101da5-7c37-432e-933f-ab952094713e-node-exporter-accelerators-collector-config\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.547373 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.547318    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/db101da5-7c37-432e-933f-ab952094713e-root\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.547373 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.547368    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/db101da5-7c37-432e-933f-ab952094713e-node-exporter-textfile\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.547524 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.547407    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db101da5-7c37-432e-933f-ab952094713e-sys\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.547524 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.547429    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/db101da5-7c37-432e-933f-ab952094713e-node-exporter-tls\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.547524 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.547438    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/db101da5-7c37-432e-933f-ab952094713e-root\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.547524 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.547463    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/db101da5-7c37-432e-933f-ab952094713e-node-exporter-wtmp\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.547524 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.547493    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db101da5-7c37-432e-933f-ab952094713e-sys\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.547802 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.547684    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/db101da5-7c37-432e-933f-ab952094713e-node-exporter-wtmp\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.547802 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.547750    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/db101da5-7c37-432e-933f-ab952094713e-node-exporter-textfile\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.548179 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.548150    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db101da5-7c37-432e-933f-ab952094713e-metrics-client-ca\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.548287 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.548160    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/db101da5-7c37-432e-933f-ab952094713e-node-exporter-accelerators-collector-config\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.549938 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.549902    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/db101da5-7c37-432e-933f-ab952094713e-node-exporter-tls\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.550079 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.550059    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db101da5-7c37-432e-933f-ab952094713e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.555668 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.555649    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9nmk\" (UniqueName: \"kubernetes.io/projected/db101da5-7c37-432e-933f-ab952094713e-kube-api-access-q9nmk\") pod \"node-exporter-kv5wg\" (UID: \"db101da5-7c37-432e-933f-ab952094713e\") " pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.647022 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:46.646984    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kv5wg"
Aug 04 18:29:46.684688 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:29:46.684657    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb101da5_7c37_432e_933f_ab952094713e.slice/crio-d5a05999390223f178a67c0df6d145d25968df35acdede7222a239c762540e38 WatchSource:0}: Error finding container d5a05999390223f178a67c0df6d145d25968df35acdede7222a239c762540e38: Status 404 returned error can't find the container with id d5a05999390223f178a67c0df6d145d25968df35acdede7222a239c762540e38
Aug 04 18:29:47.315571 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.315535    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:29:47.330102 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.330070    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.332517 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.332489    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 04 18:29:47.332694 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.332675    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 04 18:29:47.332790 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.332714    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 04 18:29:47.332847 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.332791    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 04 18:29:47.333179 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.333004    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 04 18:29:47.336883 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.335570    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 04 18:29:47.336883 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.335857    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 04 18:29:47.336883 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.336074    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 04 18:29:47.336883 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.336259    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 04 18:29:47.336883 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.336619    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nzdhn\""
Aug 04 18:29:47.337566 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.337516    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:29:47.373842 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.373803    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kv5wg" event={"ID":"db101da5-7c37-432e-933f-ab952094713e","Type":"ContainerStarted","Data":"d5a05999390223f178a67c0df6d145d25968df35acdede7222a239c762540e38"}
Aug 04 18:29:47.454495 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.454457    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.454495 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.454498    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jclzt\" (UniqueName: \"kubernetes.io/projected/23eb1292-8b9b-4f61-a2b2-c1fda471a877-kube-api-access-jclzt\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.454774 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.454526    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23eb1292-8b9b-4f61-a2b2-c1fda471a877-tls-assets\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.454774 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.454547    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.454774 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.454569    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23eb1292-8b9b-4f61-a2b2-c1fda471a877-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.454774 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.454611    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-config-volume\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.454774 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.454660    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23eb1292-8b9b-4f61-a2b2-c1fda471a877-config-out\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.454774 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.454736    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.455038 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.454801    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.455038 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.454840    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/23eb1292-8b9b-4f61-a2b2-c1fda471a877-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.455038 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.454871    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.455038 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.454922    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23eb1292-8b9b-4f61-a2b2-c1fda471a877-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.455038 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.454970    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-web-config\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.555627 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.555588    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/23eb1292-8b9b-4f61-a2b2-c1fda471a877-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.555627 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.555653    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.555912 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.555702    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23eb1292-8b9b-4f61-a2b2-c1fda471a877-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.555912 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.555772    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-web-config\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.555912 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.555847    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.555912 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.555874    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jclzt\" (UniqueName: \"kubernetes.io/projected/23eb1292-8b9b-4f61-a2b2-c1fda471a877-kube-api-access-jclzt\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.555912 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.555909    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23eb1292-8b9b-4f61-a2b2-c1fda471a877-tls-assets\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.556171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.555932    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.556171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.555954    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23eb1292-8b9b-4f61-a2b2-c1fda471a877-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.556171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.556000    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-config-volume\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.556171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.556022    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23eb1292-8b9b-4f61-a2b2-c1fda471a877-config-out\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.556171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.556025    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/23eb1292-8b9b-4f61-a2b2-c1fda471a877-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.556171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.556057    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.556171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.556107    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.556171 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:47.556134    2558 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Aug 04 18:29:47.556515 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:29:47.556207    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-main-tls podName:23eb1292-8b9b-4f61-a2b2-c1fda471a877 nodeName:}" failed. No retries permitted until 2026-08-04 18:29:48.056187659 +0000 UTC m=+108.590370733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "23eb1292-8b9b-4f61-a2b2-c1fda471a877") : secret "alertmanager-main-tls" not found
Aug 04 18:29:47.556579 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.556537    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23eb1292-8b9b-4f61-a2b2-c1fda471a877-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.560225 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.559621    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-config-volume\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.560225 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.559817    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23eb1292-8b9b-4f61-a2b2-c1fda471a877-config-out\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.560225 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.559847    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23eb1292-8b9b-4f61-a2b2-c1fda471a877-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.560225 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.560164    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.560225 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.560215    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23eb1292-8b9b-4f61-a2b2-c1fda471a877-tls-assets\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.561109 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.561086    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-web-config\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.561314 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.561295    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.561390 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.561372    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.561651 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.561615    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:47.565887 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:47.565834    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jclzt\" (UniqueName: \"kubernetes.io/projected/23eb1292-8b9b-4f61-a2b2-c1fda471a877-kube-api-access-jclzt\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:48.060703 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.060660    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:48.063107 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.063080    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:48.244233 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.244203    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:29:48.379234 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.379200    2558 generic.go:356] "Generic (PLEG): container finished" podID="db101da5-7c37-432e-933f-ab952094713e" containerID="515896aba8aa98dd15f7a660b653439960ee92006bfee4d2d2cee1f1df5da4ae" exitCode=0
Aug 04 18:29:48.379594 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.379286    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kv5wg" event={"ID":"db101da5-7c37-432e-933f-ab952094713e","Type":"ContainerDied","Data":"515896aba8aa98dd15f7a660b653439960ee92006bfee4d2d2cee1f1df5da4ae"}
Aug 04 18:29:48.402716 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.402013    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:29:48.408355 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:29:48.408330    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23eb1292_8b9b_4f61_a2b2_c1fda471a877.slice/crio-06517cd6a28f17baec8839566d03df61c333033af9fe9dd15db21b790d76125b WatchSource:0}: Error finding container 06517cd6a28f17baec8839566d03df61c333033af9fe9dd15db21b790d76125b: Status 404 returned error can't find the container with id 06517cd6a28f17baec8839566d03df61c333033af9fe9dd15db21b790d76125b
Aug 04 18:29:48.533103 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.533072    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-764b6fd88f-6l5bc"]
Aug 04 18:29:48.534938 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.534922    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.537464 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.537433    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Aug 04 18:29:48.537464 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.537445    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Aug 04 18:29:48.537661 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.537494    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jxbgl\""
Aug 04 18:29:48.537661 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.537446    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Aug 04 18:29:48.537661 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.537592    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Aug 04 18:29:48.537828 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.537777    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Aug 04 18:29:48.537828 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.537798    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Aug 04 18:29:48.537934 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.537855    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Aug 04 18:29:48.543476 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.543455    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Aug 04 18:29:48.549760 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.549741    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-764b6fd88f-6l5bc"]
Aug 04 18:29:48.665621 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.665585    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-oauth-serving-cert\") pod \"console-764b6fd88f-6l5bc\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") " pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.665826 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.665669    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-service-ca\") pod \"console-764b6fd88f-6l5bc\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") " pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.665826 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.665730    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-trusted-ca-bundle\") pod \"console-764b6fd88f-6l5bc\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") " pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.665826 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.665749    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbhhf\" (UniqueName: \"kubernetes.io/projected/b2d161a7-94f1-463b-8500-6fa1591a0a7b-kube-api-access-jbhhf\") pod \"console-764b6fd88f-6l5bc\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") " pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.665826 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.665796    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2d161a7-94f1-463b-8500-6fa1591a0a7b-console-oauth-config\") pod \"console-764b6fd88f-6l5bc\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") " pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.665826 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.665820    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2d161a7-94f1-463b-8500-6fa1591a0a7b-console-serving-cert\") pod \"console-764b6fd88f-6l5bc\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") " pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.665992 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.665844    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-console-config\") pod \"console-764b6fd88f-6l5bc\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") " pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.767078 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.767044    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2d161a7-94f1-463b-8500-6fa1591a0a7b-console-serving-cert\") pod \"console-764b6fd88f-6l5bc\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") " pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.767078 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.767080    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-console-config\") pod \"console-764b6fd88f-6l5bc\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") " pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.767360 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.767131    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-oauth-serving-cert\") pod \"console-764b6fd88f-6l5bc\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") " pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.767360 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.767151    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-service-ca\") pod \"console-764b6fd88f-6l5bc\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") " pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.767360 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.767173    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-trusted-ca-bundle\") pod \"console-764b6fd88f-6l5bc\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") " pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.767360 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.767189    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbhhf\" (UniqueName: \"kubernetes.io/projected/b2d161a7-94f1-463b-8500-6fa1591a0a7b-kube-api-access-jbhhf\") pod \"console-764b6fd88f-6l5bc\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") " pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.767360 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.767282    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2d161a7-94f1-463b-8500-6fa1591a0a7b-console-oauth-config\") pod \"console-764b6fd88f-6l5bc\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") " pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.768034 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.768011    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-console-config\") pod \"console-764b6fd88f-6l5bc\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") " pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.768147 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.768038    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-service-ca\") pod \"console-764b6fd88f-6l5bc\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") " pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.768147 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.768062    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-oauth-serving-cert\") pod \"console-764b6fd88f-6l5bc\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") " pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.768147 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.768135    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-trusted-ca-bundle\") pod \"console-764b6fd88f-6l5bc\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") " pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.769731 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.769713    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2d161a7-94f1-463b-8500-6fa1591a0a7b-console-serving-cert\") pod \"console-764b6fd88f-6l5bc\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") " pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.769781 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.769738    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2d161a7-94f1-463b-8500-6fa1591a0a7b-console-oauth-config\") pod \"console-764b6fd88f-6l5bc\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") " pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.775732 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.775709    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbhhf\" (UniqueName: \"kubernetes.io/projected/b2d161a7-94f1-463b-8500-6fa1591a0a7b-kube-api-access-jbhhf\") pod \"console-764b6fd88f-6l5bc\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") " pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.845334 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.845301    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:48.985720 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:48.985681    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-764b6fd88f-6l5bc"]
Aug 04 18:29:48.989293 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:29:48.989261    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d161a7_94f1_463b_8500_6fa1591a0a7b.slice/crio-2181a8f10b9d1bec3869b30179abfe39c191f09bcf2474d93df20030fe3b4283 WatchSource:0}: Error finding container 2181a8f10b9d1bec3869b30179abfe39c191f09bcf2474d93df20030fe3b4283: Status 404 returned error can't find the container with id 2181a8f10b9d1bec3869b30179abfe39c191f09bcf2474d93df20030fe3b4283
Aug 04 18:29:49.385762 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:49.385673    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764b6fd88f-6l5bc" event={"ID":"b2d161a7-94f1-463b-8500-6fa1591a0a7b","Type":"ContainerStarted","Data":"2181a8f10b9d1bec3869b30179abfe39c191f09bcf2474d93df20030fe3b4283"}
Aug 04 18:29:49.386918 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:49.386889    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23eb1292-8b9b-4f61-a2b2-c1fda471a877","Type":"ContainerStarted","Data":"06517cd6a28f17baec8839566d03df61c333033af9fe9dd15db21b790d76125b"}
Aug 04 18:29:49.389025 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:49.389002    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kv5wg" event={"ID":"db101da5-7c37-432e-933f-ab952094713e","Type":"ContainerStarted","Data":"46db54d199e03b44dac1f50e44d8fb6f462f7e95206521b6b29985a679745e05"}
Aug 04 18:29:49.389139 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:49.389068    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kv5wg" event={"ID":"db101da5-7c37-432e-933f-ab952094713e","Type":"ContainerStarted","Data":"f739bf22790efe054a744af629526b3e0d4af9b89e2fedc2baa6561a964b4a82"}
Aug 04 18:29:49.413012 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:49.412970    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kv5wg" podStartSLOduration=1.8524602799999998 podStartE2EDuration="3.412946486s" totalImagesPullingTime="1.482855143s" totalInitContainerRuntime="77.631063ms" isStatefulPod=true podCreationTimestamp="2026-08-04 18:29:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:49.412620047 +0000 UTC m=+109.946803145" watchObservedRunningTime="2026-08-04 18:29:49.412946486 +0000 UTC m=+109.947129574"
Aug 04 18:29:50.394988 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:50.394954    2558 generic.go:356] "Generic (PLEG): container finished" podID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerID="ac4398b3f1bc2f37742b8d6ec9676368fa9c5728b4cb0e4385faea209caf1454" exitCode=0
Aug 04 18:29:50.395418 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:50.395048    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23eb1292-8b9b-4f61-a2b2-c1fda471a877","Type":"ContainerDied","Data":"ac4398b3f1bc2f37742b8d6ec9676368fa9c5728b4cb0e4385faea209caf1454"}
Aug 04 18:29:51.006626 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:51.006589    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-2mn69"]
Aug 04 18:29:51.010157 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:51.010133    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2mn69"
Aug 04 18:29:51.012903 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:51.012881    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Aug 04 18:29:51.013038 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:51.012922    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-zw2kq\""
Aug 04 18:29:51.026142 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:51.026082    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-2mn69"]
Aug 04 18:29:51.192605 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:51.192566    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkl6n\" (UniqueName: \"kubernetes.io/projected/bcc52925-e69f-449e-a577-30c998155b50-kube-api-access-fkl6n\") pod \"monitoring-plugin-6dffbbd67-2mn69\" (UID: \"bcc52925-e69f-449e-a577-30c998155b50\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2mn69"
Aug 04 18:29:51.192811 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:51.192693    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bcc52925-e69f-449e-a577-30c998155b50-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-2mn69\" (UID: \"bcc52925-e69f-449e-a577-30c998155b50\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2mn69"
Aug 04 18:29:51.293298 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:51.293181    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bcc52925-e69f-449e-a577-30c998155b50-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-2mn69\" (UID: \"bcc52925-e69f-449e-a577-30c998155b50\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2mn69"
Aug 04 18:29:51.293463 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:51.293389    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkl6n\" (UniqueName: \"kubernetes.io/projected/bcc52925-e69f-449e-a577-30c998155b50-kube-api-access-fkl6n\") pod \"monitoring-plugin-6dffbbd67-2mn69\" (UID: \"bcc52925-e69f-449e-a577-30c998155b50\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2mn69"
Aug 04 18:29:51.296124 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:51.296097    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bcc52925-e69f-449e-a577-30c998155b50-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-2mn69\" (UID: \"bcc52925-e69f-449e-a577-30c998155b50\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2mn69"
Aug 04 18:29:51.302495 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:51.302468    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkl6n\" (UniqueName: \"kubernetes.io/projected/bcc52925-e69f-449e-a577-30c998155b50-kube-api-access-fkl6n\") pod \"monitoring-plugin-6dffbbd67-2mn69\" (UID: \"bcc52925-e69f-449e-a577-30c998155b50\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2mn69"
Aug 04 18:29:51.322137 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:51.322107    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2mn69"
Aug 04 18:29:51.356083 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:51.356054    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mw7k5"
Aug 04 18:29:51.911539 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:51.911510    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-2mn69"]
Aug 04 18:29:51.914393 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:29:51.914364    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc52925_e69f_449e_a577_30c998155b50.slice/crio-f18010215cd71f6f3a3da008dbf0dad959e33b58538e3429c0e4abb63f4d46e6 WatchSource:0}: Error finding container f18010215cd71f6f3a3da008dbf0dad959e33b58538e3429c0e4abb63f4d46e6: Status 404 returned error can't find the container with id f18010215cd71f6f3a3da008dbf0dad959e33b58538e3429c0e4abb63f4d46e6
Aug 04 18:29:52.405152 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.405106    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764b6fd88f-6l5bc" event={"ID":"b2d161a7-94f1-463b-8500-6fa1591a0a7b","Type":"ContainerStarted","Data":"f0070dff1d7bbaeb8075a2348796bf2bce158c1db6cb84e544195a594ecff2db"}
Aug 04 18:29:52.406420 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.406374    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2mn69" event={"ID":"bcc52925-e69f-449e-a577-30c998155b50","Type":"ContainerStarted","Data":"f18010215cd71f6f3a3da008dbf0dad959e33b58538e3429c0e4abb63f4d46e6"}
Aug 04 18:29:52.424461 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.424401    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-764b6fd88f-6l5bc" podStartSLOduration=1.572064782 podStartE2EDuration="4.424385032s" totalImagesPullingTime="2.85232025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:52.423477441 +0000 UTC m=+112.957660531" watchObservedRunningTime="2026-08-04 18:29:52.424385032 +0000 UTC m=+112.958568119"
Aug 04 18:29:52.507023 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.506988    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:29:52.511918 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.511896    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.514530 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.514502    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Aug 04 18:29:52.514698 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.514540    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Aug 04 18:29:52.514698 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.514578    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Aug 04 18:29:52.514828 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.514680    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-80j95qrp1a2qd\""
Aug 04 18:29:52.514878 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.514841    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Aug 04 18:29:52.514878 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.514846    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6k258\""
Aug 04 18:29:52.514878 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.514872    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Aug 04 18:29:52.515230 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.515189    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Aug 04 18:29:52.515383 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.515204    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Aug 04 18:29:52.515383 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.515326    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Aug 04 18:29:52.515539 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.515519    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Aug 04 18:29:52.515618 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.515535    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Aug 04 18:29:52.515618 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.515599    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Aug 04 18:29:52.515618 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.515608    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Aug 04 18:29:52.515874 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.515538    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Aug 04 18:29:52.521109 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.521078    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Aug 04 18:29:52.525009 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.524963    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Aug 04 18:29:52.531022 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.530996    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:29:52.705872 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.705710    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c4f5f23-27ad-46f8-b298-da2e463dbb76-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.705872 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.705763    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4z47\" (UniqueName: \"kubernetes.io/projected/7c4f5f23-27ad-46f8-b298-da2e463dbb76-kube-api-access-x4z47\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.705872 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.705820    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.705872 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.705856    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.706197 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.705891    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.706197 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.705916    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.706197 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.705947    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.706197 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.705981    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c4f5f23-27ad-46f8-b298-da2e463dbb76-config-out\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.706197 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.706023    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.706197 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.706068    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.706197 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.706097    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-web-config\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.706197 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.706133    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.706600 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.706200    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.706600 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.706248    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.706600 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.706300    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-config\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.706600 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.706324    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.706600 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.706351    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.706600 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.706382    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.706600 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.706420    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.706600 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.706468    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.807718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.807627    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-web-config\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.807889 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.807744    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.807889 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.807784    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.807889 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.807810    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.807889 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.807852    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-config\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.807889 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.807872    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.808154 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.807895    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.808154 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.807918    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.808154 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.807957    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.808154 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.808000    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.808154 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.808033    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c4f5f23-27ad-46f8-b298-da2e463dbb76-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.808154 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.808056    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4z47\" (UniqueName: \"kubernetes.io/projected/7c4f5f23-27ad-46f8-b298-da2e463dbb76-kube-api-access-x4z47\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.808154 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.808083    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.808154 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.808107    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.808154 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.808140    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.808626 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.808166    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.808626 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.808197    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.808626 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.808259    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c4f5f23-27ad-46f8-b298-da2e463dbb76-config-out\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.808626 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.808294    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.808626 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.808333    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.808905 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.808751    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.809143 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.809118    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.811898 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.811559    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-config\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.811898 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.811672    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-web-config\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.811898 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.811733    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.812296 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.812263    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.812742 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.812611    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.812985 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.812884    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.813321 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.813277    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.813497 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.813438    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.814238 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.813796    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.814238 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.813904    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.814238 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.814197    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.815223 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.815182    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c4f5f23-27ad-46f8-b298-da2e463dbb76-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.816510 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.816463    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.816648 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.816613    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.817106 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.817061    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.817612 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.817589    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c4f5f23-27ad-46f8-b298-da2e463dbb76-config-out\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.820333 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.820295    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.821841 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.821811    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4z47\" (UniqueName: \"kubernetes.io/projected/7c4f5f23-27ad-46f8-b298-da2e463dbb76-kube-api-access-x4z47\") pod \"prometheus-k8s-0\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:52.829699 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:52.829670    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:29:53.046204 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:53.046178    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:29:53.049731 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:29:53.049703    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c4f5f23_27ad_46f8_b298_da2e463dbb76.slice/crio-b0360691118dce34d79583fe3a243d5d3b07fc6013f6cf4b7bff653c74d8355e WatchSource:0}: Error finding container b0360691118dce34d79583fe3a243d5d3b07fc6013f6cf4b7bff653c74d8355e: Status 404 returned error can't find the container with id b0360691118dce34d79583fe3a243d5d3b07fc6013f6cf4b7bff653c74d8355e
Aug 04 18:29:53.414816 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:53.414779    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23eb1292-8b9b-4f61-a2b2-c1fda471a877","Type":"ContainerStarted","Data":"25f785421479dbfd4017f781841c651b4c30ca7586754e13af8bdd31bd52b267"}
Aug 04 18:29:53.415013 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:53.414868    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23eb1292-8b9b-4f61-a2b2-c1fda471a877","Type":"ContainerStarted","Data":"1cc306b8fa3e76196775356a8959085d24faa1653e8475436c84d817fbb333ea"}
Aug 04 18:29:53.415013 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:53.414914    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23eb1292-8b9b-4f61-a2b2-c1fda471a877","Type":"ContainerStarted","Data":"3b637aa38ecf0b1b671fee3a782d757cab7da147cd123b7186761926a831ee5b"}
Aug 04 18:29:53.415013 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:53.414956    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23eb1292-8b9b-4f61-a2b2-c1fda471a877","Type":"ContainerStarted","Data":"6eded588164e9dc8a14551262ae9f4c3b3658a291a10ce86edc567b675613ab6"}
Aug 04 18:29:53.416660 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:53.416618    2558 generic.go:356] "Generic (PLEG): container finished" podID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerID="b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7" exitCode=0
Aug 04 18:29:53.417116 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:53.417082    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c4f5f23-27ad-46f8-b298-da2e463dbb76","Type":"ContainerDied","Data":"b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7"}
Aug 04 18:29:53.417243 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:53.417159    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c4f5f23-27ad-46f8-b298-da2e463dbb76","Type":"ContainerStarted","Data":"b0360691118dce34d79583fe3a243d5d3b07fc6013f6cf4b7bff653c74d8355e"}
Aug 04 18:29:54.424475 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:54.424421    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23eb1292-8b9b-4f61-a2b2-c1fda471a877","Type":"ContainerStarted","Data":"bbdd4a22eda5cd1503075b264c48ba003732bd37e32cc8ace60c63b3f7ee0546"}
Aug 04 18:29:54.426112 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:54.426075    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2mn69" event={"ID":"bcc52925-e69f-449e-a577-30c998155b50","Type":"ContainerStarted","Data":"b66e2427816a1a31ad607b674a31c43922e777c535087db10eb01b1f9361831a"}
Aug 04 18:29:54.426330 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:54.426314    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2mn69"
Aug 04 18:29:54.434006 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:54.433977    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2mn69"
Aug 04 18:29:54.446340 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:54.446245    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2mn69" podStartSLOduration=2.771750584 podStartE2EDuration="4.446226703s" totalImagesPullingTime="1.674476119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:54.443347909 +0000 UTC m=+114.977531002" watchObservedRunningTime="2026-08-04 18:29:54.446226703 +0000 UTC m=+114.980409793"
Aug 04 18:29:57.255165 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:57.255049    2558 patch_prober.go:28] interesting pod/image-registry-77d9fc6d5f-9v958 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Aug 04 18:29:57.255165 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:57.255135    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958" podUID="ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:29:57.442201 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:57.442176    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c4f5f23-27ad-46f8-b298-da2e463dbb76","Type":"ContainerStarted","Data":"898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d"}
Aug 04 18:29:57.442303 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:57.442252    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c4f5f23-27ad-46f8-b298-da2e463dbb76","Type":"ContainerStarted","Data":"fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352"}
Aug 04 18:29:58.450467 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:58.450426    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23eb1292-8b9b-4f61-a2b2-c1fda471a877","Type":"ContainerStarted","Data":"92f1ec7cc1d90a30eb5963ff0fc747d1a67c4ff0c4fac0ed19b6aa060fd5202d"}
Aug 04 18:29:58.484910 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:58.484843    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.104216106 podStartE2EDuration="11.484820774s" totalImagesPullingTime="7.364414213s" totalInitContainerRuntime="16.190455ms" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:58.482616342 +0000 UTC m=+119.016799430" watchObservedRunningTime="2026-08-04 18:29:58.484820774 +0000 UTC m=+119.019003864"
Aug 04 18:29:58.845676 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:58.845576    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:58.845676 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:58.845664    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:58.852064 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:58.852042    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:59.346801 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:59.346775    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77d9fc6d5f-9v958"
Aug 04 18:29:59.458847 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:59.458805    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c4f5f23-27ad-46f8-b298-da2e463dbb76","Type":"ContainerStarted","Data":"ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de"}
Aug 04 18:29:59.459255 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:59.458875    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c4f5f23-27ad-46f8-b298-da2e463dbb76","Type":"ContainerStarted","Data":"cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5"}
Aug 04 18:29:59.459255 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:59.458910    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c4f5f23-27ad-46f8-b298-da2e463dbb76","Type":"ContainerStarted","Data":"ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff"}
Aug 04 18:29:59.459255 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:59.458935    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c4f5f23-27ad-46f8-b298-da2e463dbb76","Type":"ContainerStarted","Data":"70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76"}
Aug 04 18:29:59.462658 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:59.462609    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:29:59.492349 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:29:59.492299    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.959793586 podStartE2EDuration="7.49228035s" totalImagesPullingTime="5.509981806s" totalInitContainerRuntime="22.504958ms" isStatefulPod=false podCreationTimestamp="2026-08-04 18:29:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:29:59.490777491 +0000 UTC m=+120.024960582" watchObservedRunningTime="2026-08-04 18:29:59.49228035 +0000 UTC m=+120.026463440"
Aug 04 18:30:02.829838 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:02.829800    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:30:05.338575 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.338537    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56569bb8cb-d6wpb"]
Aug 04 18:30:05.343014 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.342997    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.354258 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.354235    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56569bb8cb-d6wpb"]
Aug 04 18:30:05.426569 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.426536    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rsjb\" (UniqueName: \"kubernetes.io/projected/0af986ed-47ea-4f24-89c2-2c20a2455feb-kube-api-access-8rsjb\") pod \"console-56569bb8cb-d6wpb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") " pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.426771 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.426595    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0af986ed-47ea-4f24-89c2-2c20a2455feb-console-oauth-config\") pod \"console-56569bb8cb-d6wpb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") " pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.426771 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.426723    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-service-ca\") pod \"console-56569bb8cb-d6wpb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") " pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.426771 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.426756    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0af986ed-47ea-4f24-89c2-2c20a2455feb-console-serving-cert\") pod \"console-56569bb8cb-d6wpb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") " pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.426889 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.426777    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-oauth-serving-cert\") pod \"console-56569bb8cb-d6wpb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") " pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.426931 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.426902    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-console-config\") pod \"console-56569bb8cb-d6wpb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") " pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.426968 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.426938    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-trusted-ca-bundle\") pod \"console-56569bb8cb-d6wpb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") " pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.528031 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.527995    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0af986ed-47ea-4f24-89c2-2c20a2455feb-console-oauth-config\") pod \"console-56569bb8cb-d6wpb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") " pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.528210 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.528067    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-service-ca\") pod \"console-56569bb8cb-d6wpb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") " pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.528210 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.528096    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0af986ed-47ea-4f24-89c2-2c20a2455feb-console-serving-cert\") pod \"console-56569bb8cb-d6wpb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") " pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.528210 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.528112    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-oauth-serving-cert\") pod \"console-56569bb8cb-d6wpb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") " pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.528210 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.528148    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-console-config\") pod \"console-56569bb8cb-d6wpb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") " pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.528210 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.528171    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-trusted-ca-bundle\") pod \"console-56569bb8cb-d6wpb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") " pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.528210 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.528206    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rsjb\" (UniqueName: \"kubernetes.io/projected/0af986ed-47ea-4f24-89c2-2c20a2455feb-kube-api-access-8rsjb\") pod \"console-56569bb8cb-d6wpb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") " pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.528963 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.528938    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-oauth-serving-cert\") pod \"console-56569bb8cb-d6wpb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") " pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.529068 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.528970    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-console-config\") pod \"console-56569bb8cb-d6wpb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") " pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.529105 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.529058    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-service-ca\") pod \"console-56569bb8cb-d6wpb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") " pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.529157 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.529138    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-trusted-ca-bundle\") pod \"console-56569bb8cb-d6wpb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") " pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.530676 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.530658    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0af986ed-47ea-4f24-89c2-2c20a2455feb-console-serving-cert\") pod \"console-56569bb8cb-d6wpb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") " pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.530757 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.530679    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0af986ed-47ea-4f24-89c2-2c20a2455feb-console-oauth-config\") pod \"console-56569bb8cb-d6wpb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") " pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.554742 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.554721    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rsjb\" (UniqueName: \"kubernetes.io/projected/0af986ed-47ea-4f24-89c2-2c20a2455feb-kube-api-access-8rsjb\") pod \"console-56569bb8cb-d6wpb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") " pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.651909 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.651867    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:05.785179 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:05.785146    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56569bb8cb-d6wpb"]
Aug 04 18:30:05.788244 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:30:05.788207    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0af986ed_47ea_4f24_89c2_2c20a2455feb.slice/crio-568de6fd48d6cde864cd1106cdbef930dc63be2a447afd97e83c4dd103f7522e WatchSource:0}: Error finding container 568de6fd48d6cde864cd1106cdbef930dc63be2a447afd97e83c4dd103f7522e: Status 404 returned error can't find the container with id 568de6fd48d6cde864cd1106cdbef930dc63be2a447afd97e83c4dd103f7522e
Aug 04 18:30:06.488449 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:06.488417    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56569bb8cb-d6wpb" event={"ID":"0af986ed-47ea-4f24-89c2-2c20a2455feb","Type":"ContainerStarted","Data":"092e6ca6e1bf1ea169594e9e56c26c9f314d4de6ed6decc1764005fc56b454a8"}
Aug 04 18:30:06.488838 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:06.488470    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56569bb8cb-d6wpb" event={"ID":"0af986ed-47ea-4f24-89c2-2c20a2455feb","Type":"ContainerStarted","Data":"568de6fd48d6cde864cd1106cdbef930dc63be2a447afd97e83c4dd103f7522e"}
Aug 04 18:30:06.514868 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:06.514820    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56569bb8cb-d6wpb" podStartSLOduration=1.514804571 podStartE2EDuration="1.514804571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:30:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:30:06.514696377 +0000 UTC m=+127.048879466" watchObservedRunningTime="2026-08-04 18:30:06.514804571 +0000 UTC m=+127.048987660"
Aug 04 18:30:09.770376 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:09.770333    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs\") pod \"network-metrics-daemon-mrvjt\" (UID: \"54490a46-3a24-4059-87c8-850cc41a7459\") " pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:30:09.772665 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:09.772645    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54490a46-3a24-4059-87c8-850cc41a7459-metrics-certs\") pod \"network-metrics-daemon-mrvjt\" (UID: \"54490a46-3a24-4059-87c8-850cc41a7459\") " pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:30:09.879546 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:09.879514    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zw2lq\""
Aug 04 18:30:09.887447 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:09.887425    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrvjt"
Aug 04 18:30:10.023358 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:10.023335    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mrvjt"]
Aug 04 18:30:10.025725 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:30:10.025697    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54490a46_3a24_4059_87c8_850cc41a7459.slice/crio-5a7e8798e25625e164b6037cd209b7f804c0629a43b2649ee961c7626285ef49 WatchSource:0}: Error finding container 5a7e8798e25625e164b6037cd209b7f804c0629a43b2649ee961c7626285ef49: Status 404 returned error can't find the container with id 5a7e8798e25625e164b6037cd209b7f804c0629a43b2649ee961c7626285ef49
Aug 04 18:30:10.506716 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:10.506673    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mrvjt" event={"ID":"54490a46-3a24-4059-87c8-850cc41a7459","Type":"ContainerStarted","Data":"5a7e8798e25625e164b6037cd209b7f804c0629a43b2649ee961c7626285ef49"}
Aug 04 18:30:11.512844 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:11.512807    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mrvjt" event={"ID":"54490a46-3a24-4059-87c8-850cc41a7459","Type":"ContainerStarted","Data":"946fe39e921794e97026a8cb57b201c496ffac7ca36d33c5b383da995fc8f27b"}
Aug 04 18:30:11.513211 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:11.512861    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mrvjt" event={"ID":"54490a46-3a24-4059-87c8-850cc41a7459","Type":"ContainerStarted","Data":"90674eaf24c920f7bf6cc0e687f0248f43fc9791e30ddf141da3ffbefca6bdee"}
Aug 04 18:30:11.533876 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:11.533825    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mrvjt" podStartSLOduration=130.59981092 podStartE2EDuration="2m11.533809718s" totalImagesPullingTime="933.998798ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:30:11.531752728 +0000 UTC m=+132.065935816" watchObservedRunningTime="2026-08-04 18:30:11.533809718 +0000 UTC m=+132.067992834"
Aug 04 18:30:15.652771 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:15.652735    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:15.653147 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:15.652823    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:15.657440 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:15.657418    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:16.535466 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:16.535438    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:30:16.653751 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:16.653719    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-764b6fd88f-6l5bc"]
Aug 04 18:30:39.630060 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:39.630027    2558 generic.go:356] "Generic (PLEG): container finished" podID="de65c70b-694d-43ab-a65a-59056697a7b9" containerID="708fed1be6ae642a707074ad5d651ebcd827076ec2fc7e0890c713d35e664852" exitCode=0
Aug 04 18:30:39.630484 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:39.630106    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-x6hzq" event={"ID":"de65c70b-694d-43ab-a65a-59056697a7b9","Type":"ContainerDied","Data":"708fed1be6ae642a707074ad5d651ebcd827076ec2fc7e0890c713d35e664852"}
Aug 04 18:30:39.630484 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:39.630456    2558 scope.go:117] "RemoveContainer" containerID="708fed1be6ae642a707074ad5d651ebcd827076ec2fc7e0890c713d35e664852"
Aug 04 18:30:40.636046 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:40.636013    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-x6hzq" event={"ID":"de65c70b-694d-43ab-a65a-59056697a7b9","Type":"ContainerStarted","Data":"61156b700e7c34fef186ef9ddad5526544ce503a9fb35b4fa33168ae6f0dd9e6"}
Aug 04 18:30:41.672423 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:41.672381    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-764b6fd88f-6l5bc" podUID="b2d161a7-94f1-463b-8500-6fa1591a0a7b" containerName="console" containerID="cri-o://f0070dff1d7bbaeb8075a2348796bf2bce158c1db6cb84e544195a594ecff2db" gracePeriod=15
Aug 04 18:30:41.913364 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:41.913341    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:30:41.959560 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:41.959489    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-service-ca\") pod \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") "
Aug 04 18:30:41.959738 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:41.959557    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbhhf\" (UniqueName: \"kubernetes.io/projected/b2d161a7-94f1-463b-8500-6fa1591a0a7b-kube-api-access-jbhhf\") pod \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") "
Aug 04 18:30:41.959738 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:41.959596    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2d161a7-94f1-463b-8500-6fa1591a0a7b-console-serving-cert\") pod \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") "
Aug 04 18:30:41.959738 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:41.959671    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-oauth-serving-cert\") pod \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") "
Aug 04 18:30:41.959738 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:41.959705    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-trusted-ca-bundle\") pod \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") "
Aug 04 18:30:41.959738 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:41.959729    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2d161a7-94f1-463b-8500-6fa1591a0a7b-console-oauth-config\") pod \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") "
Aug 04 18:30:41.960001 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:41.959751    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-console-config\") pod \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\" (UID: \"b2d161a7-94f1-463b-8500-6fa1591a0a7b\") "
Aug 04 18:30:41.960001 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:41.959869    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-service-ca" (OuterVolumeSpecName: "service-ca") pod "b2d161a7-94f1-463b-8500-6fa1591a0a7b" (UID: "b2d161a7-94f1-463b-8500-6fa1591a0a7b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:30:41.960111 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:41.960056    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-service-ca\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:30:41.960161 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:41.960105    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b2d161a7-94f1-463b-8500-6fa1591a0a7b" (UID: "b2d161a7-94f1-463b-8500-6fa1591a0a7b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:30:41.960161 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:41.960129    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b2d161a7-94f1-463b-8500-6fa1591a0a7b" (UID: "b2d161a7-94f1-463b-8500-6fa1591a0a7b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:30:41.960257 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:41.960187    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-console-config" (OuterVolumeSpecName: "console-config") pod "b2d161a7-94f1-463b-8500-6fa1591a0a7b" (UID: "b2d161a7-94f1-463b-8500-6fa1591a0a7b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:30:41.962066 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:41.962043    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2d161a7-94f1-463b-8500-6fa1591a0a7b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b2d161a7-94f1-463b-8500-6fa1591a0a7b" (UID: "b2d161a7-94f1-463b-8500-6fa1591a0a7b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:30:41.962257 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:41.962238    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2d161a7-94f1-463b-8500-6fa1591a0a7b-kube-api-access-jbhhf" (OuterVolumeSpecName: "kube-api-access-jbhhf") pod "b2d161a7-94f1-463b-8500-6fa1591a0a7b" (UID: "b2d161a7-94f1-463b-8500-6fa1591a0a7b"). InnerVolumeSpecName "kube-api-access-jbhhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:30:41.962349 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:41.962262    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2d161a7-94f1-463b-8500-6fa1591a0a7b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b2d161a7-94f1-463b-8500-6fa1591a0a7b" (UID: "b2d161a7-94f1-463b-8500-6fa1591a0a7b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:30:42.060927 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:42.060893    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbhhf\" (UniqueName: \"kubernetes.io/projected/b2d161a7-94f1-463b-8500-6fa1591a0a7b-kube-api-access-jbhhf\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:30:42.060927 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:42.060924    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2d161a7-94f1-463b-8500-6fa1591a0a7b-console-serving-cert\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:30:42.060927 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:42.060934    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-oauth-serving-cert\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:30:42.061137 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:42.060942    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-trusted-ca-bundle\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:30:42.061137 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:42.060950    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2d161a7-94f1-463b-8500-6fa1591a0a7b-console-oauth-config\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:30:42.061137 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:42.060958    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2d161a7-94f1-463b-8500-6fa1591a0a7b-console-config\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:30:42.644820 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:42.644790    2558 generic.go:356] "Generic (PLEG): container finished" podID="b2d161a7-94f1-463b-8500-6fa1591a0a7b" containerID="f0070dff1d7bbaeb8075a2348796bf2bce158c1db6cb84e544195a594ecff2db" exitCode=0
Aug 04 18:30:42.645023 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:42.644836    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764b6fd88f-6l5bc"
Aug 04 18:30:42.645023 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:42.644857    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764b6fd88f-6l5bc" event={"ID":"b2d161a7-94f1-463b-8500-6fa1591a0a7b","Type":"ContainerDied","Data":"f0070dff1d7bbaeb8075a2348796bf2bce158c1db6cb84e544195a594ecff2db"}
Aug 04 18:30:42.645023 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:42.644897    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764b6fd88f-6l5bc" event={"ID":"b2d161a7-94f1-463b-8500-6fa1591a0a7b","Type":"ContainerDied","Data":"2181a8f10b9d1bec3869b30179abfe39c191f09bcf2474d93df20030fe3b4283"}
Aug 04 18:30:42.645023 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:42.644916    2558 scope.go:117] "RemoveContainer" containerID="f0070dff1d7bbaeb8075a2348796bf2bce158c1db6cb84e544195a594ecff2db"
Aug 04 18:30:42.652982 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:42.652964    2558 scope.go:117] "RemoveContainer" containerID="f0070dff1d7bbaeb8075a2348796bf2bce158c1db6cb84e544195a594ecff2db"
Aug 04 18:30:42.653219 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:30:42.653198    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0070dff1d7bbaeb8075a2348796bf2bce158c1db6cb84e544195a594ecff2db\": container with ID starting with f0070dff1d7bbaeb8075a2348796bf2bce158c1db6cb84e544195a594ecff2db not found: ID does not exist" containerID="f0070dff1d7bbaeb8075a2348796bf2bce158c1db6cb84e544195a594ecff2db"
Aug 04 18:30:42.653257 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:42.653228    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0070dff1d7bbaeb8075a2348796bf2bce158c1db6cb84e544195a594ecff2db"} err="failed to get container status \"f0070dff1d7bbaeb8075a2348796bf2bce158c1db6cb84e544195a594ecff2db\": rpc error: code = NotFound desc = could not find container \"f0070dff1d7bbaeb8075a2348796bf2bce158c1db6cb84e544195a594ecff2db\": container with ID starting with f0070dff1d7bbaeb8075a2348796bf2bce158c1db6cb84e544195a594ecff2db not found: ID does not exist"
Aug 04 18:30:42.664898 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:42.664871    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-764b6fd88f-6l5bc"]
Aug 04 18:30:42.669163 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:42.669145    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-764b6fd88f-6l5bc"]
Aug 04 18:30:43.962695 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:43.962659    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2d161a7-94f1-463b-8500-6fa1591a0a7b" path="/var/lib/kubelet/pods/b2d161a7-94f1-463b-8500-6fa1591a0a7b/volumes"
Aug 04 18:30:52.830708 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:52.830611    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:30:52.846498 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:52.846468    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:30:53.702647 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:30:53.702605    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:06.669728 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:06.669688    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:31:06.670107 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:06.670037    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="alertmanager" containerID="cri-o://6eded588164e9dc8a14551262ae9f4c3b3658a291a10ce86edc567b675613ab6" gracePeriod=120
Aug 04 18:31:06.670174 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:06.670109    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="kube-rbac-proxy-metric" containerID="cri-o://bbdd4a22eda5cd1503075b264c48ba003732bd37e32cc8ace60c63b3f7ee0546" gracePeriod=120
Aug 04 18:31:06.670250 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:06.670164    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="kube-rbac-proxy-web" containerID="cri-o://1cc306b8fa3e76196775356a8959085d24faa1653e8475436c84d817fbb333ea" gracePeriod=120
Aug 04 18:31:06.670250 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:06.670171    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="config-reloader" containerID="cri-o://3b637aa38ecf0b1b671fee3a782d757cab7da147cd123b7186761926a831ee5b" gracePeriod=120
Aug 04 18:31:06.670250 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:06.670209    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="kube-rbac-proxy" containerID="cri-o://25f785421479dbfd4017f781841c651b4c30ca7586754e13af8bdd31bd52b267" gracePeriod=120
Aug 04 18:31:06.670408 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:06.670127    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="prom-label-proxy" containerID="cri-o://92f1ec7cc1d90a30eb5963ff0fc747d1a67c4ff0c4fac0ed19b6aa060fd5202d" gracePeriod=120
Aug 04 18:31:07.747655 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.747601    2558 generic.go:356] "Generic (PLEG): container finished" podID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerID="92f1ec7cc1d90a30eb5963ff0fc747d1a67c4ff0c4fac0ed19b6aa060fd5202d" exitCode=0
Aug 04 18:31:07.747655 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.747625    2558 generic.go:356] "Generic (PLEG): container finished" podID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerID="25f785421479dbfd4017f781841c651b4c30ca7586754e13af8bdd31bd52b267" exitCode=0
Aug 04 18:31:07.747655 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.747654    2558 generic.go:356] "Generic (PLEG): container finished" podID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerID="3b637aa38ecf0b1b671fee3a782d757cab7da147cd123b7186761926a831ee5b" exitCode=0
Aug 04 18:31:07.747655 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.747661    2558 generic.go:356] "Generic (PLEG): container finished" podID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerID="6eded588164e9dc8a14551262ae9f4c3b3658a291a10ce86edc567b675613ab6" exitCode=0
Aug 04 18:31:07.748183 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.747668    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23eb1292-8b9b-4f61-a2b2-c1fda471a877","Type":"ContainerDied","Data":"92f1ec7cc1d90a30eb5963ff0fc747d1a67c4ff0c4fac0ed19b6aa060fd5202d"}
Aug 04 18:31:07.748183 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.747790    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23eb1292-8b9b-4f61-a2b2-c1fda471a877","Type":"ContainerDied","Data":"25f785421479dbfd4017f781841c651b4c30ca7586754e13af8bdd31bd52b267"}
Aug 04 18:31:07.748183 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.747839    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23eb1292-8b9b-4f61-a2b2-c1fda471a877","Type":"ContainerDied","Data":"3b637aa38ecf0b1b671fee3a782d757cab7da147cd123b7186761926a831ee5b"}
Aug 04 18:31:07.748183 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.747877    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23eb1292-8b9b-4f61-a2b2-c1fda471a877","Type":"ContainerDied","Data":"6eded588164e9dc8a14551262ae9f4c3b3658a291a10ce86edc567b675613ab6"}
Aug 04 18:31:07.909667 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.909623    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:07.989716 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.989688    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23eb1292-8b9b-4f61-a2b2-c1fda471a877-config-out\") pod \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") "
Aug 04 18:31:07.989877 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.989723    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-kube-rbac-proxy-metric\") pod \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") "
Aug 04 18:31:07.989877 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.989745    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jclzt\" (UniqueName: \"kubernetes.io/projected/23eb1292-8b9b-4f61-a2b2-c1fda471a877-kube-api-access-jclzt\") pod \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") "
Aug 04 18:31:07.989877 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.989765    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23eb1292-8b9b-4f61-a2b2-c1fda471a877-alertmanager-trusted-ca-bundle\") pod \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") "
Aug 04 18:31:07.989877 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.989792    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-cluster-tls-config\") pod \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") "
Aug 04 18:31:07.990102 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.989924    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23eb1292-8b9b-4f61-a2b2-c1fda471a877-tls-assets\") pod \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") "
Aug 04 18:31:07.990102 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.989966    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-web-config\") pod \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") "
Aug 04 18:31:07.990102 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.990029    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-kube-rbac-proxy\") pod \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") "
Aug 04 18:31:07.990102 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.990074    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-main-tls\") pod \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") "
Aug 04 18:31:07.990333 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.990128    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-kube-rbac-proxy-web\") pod \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") "
Aug 04 18:31:07.990333 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.990165    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-config-volume\") pod \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") "
Aug 04 18:31:07.990333 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.990203    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23eb1292-8b9b-4f61-a2b2-c1fda471a877-metrics-client-ca\") pod \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") "
Aug 04 18:31:07.990333 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.990215    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23eb1292-8b9b-4f61-a2b2-c1fda471a877-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "23eb1292-8b9b-4f61-a2b2-c1fda471a877" (UID: "23eb1292-8b9b-4f61-a2b2-c1fda471a877"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:31:07.990333 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.990256    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/23eb1292-8b9b-4f61-a2b2-c1fda471a877-alertmanager-main-db\") pod \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\" (UID: \"23eb1292-8b9b-4f61-a2b2-c1fda471a877\") "
Aug 04 18:31:07.990550 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.990525    2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23eb1292-8b9b-4f61-a2b2-c1fda471a877-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:07.991148 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.990827    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23eb1292-8b9b-4f61-a2b2-c1fda471a877-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "23eb1292-8b9b-4f61-a2b2-c1fda471a877" (UID: "23eb1292-8b9b-4f61-a2b2-c1fda471a877"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:31:07.991148 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.991055    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23eb1292-8b9b-4f61-a2b2-c1fda471a877-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "23eb1292-8b9b-4f61-a2b2-c1fda471a877" (UID: "23eb1292-8b9b-4f61-a2b2-c1fda471a877"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:31:07.993627 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.993602    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-config-volume" (OuterVolumeSpecName: "config-volume") pod "23eb1292-8b9b-4f61-a2b2-c1fda471a877" (UID: "23eb1292-8b9b-4f61-a2b2-c1fda471a877"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:31:07.994313 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.994274    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23eb1292-8b9b-4f61-a2b2-c1fda471a877-kube-api-access-jclzt" (OuterVolumeSpecName: "kube-api-access-jclzt") pod "23eb1292-8b9b-4f61-a2b2-c1fda471a877" (UID: "23eb1292-8b9b-4f61-a2b2-c1fda471a877"). InnerVolumeSpecName "kube-api-access-jclzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:31:07.994568 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.994542    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "23eb1292-8b9b-4f61-a2b2-c1fda471a877" (UID: "23eb1292-8b9b-4f61-a2b2-c1fda471a877"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:31:07.994876 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.994841    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23eb1292-8b9b-4f61-a2b2-c1fda471a877-config-out" (OuterVolumeSpecName: "config-out") pod "23eb1292-8b9b-4f61-a2b2-c1fda471a877" (UID: "23eb1292-8b9b-4f61-a2b2-c1fda471a877"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:31:07.994876 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.994862    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "23eb1292-8b9b-4f61-a2b2-c1fda471a877" (UID: "23eb1292-8b9b-4f61-a2b2-c1fda471a877"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:31:07.995100 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.995078    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23eb1292-8b9b-4f61-a2b2-c1fda471a877-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "23eb1292-8b9b-4f61-a2b2-c1fda471a877" (UID: "23eb1292-8b9b-4f61-a2b2-c1fda471a877"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:31:07.995242 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.995219    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "23eb1292-8b9b-4f61-a2b2-c1fda471a877" (UID: "23eb1292-8b9b-4f61-a2b2-c1fda471a877"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:31:07.995355 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.995265    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "23eb1292-8b9b-4f61-a2b2-c1fda471a877" (UID: "23eb1292-8b9b-4f61-a2b2-c1fda471a877"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:31:07.998295 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:07.998239    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "23eb1292-8b9b-4f61-a2b2-c1fda471a877" (UID: "23eb1292-8b9b-4f61-a2b2-c1fda471a877"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:31:08.004787 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.004762    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-web-config" (OuterVolumeSpecName: "web-config") pod "23eb1292-8b9b-4f61-a2b2-c1fda471a877" (UID: "23eb1292-8b9b-4f61-a2b2-c1fda471a877"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:31:08.091405 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.091369    2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23eb1292-8b9b-4f61-a2b2-c1fda471a877-config-out\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:08.091405 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.091403    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:08.091557 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.091420    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jclzt\" (UniqueName: \"kubernetes.io/projected/23eb1292-8b9b-4f61-a2b2-c1fda471a877-kube-api-access-jclzt\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:08.091557 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.091437    2558 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-cluster-tls-config\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:08.091557 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.091447    2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23eb1292-8b9b-4f61-a2b2-c1fda471a877-tls-assets\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:08.091557 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.091457    2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-web-config\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:08.091557 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.091466    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:08.091557 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.091476    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-main-tls\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:08.091557 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.091484    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:08.091557 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.091492    2558 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/23eb1292-8b9b-4f61-a2b2-c1fda471a877-config-volume\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:08.091557 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.091500    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23eb1292-8b9b-4f61-a2b2-c1fda471a877-metrics-client-ca\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:08.091557 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.091515    2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/23eb1292-8b9b-4f61-a2b2-c1fda471a877-alertmanager-main-db\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:08.754976 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.754943    2558 generic.go:356] "Generic (PLEG): container finished" podID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerID="bbdd4a22eda5cd1503075b264c48ba003732bd37e32cc8ace60c63b3f7ee0546" exitCode=0
Aug 04 18:31:08.754976 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.754967    2558 generic.go:356] "Generic (PLEG): container finished" podID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerID="1cc306b8fa3e76196775356a8959085d24faa1653e8475436c84d817fbb333ea" exitCode=0
Aug 04 18:31:08.755435 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.754997    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23eb1292-8b9b-4f61-a2b2-c1fda471a877","Type":"ContainerDied","Data":"bbdd4a22eda5cd1503075b264c48ba003732bd37e32cc8ace60c63b3f7ee0546"}
Aug 04 18:31:08.755435 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.755017    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:31:08.755435 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.755052    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23eb1292-8b9b-4f61-a2b2-c1fda471a877","Type":"ContainerDied","Data":"1cc306b8fa3e76196775356a8959085d24faa1653e8475436c84d817fbb333ea"}
Aug 04 18:31:08.755435 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.755079    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23eb1292-8b9b-4f61-a2b2-c1fda471a877","Type":"ContainerDied","Data":"06517cd6a28f17baec8839566d03df61c333033af9fe9dd15db21b790d76125b"}
Aug 04 18:31:08.755435 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.755108    2558 scope.go:117] "RemoveContainer" containerID="92f1ec7cc1d90a30eb5963ff0fc747d1a67c4ff0c4fac0ed19b6aa060fd5202d"
Aug 04 18:31:08.769401 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.769379    2558 scope.go:117] "RemoveContainer" containerID="bbdd4a22eda5cd1503075b264c48ba003732bd37e32cc8ace60c63b3f7ee0546"
Aug 04 18:31:08.776326 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.776306    2558 scope.go:117] "RemoveContainer" containerID="25f785421479dbfd4017f781841c651b4c30ca7586754e13af8bdd31bd52b267"
Aug 04 18:31:08.783407 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.783365    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:31:08.784507 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.784482    2558 scope.go:117] "RemoveContainer" containerID="1cc306b8fa3e76196775356a8959085d24faa1653e8475436c84d817fbb333ea"
Aug 04 18:31:08.787588 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.787567    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:31:08.791492 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.791476    2558 scope.go:117] "RemoveContainer" containerID="3b637aa38ecf0b1b671fee3a782d757cab7da147cd123b7186761926a831ee5b"
Aug 04 18:31:08.798481 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.798455    2558 scope.go:117] "RemoveContainer" containerID="6eded588164e9dc8a14551262ae9f4c3b3658a291a10ce86edc567b675613ab6"
Aug 04 18:31:08.805308 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.805290    2558 scope.go:117] "RemoveContainer" containerID="ac4398b3f1bc2f37742b8d6ec9676368fa9c5728b4cb0e4385faea209caf1454"
Aug 04 18:31:08.811940 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.811922    2558 scope.go:117] "RemoveContainer" containerID="92f1ec7cc1d90a30eb5963ff0fc747d1a67c4ff0c4fac0ed19b6aa060fd5202d"
Aug 04 18:31:08.812166 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:31:08.812148    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92f1ec7cc1d90a30eb5963ff0fc747d1a67c4ff0c4fac0ed19b6aa060fd5202d\": container with ID starting with 92f1ec7cc1d90a30eb5963ff0fc747d1a67c4ff0c4fac0ed19b6aa060fd5202d not found: ID does not exist" containerID="92f1ec7cc1d90a30eb5963ff0fc747d1a67c4ff0c4fac0ed19b6aa060fd5202d"
Aug 04 18:31:08.812215 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.812175    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92f1ec7cc1d90a30eb5963ff0fc747d1a67c4ff0c4fac0ed19b6aa060fd5202d"} err="failed to get container status \"92f1ec7cc1d90a30eb5963ff0fc747d1a67c4ff0c4fac0ed19b6aa060fd5202d\": rpc error: code = NotFound desc = could not find container \"92f1ec7cc1d90a30eb5963ff0fc747d1a67c4ff0c4fac0ed19b6aa060fd5202d\": container with ID starting with 92f1ec7cc1d90a30eb5963ff0fc747d1a67c4ff0c4fac0ed19b6aa060fd5202d not found: ID does not exist"
Aug 04 18:31:08.812215 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.812197    2558 scope.go:117] "RemoveContainer" containerID="bbdd4a22eda5cd1503075b264c48ba003732bd37e32cc8ace60c63b3f7ee0546"
Aug 04 18:31:08.812408 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:31:08.812388    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbdd4a22eda5cd1503075b264c48ba003732bd37e32cc8ace60c63b3f7ee0546\": container with ID starting with bbdd4a22eda5cd1503075b264c48ba003732bd37e32cc8ace60c63b3f7ee0546 not found: ID does not exist" containerID="bbdd4a22eda5cd1503075b264c48ba003732bd37e32cc8ace60c63b3f7ee0546"
Aug 04 18:31:08.812446 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.812414    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbdd4a22eda5cd1503075b264c48ba003732bd37e32cc8ace60c63b3f7ee0546"} err="failed to get container status \"bbdd4a22eda5cd1503075b264c48ba003732bd37e32cc8ace60c63b3f7ee0546\": rpc error: code = NotFound desc = could not find container \"bbdd4a22eda5cd1503075b264c48ba003732bd37e32cc8ace60c63b3f7ee0546\": container with ID starting with bbdd4a22eda5cd1503075b264c48ba003732bd37e32cc8ace60c63b3f7ee0546 not found: ID does not exist"
Aug 04 18:31:08.812446 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.812432    2558 scope.go:117] "RemoveContainer" containerID="25f785421479dbfd4017f781841c651b4c30ca7586754e13af8bdd31bd52b267"
Aug 04 18:31:08.812622 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:31:08.812608    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25f785421479dbfd4017f781841c651b4c30ca7586754e13af8bdd31bd52b267\": container with ID starting with 25f785421479dbfd4017f781841c651b4c30ca7586754e13af8bdd31bd52b267 not found: ID does not exist" containerID="25f785421479dbfd4017f781841c651b4c30ca7586754e13af8bdd31bd52b267"
Aug 04 18:31:08.812682 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.812627    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25f785421479dbfd4017f781841c651b4c30ca7586754e13af8bdd31bd52b267"} err="failed to get container status \"25f785421479dbfd4017f781841c651b4c30ca7586754e13af8bdd31bd52b267\": rpc error: code = NotFound desc = could not find container \"25f785421479dbfd4017f781841c651b4c30ca7586754e13af8bdd31bd52b267\": container with ID starting with 25f785421479dbfd4017f781841c651b4c30ca7586754e13af8bdd31bd52b267 not found: ID does not exist"
Aug 04 18:31:08.812682 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.812655    2558 scope.go:117] "RemoveContainer" containerID="1cc306b8fa3e76196775356a8959085d24faa1653e8475436c84d817fbb333ea"
Aug 04 18:31:08.812895 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:31:08.812879    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cc306b8fa3e76196775356a8959085d24faa1653e8475436c84d817fbb333ea\": container with ID starting with 1cc306b8fa3e76196775356a8959085d24faa1653e8475436c84d817fbb333ea not found: ID does not exist" containerID="1cc306b8fa3e76196775356a8959085d24faa1653e8475436c84d817fbb333ea"
Aug 04 18:31:08.812934 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.812900    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cc306b8fa3e76196775356a8959085d24faa1653e8475436c84d817fbb333ea"} err="failed to get container status \"1cc306b8fa3e76196775356a8959085d24faa1653e8475436c84d817fbb333ea\": rpc error: code = NotFound desc = could not find container \"1cc306b8fa3e76196775356a8959085d24faa1653e8475436c84d817fbb333ea\": container with ID starting with 1cc306b8fa3e76196775356a8959085d24faa1653e8475436c84d817fbb333ea not found: ID does not exist"
Aug 04 18:31:08.812934 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.812914    2558 scope.go:117] "RemoveContainer" containerID="3b637aa38ecf0b1b671fee3a782d757cab7da147cd123b7186761926a831ee5b"
Aug 04 18:31:08.813122 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:31:08.813106    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b637aa38ecf0b1b671fee3a782d757cab7da147cd123b7186761926a831ee5b\": container with ID starting with 3b637aa38ecf0b1b671fee3a782d757cab7da147cd123b7186761926a831ee5b not found: ID does not exist" containerID="3b637aa38ecf0b1b671fee3a782d757cab7da147cd123b7186761926a831ee5b"
Aug 04 18:31:08.813163 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.813124    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b637aa38ecf0b1b671fee3a782d757cab7da147cd123b7186761926a831ee5b"} err="failed to get container status \"3b637aa38ecf0b1b671fee3a782d757cab7da147cd123b7186761926a831ee5b\": rpc error: code = NotFound desc = could not find container \"3b637aa38ecf0b1b671fee3a782d757cab7da147cd123b7186761926a831ee5b\": container with ID starting with 3b637aa38ecf0b1b671fee3a782d757cab7da147cd123b7186761926a831ee5b not found: ID does not exist"
Aug 04 18:31:08.813163 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.813138    2558 scope.go:117] "RemoveContainer" containerID="6eded588164e9dc8a14551262ae9f4c3b3658a291a10ce86edc567b675613ab6"
Aug 04 18:31:08.813338 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:31:08.813325    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6eded588164e9dc8a14551262ae9f4c3b3658a291a10ce86edc567b675613ab6\": container with ID starting with 6eded588164e9dc8a14551262ae9f4c3b3658a291a10ce86edc567b675613ab6 not found: ID does not exist" containerID="6eded588164e9dc8a14551262ae9f4c3b3658a291a10ce86edc567b675613ab6"
Aug 04 18:31:08.813380 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.813340    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eded588164e9dc8a14551262ae9f4c3b3658a291a10ce86edc567b675613ab6"} err="failed to get container status \"6eded588164e9dc8a14551262ae9f4c3b3658a291a10ce86edc567b675613ab6\": rpc error: code = NotFound desc = could not find container \"6eded588164e9dc8a14551262ae9f4c3b3658a291a10ce86edc567b675613ab6\": container with ID starting with 6eded588164e9dc8a14551262ae9f4c3b3658a291a10ce86edc567b675613ab6 not found: ID does not exist"
Aug 04 18:31:08.813380 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.813351    2558 scope.go:117] "RemoveContainer" containerID="ac4398b3f1bc2f37742b8d6ec9676368fa9c5728b4cb0e4385faea209caf1454"
Aug 04 18:31:08.813597 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:31:08.813578    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac4398b3f1bc2f37742b8d6ec9676368fa9c5728b4cb0e4385faea209caf1454\": container with ID starting with ac4398b3f1bc2f37742b8d6ec9676368fa9c5728b4cb0e4385faea209caf1454 not found: ID does not exist" containerID="ac4398b3f1bc2f37742b8d6ec9676368fa9c5728b4cb0e4385faea209caf1454"
Aug 04 18:31:08.813669 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.813601    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac4398b3f1bc2f37742b8d6ec9676368fa9c5728b4cb0e4385faea209caf1454"} err="failed to get container status \"ac4398b3f1bc2f37742b8d6ec9676368fa9c5728b4cb0e4385faea209caf1454\": rpc error: code = NotFound desc = could not find container \"ac4398b3f1bc2f37742b8d6ec9676368fa9c5728b4cb0e4385faea209caf1454\": container with ID starting with ac4398b3f1bc2f37742b8d6ec9676368fa9c5728b4cb0e4385faea209caf1454 not found: ID does not exist"
Aug 04 18:31:08.813669 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.813614    2558 scope.go:117] "RemoveContainer" containerID="92f1ec7cc1d90a30eb5963ff0fc747d1a67c4ff0c4fac0ed19b6aa060fd5202d"
Aug 04 18:31:08.813906 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.813889    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92f1ec7cc1d90a30eb5963ff0fc747d1a67c4ff0c4fac0ed19b6aa060fd5202d"} err="failed to get container status \"92f1ec7cc1d90a30eb5963ff0fc747d1a67c4ff0c4fac0ed19b6aa060fd5202d\": rpc error: code = NotFound desc = could not find container \"92f1ec7cc1d90a30eb5963ff0fc747d1a67c4ff0c4fac0ed19b6aa060fd5202d\": container with ID starting with 92f1ec7cc1d90a30eb5963ff0fc747d1a67c4ff0c4fac0ed19b6aa060fd5202d not found: ID does not exist"
Aug 04 18:31:08.813962 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.813907    2558 scope.go:117] "RemoveContainer" containerID="bbdd4a22eda5cd1503075b264c48ba003732bd37e32cc8ace60c63b3f7ee0546"
Aug 04 18:31:08.814122 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.814105    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbdd4a22eda5cd1503075b264c48ba003732bd37e32cc8ace60c63b3f7ee0546"} err="failed to get container status \"bbdd4a22eda5cd1503075b264c48ba003732bd37e32cc8ace60c63b3f7ee0546\": rpc error: code = NotFound desc = could not find container \"bbdd4a22eda5cd1503075b264c48ba003732bd37e32cc8ace60c63b3f7ee0546\": container with ID starting with bbdd4a22eda5cd1503075b264c48ba003732bd37e32cc8ace60c63b3f7ee0546 not found: ID does not exist"
Aug 04 18:31:08.814167 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.814122    2558 scope.go:117] "RemoveContainer" containerID="25f785421479dbfd4017f781841c651b4c30ca7586754e13af8bdd31bd52b267"
Aug 04 18:31:08.814370 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.814354    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25f785421479dbfd4017f781841c651b4c30ca7586754e13af8bdd31bd52b267"} err="failed to get container status \"25f785421479dbfd4017f781841c651b4c30ca7586754e13af8bdd31bd52b267\": rpc error: code = NotFound desc = could not find container \"25f785421479dbfd4017f781841c651b4c30ca7586754e13af8bdd31bd52b267\": container with ID starting with 25f785421479dbfd4017f781841c651b4c30ca7586754e13af8bdd31bd52b267 not found: ID does not exist"
Aug 04 18:31:08.814416 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.814370    2558 scope.go:117] "RemoveContainer" containerID="1cc306b8fa3e76196775356a8959085d24faa1653e8475436c84d817fbb333ea"
Aug 04 18:31:08.814581 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.814558    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cc306b8fa3e76196775356a8959085d24faa1653e8475436c84d817fbb333ea"} err="failed to get container status \"1cc306b8fa3e76196775356a8959085d24faa1653e8475436c84d817fbb333ea\": rpc error: code = NotFound desc = could not find container \"1cc306b8fa3e76196775356a8959085d24faa1653e8475436c84d817fbb333ea\": container with ID starting with 1cc306b8fa3e76196775356a8959085d24faa1653e8475436c84d817fbb333ea not found: ID does not exist"
Aug 04 18:31:08.814581 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.814580    2558 scope.go:117] "RemoveContainer" containerID="3b637aa38ecf0b1b671fee3a782d757cab7da147cd123b7186761926a831ee5b"
Aug 04 18:31:08.814866 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.814831    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b637aa38ecf0b1b671fee3a782d757cab7da147cd123b7186761926a831ee5b"} err="failed to get container status \"3b637aa38ecf0b1b671fee3a782d757cab7da147cd123b7186761926a831ee5b\": rpc error: code = NotFound desc = could not find container \"3b637aa38ecf0b1b671fee3a782d757cab7da147cd123b7186761926a831ee5b\": container with ID starting with 3b637aa38ecf0b1b671fee3a782d757cab7da147cd123b7186761926a831ee5b not found: ID does not exist"
Aug 04 18:31:08.814866 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.814857    2558 scope.go:117] "RemoveContainer" containerID="6eded588164e9dc8a14551262ae9f4c3b3658a291a10ce86edc567b675613ab6"
Aug 04 18:31:08.815184 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.815158    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eded588164e9dc8a14551262ae9f4c3b3658a291a10ce86edc567b675613ab6"} err="failed to get container status \"6eded588164e9dc8a14551262ae9f4c3b3658a291a10ce86edc567b675613ab6\": rpc error: code = NotFound desc = could not find container \"6eded588164e9dc8a14551262ae9f4c3b3658a291a10ce86edc567b675613ab6\": container with ID starting with 6eded588164e9dc8a14551262ae9f4c3b3658a291a10ce86edc567b675613ab6 not found: ID does not exist"
Aug 04 18:31:08.815259 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.815185    2558 scope.go:117] "RemoveContainer" containerID="ac4398b3f1bc2f37742b8d6ec9676368fa9c5728b4cb0e4385faea209caf1454"
Aug 04 18:31:08.815520 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:08.815496    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac4398b3f1bc2f37742b8d6ec9676368fa9c5728b4cb0e4385faea209caf1454"} err="failed to get container status \"ac4398b3f1bc2f37742b8d6ec9676368fa9c5728b4cb0e4385faea209caf1454\": rpc error: code = NotFound desc = could not find container \"ac4398b3f1bc2f37742b8d6ec9676368fa9c5728b4cb0e4385faea209caf1454\": container with ID starting with ac4398b3f1bc2f37742b8d6ec9676368fa9c5728b4cb0e4385faea209caf1454 not found: ID does not exist"
Aug 04 18:31:09.962627 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:09.962594    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" path="/var/lib/kubelet/pods/23eb1292-8b9b-4f61-a2b2-c1fda471a877/volumes"
Aug 04 18:31:11.005802 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.005761    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:31:11.006247 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.006061    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="prometheus" containerID="cri-o://fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352" gracePeriod=600
Aug 04 18:31:11.006247 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.006073    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="kube-rbac-proxy" containerID="cri-o://cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5" gracePeriod=600
Aug 04 18:31:11.006247 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.006102    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="thanos-sidecar" containerID="cri-o://70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76" gracePeriod=600
Aug 04 18:31:11.006247 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.006124    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="kube-rbac-proxy-web" containerID="cri-o://ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff" gracePeriod=600
Aug 04 18:31:11.006247 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.006136    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="kube-rbac-proxy-thanos" containerID="cri-o://ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de" gracePeriod=600
Aug 04 18:31:11.006247 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.006147    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="config-reloader" containerID="cri-o://898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d" gracePeriod=600
Aug 04 18:31:11.247338 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.247313    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.319735 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.319649    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-configmap-serving-certs-ca-bundle\") pod \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") "
Aug 04 18:31:11.319735 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.319716    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-rulefiles-1\") pod \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") "
Aug 04 18:31:11.319956 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.319747    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-rulefiles-0\") pod \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") "
Aug 04 18:31:11.319956 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.319909    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c4f5f23-27ad-46f8-b298-da2e463dbb76-config-out\") pod \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") "
Aug 04 18:31:11.319956 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.319950    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-config\") pod \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") "
Aug 04 18:31:11.320102 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.319978    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") "
Aug 04 18:31:11.320102 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.320004    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-prometheus-k8s-tls\") pod \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") "
Aug 04 18:31:11.320102 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.320033    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "7c4f5f23-27ad-46f8-b298-da2e463dbb76" (UID: "7c4f5f23-27ad-46f8-b298-da2e463dbb76"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:31:11.320102 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.320039    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-configmap-kubelet-serving-ca-bundle\") pod \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") "
Aug 04 18:31:11.320102 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.320077    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "7c4f5f23-27ad-46f8-b298-da2e463dbb76" (UID: "7c4f5f23-27ad-46f8-b298-da2e463dbb76"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:31:11.320334 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.320087    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4z47\" (UniqueName: \"kubernetes.io/projected/7c4f5f23-27ad-46f8-b298-da2e463dbb76-kube-api-access-x4z47\") pod \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") "
Aug 04 18:31:11.320334 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.320158    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-web-config\") pod \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") "
Aug 04 18:31:11.320334 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.320186    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-kube-rbac-proxy\") pod \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") "
Aug 04 18:31:11.320479 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.320348    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c4f5f23-27ad-46f8-b298-da2e463dbb76-tls-assets\") pod \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") "
Aug 04 18:31:11.320479 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.320378    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "7c4f5f23-27ad-46f8-b298-da2e463dbb76" (UID: "7c4f5f23-27ad-46f8-b298-da2e463dbb76"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:31:11.320479 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.320398    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-metrics-client-certs\") pod \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") "
Aug 04 18:31:11.320479 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.320427    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-configmap-metrics-client-ca\") pod \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") "
Aug 04 18:31:11.320479 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.320470    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-db\") pod \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") "
Aug 04 18:31:11.320733 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.320494    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-trusted-ca-bundle\") pod \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") "
Aug 04 18:31:11.320733 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.320522    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") "
Aug 04 18:31:11.320733 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.320572    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-rulefiles-2\") pod \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") "
Aug 04 18:31:11.320733 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.320601    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-thanos-prometheus-http-client-file\") pod \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") "
Aug 04 18:31:11.320733 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.320650    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-grpc-tls\") pod \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\" (UID: \"7c4f5f23-27ad-46f8-b298-da2e463dbb76\") "
Aug 04 18:31:11.320958 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.320852    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "7c4f5f23-27ad-46f8-b298-da2e463dbb76" (UID: "7c4f5f23-27ad-46f8-b298-da2e463dbb76"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:31:11.320958 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.320936    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:11.320958 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.320954    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:11.321108 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.320969    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:11.321108 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.320984    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:11.322532 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.322140    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "7c4f5f23-27ad-46f8-b298-da2e463dbb76" (UID: "7c4f5f23-27ad-46f8-b298-da2e463dbb76"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:31:11.322532 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.322200    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "7c4f5f23-27ad-46f8-b298-da2e463dbb76" (UID: "7c4f5f23-27ad-46f8-b298-da2e463dbb76"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:31:11.322733 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.322572    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "7c4f5f23-27ad-46f8-b298-da2e463dbb76" (UID: "7c4f5f23-27ad-46f8-b298-da2e463dbb76"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:31:11.322945 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.322909    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "7c4f5f23-27ad-46f8-b298-da2e463dbb76" (UID: "7c4f5f23-27ad-46f8-b298-da2e463dbb76"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:31:11.323915 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.323885    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c4f5f23-27ad-46f8-b298-da2e463dbb76-kube-api-access-x4z47" (OuterVolumeSpecName: "kube-api-access-x4z47") pod "7c4f5f23-27ad-46f8-b298-da2e463dbb76" (UID: "7c4f5f23-27ad-46f8-b298-da2e463dbb76"). InnerVolumeSpecName "kube-api-access-x4z47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:31:11.323915 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.323891    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "7c4f5f23-27ad-46f8-b298-da2e463dbb76" (UID: "7c4f5f23-27ad-46f8-b298-da2e463dbb76"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:31:11.324251 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.324220    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "7c4f5f23-27ad-46f8-b298-da2e463dbb76" (UID: "7c4f5f23-27ad-46f8-b298-da2e463dbb76"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:31:11.324390 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.324298    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "7c4f5f23-27ad-46f8-b298-da2e463dbb76" (UID: "7c4f5f23-27ad-46f8-b298-da2e463dbb76"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:31:11.324458 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.324390    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c4f5f23-27ad-46f8-b298-da2e463dbb76-config-out" (OuterVolumeSpecName: "config-out") pod "7c4f5f23-27ad-46f8-b298-da2e463dbb76" (UID: "7c4f5f23-27ad-46f8-b298-da2e463dbb76"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:31:11.324730 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.324705    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "7c4f5f23-27ad-46f8-b298-da2e463dbb76" (UID: "7c4f5f23-27ad-46f8-b298-da2e463dbb76"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:31:11.325260 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.325228    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "7c4f5f23-27ad-46f8-b298-da2e463dbb76" (UID: "7c4f5f23-27ad-46f8-b298-da2e463dbb76"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:31:11.325260 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.325244    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "7c4f5f23-27ad-46f8-b298-da2e463dbb76" (UID: "7c4f5f23-27ad-46f8-b298-da2e463dbb76"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:31:11.325626 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.325607    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "7c4f5f23-27ad-46f8-b298-da2e463dbb76" (UID: "7c4f5f23-27ad-46f8-b298-da2e463dbb76"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:31:11.325813 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.325791    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c4f5f23-27ad-46f8-b298-da2e463dbb76-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7c4f5f23-27ad-46f8-b298-da2e463dbb76" (UID: "7c4f5f23-27ad-46f8-b298-da2e463dbb76"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:31:11.326074 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.326054    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-config" (OuterVolumeSpecName: "config") pod "7c4f5f23-27ad-46f8-b298-da2e463dbb76" (UID: "7c4f5f23-27ad-46f8-b298-da2e463dbb76"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:31:11.334480 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.334458    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-web-config" (OuterVolumeSpecName: "web-config") pod "7c4f5f23-27ad-46f8-b298-da2e463dbb76" (UID: "7c4f5f23-27ad-46f8-b298-da2e463dbb76"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:31:11.421719 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.421680    2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c4f5f23-27ad-46f8-b298-da2e463dbb76-config-out\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:11.421719 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.421711    2558 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-config\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:11.421719 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.421728    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:11.421974 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.421741    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:11.421974 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.421754    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4z47\" (UniqueName: \"kubernetes.io/projected/7c4f5f23-27ad-46f8-b298-da2e463dbb76-kube-api-access-x4z47\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:11.421974 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.421766    2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-web-config\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:11.421974 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.421778    2558 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-kube-rbac-proxy\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:11.421974 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.421788    2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c4f5f23-27ad-46f8-b298-da2e463dbb76-tls-assets\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:11.421974 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.421799    2558 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-metrics-client-certs\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:11.421974 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.421813    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-configmap-metrics-client-ca\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:11.421974 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.421827    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-db\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:11.421974 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.421839    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:11.421974 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.421852    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:11.421974 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.421864    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7c4f5f23-27ad-46f8-b298-da2e463dbb76-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:11.421974 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.421875    2558 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:11.421974 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.421888    2558 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c4f5f23-27ad-46f8-b298-da2e463dbb76-secret-grpc-tls\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:11.773181 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.773147    2558 generic.go:356] "Generic (PLEG): container finished" podID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerID="ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de" exitCode=0
Aug 04 18:31:11.773181 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.773170    2558 generic.go:356] "Generic (PLEG): container finished" podID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerID="cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5" exitCode=0
Aug 04 18:31:11.773181 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.773179    2558 generic.go:356] "Generic (PLEG): container finished" podID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerID="ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff" exitCode=0
Aug 04 18:31:11.773181 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.773187    2558 generic.go:356] "Generic (PLEG): container finished" podID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerID="70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76" exitCode=0
Aug 04 18:31:11.773181 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.773194    2558 generic.go:356] "Generic (PLEG): container finished" podID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerID="898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d" exitCode=0
Aug 04 18:31:11.773571 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.773201    2558 generic.go:356] "Generic (PLEG): container finished" podID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerID="fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352" exitCode=0
Aug 04 18:31:11.773571 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.773223    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c4f5f23-27ad-46f8-b298-da2e463dbb76","Type":"ContainerDied","Data":"ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de"}
Aug 04 18:31:11.773571 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.773295    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c4f5f23-27ad-46f8-b298-da2e463dbb76","Type":"ContainerDied","Data":"cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5"}
Aug 04 18:31:11.773571 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.773226    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.773571 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.773336    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c4f5f23-27ad-46f8-b298-da2e463dbb76","Type":"ContainerDied","Data":"ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff"}
Aug 04 18:31:11.773571 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.773373    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c4f5f23-27ad-46f8-b298-da2e463dbb76","Type":"ContainerDied","Data":"70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76"}
Aug 04 18:31:11.773571 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.773391    2558 scope.go:117] "RemoveContainer" containerID="ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de"
Aug 04 18:31:11.773571 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.773412    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c4f5f23-27ad-46f8-b298-da2e463dbb76","Type":"ContainerDied","Data":"898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d"}
Aug 04 18:31:11.773571 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.773453    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c4f5f23-27ad-46f8-b298-da2e463dbb76","Type":"ContainerDied","Data":"fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352"}
Aug 04 18:31:11.773571 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.773492    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c4f5f23-27ad-46f8-b298-da2e463dbb76","Type":"ContainerDied","Data":"b0360691118dce34d79583fe3a243d5d3b07fc6013f6cf4b7bff653c74d8355e"}
Aug 04 18:31:11.781034 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.781015    2558 scope.go:117] "RemoveContainer" containerID="cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5"
Aug 04 18:31:11.787980 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.787948    2558 scope.go:117] "RemoveContainer" containerID="ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff"
Aug 04 18:31:11.794887 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.794872    2558 scope.go:117] "RemoveContainer" containerID="70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76"
Aug 04 18:31:11.800227 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.800205    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:31:11.802619 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.802604    2558 scope.go:117] "RemoveContainer" containerID="898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d"
Aug 04 18:31:11.808732 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.808711    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:31:11.809918 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.809903    2558 scope.go:117] "RemoveContainer" containerID="fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352"
Aug 04 18:31:11.817373 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.817357    2558 scope.go:117] "RemoveContainer" containerID="b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7"
Aug 04 18:31:11.824213 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.824196    2558 scope.go:117] "RemoveContainer" containerID="ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de"
Aug 04 18:31:11.824512 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:31:11.824484    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de\": container with ID starting with ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de not found: ID does not exist" containerID="ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de"
Aug 04 18:31:11.824563 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.824513    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de"} err="failed to get container status \"ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de\": rpc error: code = NotFound desc = could not find container \"ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de\": container with ID starting with ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de not found: ID does not exist"
Aug 04 18:31:11.824563 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.824534    2558 scope.go:117] "RemoveContainer" containerID="cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5"
Aug 04 18:31:11.824812 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:31:11.824791    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5\": container with ID starting with cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5 not found: ID does not exist" containerID="cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5"
Aug 04 18:31:11.824858 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.824818    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5"} err="failed to get container status \"cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5\": rpc error: code = NotFound desc = could not find container \"cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5\": container with ID starting with cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5 not found: ID does not exist"
Aug 04 18:31:11.824858 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.824835    2558 scope.go:117] "RemoveContainer" containerID="ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff"
Aug 04 18:31:11.825077 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:31:11.825062    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff\": container with ID starting with ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff not found: ID does not exist" containerID="ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff"
Aug 04 18:31:11.825117 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.825080    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff"} err="failed to get container status \"ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff\": rpc error: code = NotFound desc = could not find container \"ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff\": container with ID starting with ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff not found: ID does not exist"
Aug 04 18:31:11.825117 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.825092    2558 scope.go:117] "RemoveContainer" containerID="70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76"
Aug 04 18:31:11.825307 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:31:11.825291    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76\": container with ID starting with 70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76 not found: ID does not exist" containerID="70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76"
Aug 04 18:31:11.825349 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.825311    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76"} err="failed to get container status \"70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76\": rpc error: code = NotFound desc = could not find container \"70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76\": container with ID starting with 70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76 not found: ID does not exist"
Aug 04 18:31:11.825349 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.825325    2558 scope.go:117] "RemoveContainer" containerID="898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d"
Aug 04 18:31:11.825519 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:31:11.825502    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d\": container with ID starting with 898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d not found: ID does not exist" containerID="898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d"
Aug 04 18:31:11.825561 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.825523    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d"} err="failed to get container status \"898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d\": rpc error: code = NotFound desc = could not find container \"898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d\": container with ID starting with 898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d not found: ID does not exist"
Aug 04 18:31:11.825561 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.825538    2558 scope.go:117] "RemoveContainer" containerID="fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352"
Aug 04 18:31:11.825786 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:31:11.825769    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352\": container with ID starting with fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352 not found: ID does not exist" containerID="fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352"
Aug 04 18:31:11.825830 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.825791    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352"} err="failed to get container status \"fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352\": rpc error: code = NotFound desc = could not find container \"fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352\": container with ID starting with fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352 not found: ID does not exist"
Aug 04 18:31:11.825830 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.825803    2558 scope.go:117] "RemoveContainer" containerID="b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7"
Aug 04 18:31:11.826015 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:31:11.826000    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7\": container with ID starting with b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7 not found: ID does not exist" containerID="b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7"
Aug 04 18:31:11.826053 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.826017    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7"} err="failed to get container status \"b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7\": rpc error: code = NotFound desc = could not find container \"b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7\": container with ID starting with b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7 not found: ID does not exist"
Aug 04 18:31:11.826053 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.826029    2558 scope.go:117] "RemoveContainer" containerID="ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de"
Aug 04 18:31:11.826236 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.826218    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de"} err="failed to get container status \"ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de\": rpc error: code = NotFound desc = could not find container \"ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de\": container with ID starting with ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de not found: ID does not exist"
Aug 04 18:31:11.826279 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.826235    2558 scope.go:117] "RemoveContainer" containerID="cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5"
Aug 04 18:31:11.826431 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.826412    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5"} err="failed to get container status \"cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5\": rpc error: code = NotFound desc = could not find container \"cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5\": container with ID starting with cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5 not found: ID does not exist"
Aug 04 18:31:11.826472 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.826431    2558 scope.go:117] "RemoveContainer" containerID="ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff"
Aug 04 18:31:11.826621 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.826607    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff"} err="failed to get container status \"ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff\": rpc error: code = NotFound desc = could not find container \"ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff\": container with ID starting with ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff not found: ID does not exist"
Aug 04 18:31:11.826701 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.826621    2558 scope.go:117] "RemoveContainer" containerID="70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76"
Aug 04 18:31:11.826884 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.826865    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76"} err="failed to get container status \"70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76\": rpc error: code = NotFound desc = could not find container \"70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76\": container with ID starting with 70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76 not found: ID does not exist"
Aug 04 18:31:11.826929 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.826887    2558 scope.go:117] "RemoveContainer" containerID="898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d"
Aug 04 18:31:11.827106 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.827089    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d"} err="failed to get container status \"898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d\": rpc error: code = NotFound desc = could not find container \"898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d\": container with ID starting with 898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d not found: ID does not exist"
Aug 04 18:31:11.827144 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.827106    2558 scope.go:117] "RemoveContainer" containerID="fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352"
Aug 04 18:31:11.827285 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.827268    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352"} err="failed to get container status \"fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352\": rpc error: code = NotFound desc = could not find container \"fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352\": container with ID starting with fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352 not found: ID does not exist"
Aug 04 18:31:11.827326 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.827286    2558 scope.go:117] "RemoveContainer" containerID="b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7"
Aug 04 18:31:11.827458 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.827439    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7"} err="failed to get container status \"b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7\": rpc error: code = NotFound desc = could not find container \"b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7\": container with ID starting with b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7 not found: ID does not exist"
Aug 04 18:31:11.827499 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.827460    2558 scope.go:117] "RemoveContainer" containerID="ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de"
Aug 04 18:31:11.827624 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.827609    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de"} err="failed to get container status \"ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de\": rpc error: code = NotFound desc = could not find container \"ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de\": container with ID starting with ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de not found: ID does not exist"
Aug 04 18:31:11.827681 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.827624    2558 scope.go:117] "RemoveContainer" containerID="cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5"
Aug 04 18:31:11.827831 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.827812    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5"} err="failed to get container status \"cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5\": rpc error: code = NotFound desc = could not find container \"cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5\": container with ID starting with cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5 not found: ID does not exist"
Aug 04 18:31:11.827900 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.827834    2558 scope.go:117] "RemoveContainer" containerID="ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff"
Aug 04 18:31:11.828037 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.828021    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff"} err="failed to get container status \"ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff\": rpc error: code = NotFound desc = could not find container \"ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff\": container with ID starting with ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff not found: ID does not exist"
Aug 04 18:31:11.828085 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.828039    2558 scope.go:117] "RemoveContainer" containerID="70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76"
Aug 04 18:31:11.828228 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.828212    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76"} err="failed to get container status \"70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76\": rpc error: code = NotFound desc = could not find container \"70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76\": container with ID starting with 70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76 not found: ID does not exist"
Aug 04 18:31:11.828279 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.828229    2558 scope.go:117] "RemoveContainer" containerID="898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d"
Aug 04 18:31:11.828411 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.828395    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d"} err="failed to get container status \"898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d\": rpc error: code = NotFound desc = could not find container \"898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d\": container with ID starting with 898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d not found: ID does not exist"
Aug 04 18:31:11.828450 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.828411    2558 scope.go:117] "RemoveContainer" containerID="fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352"
Aug 04 18:31:11.828590 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.828575    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352"} err="failed to get container status \"fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352\": rpc error: code = NotFound desc = could not find container \"fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352\": container with ID starting with fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352 not found: ID does not exist"
Aug 04 18:31:11.828590 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.828589    2558 scope.go:117] "RemoveContainer" containerID="b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7"
Aug 04 18:31:11.828777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.828763    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7"} err="failed to get container status \"b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7\": rpc error: code = NotFound desc = could not find container \"b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7\": container with ID starting with b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7 not found: ID does not exist"
Aug 04 18:31:11.828822 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.828785    2558 scope.go:117] "RemoveContainer" containerID="ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de"
Aug 04 18:31:11.828951 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.828937    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de"} err="failed to get container status \"ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de\": rpc error: code = NotFound desc = could not find container \"ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de\": container with ID starting with ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de not found: ID does not exist"
Aug 04 18:31:11.828991 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.828950    2558 scope.go:117] "RemoveContainer" containerID="cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5"
Aug 04 18:31:11.829149 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.829133    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5"} err="failed to get container status \"cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5\": rpc error: code = NotFound desc = could not find container \"cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5\": container with ID starting with cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5 not found: ID does not exist"
Aug 04 18:31:11.829190 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.829152    2558 scope.go:117] "RemoveContainer" containerID="ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff"
Aug 04 18:31:11.829333 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.829319    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff"} err="failed to get container status \"ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff\": rpc error: code = NotFound desc = could not find container \"ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff\": container with ID starting with ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff not found: ID does not exist"
Aug 04 18:31:11.829376 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.829333    2558 scope.go:117] "RemoveContainer" containerID="70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76"
Aug 04 18:31:11.829506 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.829488    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76"} err="failed to get container status \"70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76\": rpc error: code = NotFound desc = could not find container \"70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76\": container with ID starting with 70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76 not found: ID does not exist"
Aug 04 18:31:11.829542 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.829505    2558 scope.go:117] "RemoveContainer" containerID="898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d"
Aug 04 18:31:11.829682 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.829667    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d"} err="failed to get container status \"898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d\": rpc error: code = NotFound desc = could not find container \"898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d\": container with ID starting with 898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d not found: ID does not exist"
Aug 04 18:31:11.829682 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.829681    2558 scope.go:117] "RemoveContainer" containerID="fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352"
Aug 04 18:31:11.829879 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.829856    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352"} err="failed to get container status \"fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352\": rpc error: code = NotFound desc = could not find container \"fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352\": container with ID starting with fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352 not found: ID does not exist"
Aug 04 18:31:11.829879 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.829877    2558 scope.go:117] "RemoveContainer" containerID="b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7"
Aug 04 18:31:11.830115 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.830096    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7"} err="failed to get container status \"b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7\": rpc error: code = NotFound desc = could not find container \"b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7\": container with ID starting with b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7 not found: ID does not exist"
Aug 04 18:31:11.830214 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.830117    2558 scope.go:117] "RemoveContainer" containerID="ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de"
Aug 04 18:31:11.830373 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.830355    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de"} err="failed to get container status \"ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de\": rpc error: code = NotFound desc = could not find container \"ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de\": container with ID starting with ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de not found: ID does not exist"
Aug 04 18:31:11.830434 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.830374    2558 scope.go:117] "RemoveContainer" containerID="cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5"
Aug 04 18:31:11.830566 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.830550    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5"} err="failed to get container status \"cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5\": rpc error: code = NotFound desc = could not find container \"cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5\": container with ID starting with cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5 not found: ID does not exist"
Aug 04 18:31:11.830606 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.830566    2558 scope.go:117] "RemoveContainer" containerID="ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff"
Aug 04 18:31:11.830776 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.830760    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff"} err="failed to get container status \"ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff\": rpc error: code = NotFound desc = could not find container \"ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff\": container with ID starting with ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff not found: ID does not exist"
Aug 04 18:31:11.830823 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.830777    2558 scope.go:117] "RemoveContainer" containerID="70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76"
Aug 04 18:31:11.830980 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.830961    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76"} err="failed to get container status \"70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76\": rpc error: code = NotFound desc = could not find container \"70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76\": container with ID starting with 70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76 not found: ID does not exist"
Aug 04 18:31:11.831060 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.830982    2558 scope.go:117] "RemoveContainer" containerID="898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d"
Aug 04 18:31:11.831188 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.831173    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d"} err="failed to get container status \"898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d\": rpc error: code = NotFound desc = could not find container \"898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d\": container with ID starting with 898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d not found: ID does not exist"
Aug 04 18:31:11.831247 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.831189    2558 scope.go:117] "RemoveContainer" containerID="fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352"
Aug 04 18:31:11.831379 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.831362    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352"} err="failed to get container status \"fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352\": rpc error: code = NotFound desc = could not find container \"fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352\": container with ID starting with fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352 not found: ID does not exist"
Aug 04 18:31:11.831423 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.831379    2558 scope.go:117] "RemoveContainer" containerID="b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7"
Aug 04 18:31:11.831584 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.831566    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7"} err="failed to get container status \"b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7\": rpc error: code = NotFound desc = could not find container \"b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7\": container with ID starting with b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7 not found: ID does not exist"
Aug 04 18:31:11.831674 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.831585    2558 scope.go:117] "RemoveContainer" containerID="ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de"
Aug 04 18:31:11.831807 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.831789    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de"} err="failed to get container status \"ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de\": rpc error: code = NotFound desc = could not find container \"ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de\": container with ID starting with ce4966b3e0794f61fd0b5984287a64d3012c6f7d2761ee36b5191da47363c2de not found: ID does not exist"
Aug 04 18:31:11.831807 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.831806    2558 scope.go:117] "RemoveContainer" containerID="cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5"
Aug 04 18:31:11.832064 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.832004    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5"} err="failed to get container status \"cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5\": rpc error: code = NotFound desc = could not find container \"cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5\": container with ID starting with cc1a7a9a8a35784d492a6e92e24a55afde0f57613378573cf5345be3430c66c5 not found: ID does not exist"
Aug 04 18:31:11.832155 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.832066    2558 scope.go:117] "RemoveContainer" containerID="ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff"
Aug 04 18:31:11.832318 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.832298    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff"} err="failed to get container status \"ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff\": rpc error: code = NotFound desc = could not find container \"ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff\": container with ID starting with ceea98c5e14095e8c9f60bd5f48553f90725e66ead80b67f5d4276e7f67a1bff not found: ID does not exist"
Aug 04 18:31:11.832387 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.832320    2558 scope.go:117] "RemoveContainer" containerID="70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76"
Aug 04 18:31:11.832594 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.832574    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76"} err="failed to get container status \"70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76\": rpc error: code = NotFound desc = could not find container \"70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76\": container with ID starting with 70f603e200a15c4867289f122b0f9f5783c3e8ba8aa8a38d64e68da671326d76 not found: ID does not exist"
Aug 04 18:31:11.832677 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.832595    2558 scope.go:117] "RemoveContainer" containerID="898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d"
Aug 04 18:31:11.832843 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.832824    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d"} err="failed to get container status \"898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d\": rpc error: code = NotFound desc = could not find container \"898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d\": container with ID starting with 898703026bc0381abd1f718c68c6832305f3a7e3f694dfec1786f2d22fa6478d not found: ID does not exist"
Aug 04 18:31:11.832898 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.832843    2558 scope.go:117] "RemoveContainer" containerID="fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352"
Aug 04 18:31:11.833023 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.833007    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352"} err="failed to get container status \"fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352\": rpc error: code = NotFound desc = could not find container \"fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352\": container with ID starting with fbb9ce4b318c6309d58f8853478d1996c2278d9c51cd55ed82bc1eb2fe122352 not found: ID does not exist"
Aug 04 18:31:11.833077 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.833023    2558 scope.go:117] "RemoveContainer" containerID="b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7"
Aug 04 18:31:11.833222 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.833207    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7"} err="failed to get container status \"b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7\": rpc error: code = NotFound desc = could not find container \"b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7\": container with ID starting with b28cea4b5625bd0eb4ec779241498f597e78a69d37852473be449fe441ae2ab7 not found: ID does not exist"
Aug 04 18:31:11.841971 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.841950    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:31:11.842267 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842252    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="kube-rbac-proxy-metric"
Aug 04 18:31:11.842310 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842269    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="kube-rbac-proxy-metric"
Aug 04 18:31:11.842310 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842278    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="kube-rbac-proxy-web"
Aug 04 18:31:11.842310 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842285    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="kube-rbac-proxy-web"
Aug 04 18:31:11.842310 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842293    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="kube-rbac-proxy"
Aug 04 18:31:11.842310 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842299    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="kube-rbac-proxy"
Aug 04 18:31:11.842310 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842306    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="prom-label-proxy"
Aug 04 18:31:11.842310 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842311    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="prom-label-proxy"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842318    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="kube-rbac-proxy"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842323    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="kube-rbac-proxy"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842330    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="kube-rbac-proxy-web"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842335    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="kube-rbac-proxy-web"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842341    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="kube-rbac-proxy-thanos"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842345    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="kube-rbac-proxy-thanos"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842351    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="config-reloader"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842357    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="config-reloader"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842363    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="prometheus"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842368    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="prometheus"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842376    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="init-config-reloader"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842383    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="init-config-reloader"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842390    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="alertmanager"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842395    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="alertmanager"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842400    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="config-reloader"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842405    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="config-reloader"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842415    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="init-config-reloader"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842420    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="init-config-reloader"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842425    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="thanos-sidecar"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842430    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="thanos-sidecar"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842436    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2d161a7-94f1-463b-8500-6fa1591a0a7b" containerName="console"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842441    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2d161a7-94f1-463b-8500-6fa1591a0a7b" containerName="console"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842479    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="prom-label-proxy"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842486    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="config-reloader"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842490    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="thanos-sidecar"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842497    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="kube-rbac-proxy"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842504    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2d161a7-94f1-463b-8500-6fa1591a0a7b" containerName="console"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842509    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="kube-rbac-proxy-web"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842515    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="kube-rbac-proxy-web"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842520    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="kube-rbac-proxy"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842525    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="alertmanager"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842531    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="config-reloader"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842536    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="prometheus"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842541    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="23eb1292-8b9b-4f61-a2b2-c1fda471a877" containerName="kube-rbac-proxy-metric"
Aug 04 18:31:11.842534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.842546    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" containerName="kube-rbac-proxy-thanos"
Aug 04 18:31:11.845712 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.845698    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.848355 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.848337    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Aug 04 18:31:11.848355 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.848348    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Aug 04 18:31:11.848514 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.848372    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Aug 04 18:31:11.848951 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.848935    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Aug 04 18:31:11.849425 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.849407    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Aug 04 18:31:11.849503 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.849448    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Aug 04 18:31:11.849567 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.849506    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Aug 04 18:31:11.849667 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.849653    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Aug 04 18:31:11.849739 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.849678    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6k258\""
Aug 04 18:31:11.850181 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.850165    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Aug 04 18:31:11.850275 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.850229    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Aug 04 18:31:11.850465 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.850450    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Aug 04 18:31:11.850465 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.850458    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-80j95qrp1a2qd\""
Aug 04 18:31:11.850579 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.850486    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Aug 04 18:31:11.850859 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.850840    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Aug 04 18:31:11.853838 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.853817    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Aug 04 18:31:11.856418 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.856401    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Aug 04 18:31:11.869727 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.869700    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:31:11.925753 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.925712    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.925753 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.925747    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3f3f3709-a748-46e9-9e4f-85827cfef2ab-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.926033 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.925770    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.926033 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.925796    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.926033 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.925816    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-web-config\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.926033 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.925831    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.926033 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.925847    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f3f3709-a748-46e9-9e4f-85827cfef2ab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.926033 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.925862    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f3f3709-a748-46e9-9e4f-85827cfef2ab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.926033 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.925880    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3f3709-a748-46e9-9e4f-85827cfef2ab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.926033 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.925909    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.926033 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.925947    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3f3709-a748-46e9-9e4f-85827cfef2ab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.926033 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.925999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f3f3709-a748-46e9-9e4f-85827cfef2ab-config-out\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.926033 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.926024    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3f3f3709-a748-46e9-9e4f-85827cfef2ab-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.926606 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.926042    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.926606 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.926083    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-config\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.926606 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.926111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.926606 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.926169    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f3f3709-a748-46e9-9e4f-85827cfef2ab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.926606 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.926198    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3f3709-a748-46e9-9e4f-85827cfef2ab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.926606 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.926225    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xzll\" (UniqueName: \"kubernetes.io/projected/3f3f3709-a748-46e9-9e4f-85827cfef2ab-kube-api-access-9xzll\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.926606 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.926243    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f3f3709-a748-46e9-9e4f-85827cfef2ab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:11.963018 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:11.962985    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c4f5f23-27ad-46f8-b298-da2e463dbb76" path="/var/lib/kubelet/pods/7c4f5f23-27ad-46f8-b298-da2e463dbb76/volumes"
Aug 04 18:31:12.026741 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.026675    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.026741 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.026710    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3f3f3709-a748-46e9-9e4f-85827cfef2ab-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.026741 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.026729    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.027212 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.026987    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.027212 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.027040    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-web-config\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.027212 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.027065    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.027212 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.027087    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f3f3709-a748-46e9-9e4f-85827cfef2ab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.027212 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.027106    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f3f3709-a748-46e9-9e4f-85827cfef2ab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.027212 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.027137    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3f3709-a748-46e9-9e4f-85827cfef2ab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.027212 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.027162    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.027613 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.027391    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3f3f3709-a748-46e9-9e4f-85827cfef2ab-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.027613 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.027572    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3f3709-a748-46e9-9e4f-85827cfef2ab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.027613 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.027610    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f3f3709-a748-46e9-9e4f-85827cfef2ab-config-out\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.027855 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.027656    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3f3f3709-a748-46e9-9e4f-85827cfef2ab-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.027855 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.027689    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.027855 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.027719    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-config\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.027855 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.027742    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.027855 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.027801    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f3f3709-a748-46e9-9e4f-85827cfef2ab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.027855 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.027819    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f3f3709-a748-46e9-9e4f-85827cfef2ab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.027855 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.027835    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3f3709-a748-46e9-9e4f-85827cfef2ab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.028182 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.027891    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xzll\" (UniqueName: \"kubernetes.io/projected/3f3f3709-a748-46e9-9e4f-85827cfef2ab-kube-api-access-9xzll\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.028182 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.027927    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f3f3709-a748-46e9-9e4f-85827cfef2ab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.028453 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.028426    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3f3709-a748-46e9-9e4f-85827cfef2ab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.029115 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.029087    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3f3709-a748-46e9-9e4f-85827cfef2ab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.030026 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.029854    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.030026 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.029962    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.031014 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.030710    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.031014 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.030832    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f3f3709-a748-46e9-9e4f-85827cfef2ab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.031176 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.031080    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f3f3709-a748-46e9-9e4f-85827cfef2ab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.031607 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.031582    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f3f3709-a748-46e9-9e4f-85827cfef2ab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.031775 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.031559    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3f3f3709-a748-46e9-9e4f-85827cfef2ab-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.031867 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.031618    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.031967 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.031863    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.032377 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.032360    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-web-config\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.032537 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.032513    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3f3709-a748-46e9-9e4f-85827cfef2ab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.032624 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.032603    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.033085 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.033065    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.033531 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.033513    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f3f3709-a748-46e9-9e4f-85827cfef2ab-config-out\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.033835 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.033820    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f3f3709-a748-46e9-9e4f-85827cfef2ab-config\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.040352 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.040332    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xzll\" (UniqueName: \"kubernetes.io/projected/3f3f3709-a748-46e9-9e4f-85827cfef2ab-kube-api-access-9xzll\") pod \"prometheus-k8s-0\" (UID: \"3f3f3709-a748-46e9-9e4f-85827cfef2ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.155624 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.155589    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:12.303541 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.303413    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:31:12.307208 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:31:12.307180    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3f3709_a748_46e9_9e4f_85827cfef2ab.slice/crio-ce7d4d99b7e2a625964c46565fe7def535023b29d55c709bc44d343f1eb48b7a WatchSource:0}: Error finding container ce7d4d99b7e2a625964c46565fe7def535023b29d55c709bc44d343f1eb48b7a: Status 404 returned error can't find the container with id ce7d4d99b7e2a625964c46565fe7def535023b29d55c709bc44d343f1eb48b7a
Aug 04 18:31:12.779824 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.779788    2558 generic.go:356] "Generic (PLEG): container finished" podID="3f3f3709-a748-46e9-9e4f-85827cfef2ab" containerID="dd8012e9eafb24222fb9e5bee83cb24b2cdd2f884b2e31a06ae0272498095288" exitCode=0
Aug 04 18:31:12.779990 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.779850    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f3f3709-a748-46e9-9e4f-85827cfef2ab","Type":"ContainerDied","Data":"dd8012e9eafb24222fb9e5bee83cb24b2cdd2f884b2e31a06ae0272498095288"}
Aug 04 18:31:12.779990 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:12.779899    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f3f3709-a748-46e9-9e4f-85827cfef2ab","Type":"ContainerStarted","Data":"ce7d4d99b7e2a625964c46565fe7def535023b29d55c709bc44d343f1eb48b7a"}
Aug 04 18:31:13.519859 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:13.519819    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56569bb8cb-d6wpb"]
Aug 04 18:31:13.786823 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:13.786737    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f3f3709-a748-46e9-9e4f-85827cfef2ab","Type":"ContainerStarted","Data":"76d3a4ecbda191f05c5fed182ebbe72df7d762ac9429c349fa2da50295e12df4"}
Aug 04 18:31:13.786823 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:13.786818    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f3f3709-a748-46e9-9e4f-85827cfef2ab","Type":"ContainerStarted","Data":"508a885328f00e8cbf86ffa1ae911a559a299bc3fdf3614c7c08944bc9f73f4c"}
Aug 04 18:31:13.786990 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:13.786861    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f3f3709-a748-46e9-9e4f-85827cfef2ab","Type":"ContainerStarted","Data":"b5d5acfe1e0445695734c8af457e8474eb631be2bc393718bb55e6fb3456afba"}
Aug 04 18:31:13.786990 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:13.786898    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f3f3709-a748-46e9-9e4f-85827cfef2ab","Type":"ContainerStarted","Data":"b087a79867d2e3267de10555ecbe822859e37171d3aaca9a0856cb6a159682f6"}
Aug 04 18:31:13.786990 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:13.786930    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f3f3709-a748-46e9-9e4f-85827cfef2ab","Type":"ContainerStarted","Data":"23e5b3aab2575ddc383173b18881361cde2ece75ce0af68e1f6c66cb10408477"}
Aug 04 18:31:13.786990 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:13.786965    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f3f3709-a748-46e9-9e4f-85827cfef2ab","Type":"ContainerStarted","Data":"f86a4c28e138ad2c56c78fc76327423e2d6c65158911b7bb6abbd5f136b1192f"}
Aug 04 18:31:13.834850 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:13.832030    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.811213292 podStartE2EDuration="2.832007684s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.794392ms" isStatefulPod=false podCreationTimestamp="2026-08-04 18:31:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:31:13.827743031 +0000 UTC m=+194.361926120" watchObservedRunningTime="2026-08-04 18:31:13.832007684 +0000 UTC m=+194.366190790"
Aug 04 18:31:17.156700 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:17.156665    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:31:38.539130 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.539066    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56569bb8cb-d6wpb" podUID="0af986ed-47ea-4f24-89c2-2c20a2455feb" containerName="console" containerID="cri-o://092e6ca6e1bf1ea169594e9e56c26c9f314d4de6ed6decc1764005fc56b454a8" gracePeriod=15
Aug 04 18:31:38.783212 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.783187    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:31:38.865854 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.865759    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0af986ed-47ea-4f24-89c2-2c20a2455feb-console-serving-cert\") pod \"0af986ed-47ea-4f24-89c2-2c20a2455feb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") "
Aug 04 18:31:38.865854 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.865824    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0af986ed-47ea-4f24-89c2-2c20a2455feb-console-oauth-config\") pod \"0af986ed-47ea-4f24-89c2-2c20a2455feb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") "
Aug 04 18:31:38.866078 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.865867    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rsjb\" (UniqueName: \"kubernetes.io/projected/0af986ed-47ea-4f24-89c2-2c20a2455feb-kube-api-access-8rsjb\") pod \"0af986ed-47ea-4f24-89c2-2c20a2455feb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") "
Aug 04 18:31:38.866078 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.865920    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-service-ca\") pod \"0af986ed-47ea-4f24-89c2-2c20a2455feb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") "
Aug 04 18:31:38.866078 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.865946    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-console-config\") pod \"0af986ed-47ea-4f24-89c2-2c20a2455feb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") "
Aug 04 18:31:38.866078 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.865975    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-trusted-ca-bundle\") pod \"0af986ed-47ea-4f24-89c2-2c20a2455feb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") "
Aug 04 18:31:38.866078 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.866005    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-oauth-serving-cert\") pod \"0af986ed-47ea-4f24-89c2-2c20a2455feb\" (UID: \"0af986ed-47ea-4f24-89c2-2c20a2455feb\") "
Aug 04 18:31:38.866553 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.866467    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-service-ca" (OuterVolumeSpecName: "service-ca") pod "0af986ed-47ea-4f24-89c2-2c20a2455feb" (UID: "0af986ed-47ea-4f24-89c2-2c20a2455feb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:31:38.866553 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.866467    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-console-config" (OuterVolumeSpecName: "console-config") pod "0af986ed-47ea-4f24-89c2-2c20a2455feb" (UID: "0af986ed-47ea-4f24-89c2-2c20a2455feb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:31:38.866553 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.866509    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0af986ed-47ea-4f24-89c2-2c20a2455feb" (UID: "0af986ed-47ea-4f24-89c2-2c20a2455feb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:31:38.866553 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.866527    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0af986ed-47ea-4f24-89c2-2c20a2455feb" (UID: "0af986ed-47ea-4f24-89c2-2c20a2455feb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:31:38.868339 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.868313    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0af986ed-47ea-4f24-89c2-2c20a2455feb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0af986ed-47ea-4f24-89c2-2c20a2455feb" (UID: "0af986ed-47ea-4f24-89c2-2c20a2455feb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:31:38.868492 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.868471    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0af986ed-47ea-4f24-89c2-2c20a2455feb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0af986ed-47ea-4f24-89c2-2c20a2455feb" (UID: "0af986ed-47ea-4f24-89c2-2c20a2455feb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:31:38.868549 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.868488    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0af986ed-47ea-4f24-89c2-2c20a2455feb-kube-api-access-8rsjb" (OuterVolumeSpecName: "kube-api-access-8rsjb") pod "0af986ed-47ea-4f24-89c2-2c20a2455feb" (UID: "0af986ed-47ea-4f24-89c2-2c20a2455feb"). InnerVolumeSpecName "kube-api-access-8rsjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:31:38.891495 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.891448    2558 generic.go:356] "Generic (PLEG): container finished" podID="0af986ed-47ea-4f24-89c2-2c20a2455feb" containerID="092e6ca6e1bf1ea169594e9e56c26c9f314d4de6ed6decc1764005fc56b454a8" exitCode=0
Aug 04 18:31:38.891607 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.891528    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56569bb8cb-d6wpb" event={"ID":"0af986ed-47ea-4f24-89c2-2c20a2455feb","Type":"ContainerDied","Data":"092e6ca6e1bf1ea169594e9e56c26c9f314d4de6ed6decc1764005fc56b454a8"}
Aug 04 18:31:38.891663 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.891604    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56569bb8cb-d6wpb" event={"ID":"0af986ed-47ea-4f24-89c2-2c20a2455feb","Type":"ContainerDied","Data":"568de6fd48d6cde864cd1106cdbef930dc63be2a447afd97e83c4dd103f7522e"}
Aug 04 18:31:38.891663 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.891535    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56569bb8cb-d6wpb"
Aug 04 18:31:38.891663 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.891626    2558 scope.go:117] "RemoveContainer" containerID="092e6ca6e1bf1ea169594e9e56c26c9f314d4de6ed6decc1764005fc56b454a8"
Aug 04 18:31:38.900491 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.900477    2558 scope.go:117] "RemoveContainer" containerID="092e6ca6e1bf1ea169594e9e56c26c9f314d4de6ed6decc1764005fc56b454a8"
Aug 04 18:31:38.900764 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:31:38.900743    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"092e6ca6e1bf1ea169594e9e56c26c9f314d4de6ed6decc1764005fc56b454a8\": container with ID starting with 092e6ca6e1bf1ea169594e9e56c26c9f314d4de6ed6decc1764005fc56b454a8 not found: ID does not exist" containerID="092e6ca6e1bf1ea169594e9e56c26c9f314d4de6ed6decc1764005fc56b454a8"
Aug 04 18:31:38.900832 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.900771    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"092e6ca6e1bf1ea169594e9e56c26c9f314d4de6ed6decc1764005fc56b454a8"} err="failed to get container status \"092e6ca6e1bf1ea169594e9e56c26c9f314d4de6ed6decc1764005fc56b454a8\": rpc error: code = NotFound desc = could not find container \"092e6ca6e1bf1ea169594e9e56c26c9f314d4de6ed6decc1764005fc56b454a8\": container with ID starting with 092e6ca6e1bf1ea169594e9e56c26c9f314d4de6ed6decc1764005fc56b454a8 not found: ID does not exist"
Aug 04 18:31:38.913325 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.913305    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56569bb8cb-d6wpb"]
Aug 04 18:31:38.916783 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.916762    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56569bb8cb-d6wpb"]
Aug 04 18:31:38.967584 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.967558    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rsjb\" (UniqueName: \"kubernetes.io/projected/0af986ed-47ea-4f24-89c2-2c20a2455feb-kube-api-access-8rsjb\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:38.967584 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.967582    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-service-ca\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:38.967751 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.967593    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-console-config\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:38.967751 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.967602    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-trusted-ca-bundle\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:38.967751 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.967609    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0af986ed-47ea-4f24-89c2-2c20a2455feb-oauth-serving-cert\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:38.967751 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.967618    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0af986ed-47ea-4f24-89c2-2c20a2455feb-console-serving-cert\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:38.967751 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:38.967625    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0af986ed-47ea-4f24-89c2-2c20a2455feb-console-oauth-config\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:31:39.962605 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:31:39.962573    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0af986ed-47ea-4f24-89c2-2c20a2455feb" path="/var/lib/kubelet/pods/0af986ed-47ea-4f24-89c2-2c20a2455feb/volumes"
Aug 04 18:32:12.156225 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:32:12.156191    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:32:12.171229 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:32:12.171206    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:32:13.028999 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:32:13.028972    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:32:59.838164 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:32:59.838131    2558 kubelet.go:1648] "Image garbage collection succeeded"
Aug 04 18:33:46.610681 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.610650    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z"]
Aug 04 18:33:46.611149 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.610936    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0af986ed-47ea-4f24-89c2-2c20a2455feb" containerName="console"
Aug 04 18:33:46.611149 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.610947    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0af986ed-47ea-4f24-89c2-2c20a2455feb" containerName="console"
Aug 04 18:33:46.611149 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.610999    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0af986ed-47ea-4f24-89c2-2c20a2455feb" containerName="console"
Aug 04 18:33:46.613960 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.613940    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z"
Aug 04 18:33:46.617196 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.617170    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 04 18:33:46.617313 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.617218    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 04 18:33:46.617370 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.617308    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-v6z2v\""
Aug 04 18:33:46.617717 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.617699    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 04 18:33:46.617808 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.617740    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 04 18:33:46.647229 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.647198    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z"]
Aug 04 18:33:46.664644 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.664604    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/41f767fb-2927-4157-b2e4-4c00fb41bfa5-manifests\") pod \"opendatahub-operator-controller-manager-5556d6485b-b9m4z\" (UID: \"41f767fb-2927-4157-b2e4-4c00fb41bfa5\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z"
Aug 04 18:33:46.664783 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.664669    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41f767fb-2927-4157-b2e4-4c00fb41bfa5-tmp\") pod \"opendatahub-operator-controller-manager-5556d6485b-b9m4z\" (UID: \"41f767fb-2927-4157-b2e4-4c00fb41bfa5\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z"
Aug 04 18:33:46.664783 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.664714    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41f767fb-2927-4157-b2e4-4c00fb41bfa5-webhook-cert\") pod \"opendatahub-operator-controller-manager-5556d6485b-b9m4z\" (UID: \"41f767fb-2927-4157-b2e4-4c00fb41bfa5\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z"
Aug 04 18:33:46.664783 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.664740    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7m4n\" (UniqueName: \"kubernetes.io/projected/41f767fb-2927-4157-b2e4-4c00fb41bfa5-kube-api-access-n7m4n\") pod \"opendatahub-operator-controller-manager-5556d6485b-b9m4z\" (UID: \"41f767fb-2927-4157-b2e4-4c00fb41bfa5\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z"
Aug 04 18:33:46.664886 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.664790    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41f767fb-2927-4157-b2e4-4c00fb41bfa5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5556d6485b-b9m4z\" (UID: \"41f767fb-2927-4157-b2e4-4c00fb41bfa5\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z"
Aug 04 18:33:46.766133 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.766100    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/41f767fb-2927-4157-b2e4-4c00fb41bfa5-manifests\") pod \"opendatahub-operator-controller-manager-5556d6485b-b9m4z\" (UID: \"41f767fb-2927-4157-b2e4-4c00fb41bfa5\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z"
Aug 04 18:33:46.766133 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.766135    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41f767fb-2927-4157-b2e4-4c00fb41bfa5-tmp\") pod \"opendatahub-operator-controller-manager-5556d6485b-b9m4z\" (UID: \"41f767fb-2927-4157-b2e4-4c00fb41bfa5\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z"
Aug 04 18:33:46.766394 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.766190    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41f767fb-2927-4157-b2e4-4c00fb41bfa5-webhook-cert\") pod \"opendatahub-operator-controller-manager-5556d6485b-b9m4z\" (UID: \"41f767fb-2927-4157-b2e4-4c00fb41bfa5\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z"
Aug 04 18:33:46.766394 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.766216    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7m4n\" (UniqueName: \"kubernetes.io/projected/41f767fb-2927-4157-b2e4-4c00fb41bfa5-kube-api-access-n7m4n\") pod \"opendatahub-operator-controller-manager-5556d6485b-b9m4z\" (UID: \"41f767fb-2927-4157-b2e4-4c00fb41bfa5\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z"
Aug 04 18:33:46.766394 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.766242    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41f767fb-2927-4157-b2e4-4c00fb41bfa5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5556d6485b-b9m4z\" (UID: \"41f767fb-2927-4157-b2e4-4c00fb41bfa5\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z"
Aug 04 18:33:46.766586 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.766562    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/41f767fb-2927-4157-b2e4-4c00fb41bfa5-manifests\") pod \"opendatahub-operator-controller-manager-5556d6485b-b9m4z\" (UID: \"41f767fb-2927-4157-b2e4-4c00fb41bfa5\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z"
Aug 04 18:33:46.768486 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.768466    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41f767fb-2927-4157-b2e4-4c00fb41bfa5-tmp\") pod \"opendatahub-operator-controller-manager-5556d6485b-b9m4z\" (UID: \"41f767fb-2927-4157-b2e4-4c00fb41bfa5\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z"
Aug 04 18:33:46.768754 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.768733    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41f767fb-2927-4157-b2e4-4c00fb41bfa5-webhook-cert\") pod \"opendatahub-operator-controller-manager-5556d6485b-b9m4z\" (UID: \"41f767fb-2927-4157-b2e4-4c00fb41bfa5\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z"
Aug 04 18:33:46.768825 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.768757    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41f767fb-2927-4157-b2e4-4c00fb41bfa5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5556d6485b-b9m4z\" (UID: \"41f767fb-2927-4157-b2e4-4c00fb41bfa5\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z"
Aug 04 18:33:46.779217 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.779184    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7m4n\" (UniqueName: \"kubernetes.io/projected/41f767fb-2927-4157-b2e4-4c00fb41bfa5-kube-api-access-n7m4n\") pod \"opendatahub-operator-controller-manager-5556d6485b-b9m4z\" (UID: \"41f767fb-2927-4157-b2e4-4c00fb41bfa5\") " pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z"
Aug 04 18:33:46.924574 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:46.924535    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z"
Aug 04 18:33:47.162109 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:47.162086    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z"]
Aug 04 18:33:47.164175 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:33:47.164144    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f767fb_2927_4157_b2e4_4c00fb41bfa5.slice/crio-b75d7fe1ac7e46f7c6507681d8748ee52d64b3877fa908db1a2ec623c8c96344 WatchSource:0}: Error finding container b75d7fe1ac7e46f7c6507681d8748ee52d64b3877fa908db1a2ec623c8c96344: Status 404 returned error can't find the container with id b75d7fe1ac7e46f7c6507681d8748ee52d64b3877fa908db1a2ec623c8c96344
Aug 04 18:33:47.165999 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:47.165977    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:33:47.352477 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:47.352393    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z" event={"ID":"41f767fb-2927-4157-b2e4-4c00fb41bfa5","Type":"ContainerStarted","Data":"b75d7fe1ac7e46f7c6507681d8748ee52d64b3877fa908db1a2ec623c8c96344"}
Aug 04 18:33:50.368029 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:50.367949    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z" event={"ID":"41f767fb-2927-4157-b2e4-4c00fb41bfa5","Type":"ContainerStarted","Data":"1cd1d4010114610a04b8d9fe0fff4859e3c03d616b0714d5089c5dd0952ad8b6"}
Aug 04 18:33:51.372991 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:51.372958    2558 generic.go:356] "Generic (PLEG): container finished" podID="41f767fb-2927-4157-b2e4-4c00fb41bfa5" containerID="1cd1d4010114610a04b8d9fe0fff4859e3c03d616b0714d5089c5dd0952ad8b6" exitCode=0
Aug 04 18:33:51.373380 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:51.372998    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z" event={"ID":"41f767fb-2927-4157-b2e4-4c00fb41bfa5","Type":"ContainerDied","Data":"1cd1d4010114610a04b8d9fe0fff4859e3c03d616b0714d5089c5dd0952ad8b6"}
Aug 04 18:33:52.378535 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:52.378502    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z" event={"ID":"41f767fb-2927-4157-b2e4-4c00fb41bfa5","Type":"ContainerStarted","Data":"a901d23f2fdcfe57c5ea165a9e17d8de6fb9892e1e7ef236b731ce9a6cd7856f"}
Aug 04 18:33:52.378945 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:52.378610    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z"
Aug 04 18:33:52.430068 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:33:52.429984    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z" podStartSLOduration=2.043724112 podStartE2EDuration="6.429967391s" totalImagesPullingTime="3.316872211s" totalInitContainerRuntime="1.069371068s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:33:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:33:52.42755861 +0000 UTC m=+352.961741699" watchObservedRunningTime="2026-08-04 18:33:52.429967391 +0000 UTC m=+352.964150478"
Aug 04 18:34:03.384918 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.384884    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5556d6485b-b9m4z"
Aug 04 18:34:03.515477 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.515439    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f7c986d68-88m26"]
Aug 04 18:34:03.524239 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.524216    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-88m26"
Aug 04 18:34:03.528760 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.528736    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 04 18:34:03.528900 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.528827    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Aug 04 18:34:03.528964 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.528900    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Aug 04 18:34:03.529049 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.529029    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-j99f5\""
Aug 04 18:34:03.529122 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.529106    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Aug 04 18:34:03.530821 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.530590    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 04 18:34:03.545558 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.545536    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f7c986d68-88m26"]
Aug 04 18:34:03.616545 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.616515    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a7cb3c09-668b-415f-bf35-508257c49ad6-manager-config\") pod \"lws-controller-manager-6f7c986d68-88m26\" (UID: \"a7cb3c09-668b-415f-bf35-508257c49ad6\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-88m26"
Aug 04 18:34:03.616733 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.616562    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7cb3c09-668b-415f-bf35-508257c49ad6-cert\") pod \"lws-controller-manager-6f7c986d68-88m26\" (UID: \"a7cb3c09-668b-415f-bf35-508257c49ad6\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-88m26"
Aug 04 18:34:03.616733 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.616622    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjqwh\" (UniqueName: \"kubernetes.io/projected/a7cb3c09-668b-415f-bf35-508257c49ad6-kube-api-access-fjqwh\") pod \"lws-controller-manager-6f7c986d68-88m26\" (UID: \"a7cb3c09-668b-415f-bf35-508257c49ad6\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-88m26"
Aug 04 18:34:03.616733 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.616661    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7cb3c09-668b-415f-bf35-508257c49ad6-metrics-cert\") pod \"lws-controller-manager-6f7c986d68-88m26\" (UID: \"a7cb3c09-668b-415f-bf35-508257c49ad6\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-88m26"
Aug 04 18:34:03.717922 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.717885    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a7cb3c09-668b-415f-bf35-508257c49ad6-manager-config\") pod \"lws-controller-manager-6f7c986d68-88m26\" (UID: \"a7cb3c09-668b-415f-bf35-508257c49ad6\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-88m26"
Aug 04 18:34:03.718094 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.717936    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7cb3c09-668b-415f-bf35-508257c49ad6-cert\") pod \"lws-controller-manager-6f7c986d68-88m26\" (UID: \"a7cb3c09-668b-415f-bf35-508257c49ad6\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-88m26"
Aug 04 18:34:03.718094 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.717970    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjqwh\" (UniqueName: \"kubernetes.io/projected/a7cb3c09-668b-415f-bf35-508257c49ad6-kube-api-access-fjqwh\") pod \"lws-controller-manager-6f7c986d68-88m26\" (UID: \"a7cb3c09-668b-415f-bf35-508257c49ad6\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-88m26"
Aug 04 18:34:03.718094 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.717999    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7cb3c09-668b-415f-bf35-508257c49ad6-metrics-cert\") pod \"lws-controller-manager-6f7c986d68-88m26\" (UID: \"a7cb3c09-668b-415f-bf35-508257c49ad6\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-88m26"
Aug 04 18:34:03.718728 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.718698    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a7cb3c09-668b-415f-bf35-508257c49ad6-manager-config\") pod \"lws-controller-manager-6f7c986d68-88m26\" (UID: \"a7cb3c09-668b-415f-bf35-508257c49ad6\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-88m26"
Aug 04 18:34:03.720426 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.720401    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7cb3c09-668b-415f-bf35-508257c49ad6-cert\") pod \"lws-controller-manager-6f7c986d68-88m26\" (UID: \"a7cb3c09-668b-415f-bf35-508257c49ad6\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-88m26"
Aug 04 18:34:03.720523 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.720466    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7cb3c09-668b-415f-bf35-508257c49ad6-metrics-cert\") pod \"lws-controller-manager-6f7c986d68-88m26\" (UID: \"a7cb3c09-668b-415f-bf35-508257c49ad6\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-88m26"
Aug 04 18:34:03.733335 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.733308    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjqwh\" (UniqueName: \"kubernetes.io/projected/a7cb3c09-668b-415f-bf35-508257c49ad6-kube-api-access-fjqwh\") pod \"lws-controller-manager-6f7c986d68-88m26\" (UID: \"a7cb3c09-668b-415f-bf35-508257c49ad6\") " pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-88m26"
Aug 04 18:34:03.833503 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.833456    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-88m26"
Aug 04 18:34:03.969560 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:03.969527    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f7c986d68-88m26"]
Aug 04 18:34:03.971834 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:34:03.971806    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7cb3c09_668b_415f_bf35_508257c49ad6.slice/crio-afe039899ec60c92262cc690e4963ee8f880d3b01ca9c4770359e4e9197b4e20 WatchSource:0}: Error finding container afe039899ec60c92262cc690e4963ee8f880d3b01ca9c4770359e4e9197b4e20: Status 404 returned error can't find the container with id afe039899ec60c92262cc690e4963ee8f880d3b01ca9c4770359e4e9197b4e20
Aug 04 18:34:04.425119 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:04.425087    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-88m26" event={"ID":"a7cb3c09-668b-415f-bf35-508257c49ad6","Type":"ContainerStarted","Data":"afe039899ec60c92262cc690e4963ee8f880d3b01ca9c4770359e4e9197b4e20"}
Aug 04 18:34:10.451929 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:10.451872    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-88m26" event={"ID":"a7cb3c09-668b-415f-bf35-508257c49ad6","Type":"ContainerStarted","Data":"62aafd1f0771f9ebe4a5ba4364e304f162ff0a37e0722ba738c0a9b1c60ed221"}
Aug 04 18:34:10.452317 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:10.452001    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-88m26"
Aug 04 18:34:10.485963 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:10.485912    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-88m26" podStartSLOduration=1.9595844 podStartE2EDuration="7.485896359s" totalImagesPullingTime="5.526311959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:34:10.484167402 +0000 UTC m=+371.018350492" watchObservedRunningTime="2026-08-04 18:34:10.485896359 +0000 UTC m=+371.020079446"
Aug 04 18:34:16.032172 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.032131    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"]
Aug 04 18:34:16.035680 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.035658    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.042901 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.042881    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 04 18:34:16.049867 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.049849    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Aug 04 18:34:16.049967 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.049942    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Aug 04 18:34:16.049967 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.049849    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Aug 04 18:34:16.051212 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.051199    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6q86t\""
Aug 04 18:34:16.094297 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.094257    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"]
Aug 04 18:34:16.224865 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.224834    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/99cab7b9-099b-4b1f-bfd5-ae34ca916791-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-znd67\" (UID: \"99cab7b9-099b-4b1f-bfd5-ae34ca916791\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.225033 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.224876    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99cab7b9-099b-4b1f-bfd5-ae34ca916791-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-znd67\" (UID: \"99cab7b9-099b-4b1f-bfd5-ae34ca916791\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.225033 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.224901    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/99cab7b9-099b-4b1f-bfd5-ae34ca916791-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-znd67\" (UID: \"99cab7b9-099b-4b1f-bfd5-ae34ca916791\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.225033 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.225010    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/99cab7b9-099b-4b1f-bfd5-ae34ca916791-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-znd67\" (UID: \"99cab7b9-099b-4b1f-bfd5-ae34ca916791\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.225141 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.225044    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99cab7b9-099b-4b1f-bfd5-ae34ca916791-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-znd67\" (UID: \"99cab7b9-099b-4b1f-bfd5-ae34ca916791\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.225141 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.225067    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/99cab7b9-099b-4b1f-bfd5-ae34ca916791-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-znd67\" (UID: \"99cab7b9-099b-4b1f-bfd5-ae34ca916791\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.225141 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.225101    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlzkj\" (UniqueName: \"kubernetes.io/projected/99cab7b9-099b-4b1f-bfd5-ae34ca916791-kube-api-access-wlzkj\") pod \"istiod-openshift-gateway-5677ccb49b-znd67\" (UID: \"99cab7b9-099b-4b1f-bfd5-ae34ca916791\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.326534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.326445    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlzkj\" (UniqueName: \"kubernetes.io/projected/99cab7b9-099b-4b1f-bfd5-ae34ca916791-kube-api-access-wlzkj\") pod \"istiod-openshift-gateway-5677ccb49b-znd67\" (UID: \"99cab7b9-099b-4b1f-bfd5-ae34ca916791\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.326534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.326491    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/99cab7b9-099b-4b1f-bfd5-ae34ca916791-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-znd67\" (UID: \"99cab7b9-099b-4b1f-bfd5-ae34ca916791\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.326534 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.326518    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99cab7b9-099b-4b1f-bfd5-ae34ca916791-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-znd67\" (UID: \"99cab7b9-099b-4b1f-bfd5-ae34ca916791\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.326855 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.326543    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/99cab7b9-099b-4b1f-bfd5-ae34ca916791-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-znd67\" (UID: \"99cab7b9-099b-4b1f-bfd5-ae34ca916791\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.326855 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.326583    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/99cab7b9-099b-4b1f-bfd5-ae34ca916791-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-znd67\" (UID: \"99cab7b9-099b-4b1f-bfd5-ae34ca916791\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.326855 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.326603    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99cab7b9-099b-4b1f-bfd5-ae34ca916791-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-znd67\" (UID: \"99cab7b9-099b-4b1f-bfd5-ae34ca916791\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.326855 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.326619    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/99cab7b9-099b-4b1f-bfd5-ae34ca916791-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-znd67\" (UID: \"99cab7b9-099b-4b1f-bfd5-ae34ca916791\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.327200 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.327166    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/99cab7b9-099b-4b1f-bfd5-ae34ca916791-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-znd67\" (UID: \"99cab7b9-099b-4b1f-bfd5-ae34ca916791\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.329049 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.329018    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/99cab7b9-099b-4b1f-bfd5-ae34ca916791-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-znd67\" (UID: \"99cab7b9-099b-4b1f-bfd5-ae34ca916791\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.329150 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.329032    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/99cab7b9-099b-4b1f-bfd5-ae34ca916791-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-znd67\" (UID: \"99cab7b9-099b-4b1f-bfd5-ae34ca916791\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.329150 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.329130    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/99cab7b9-099b-4b1f-bfd5-ae34ca916791-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-znd67\" (UID: \"99cab7b9-099b-4b1f-bfd5-ae34ca916791\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.329221 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.329194    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99cab7b9-099b-4b1f-bfd5-ae34ca916791-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-znd67\" (UID: \"99cab7b9-099b-4b1f-bfd5-ae34ca916791\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.341105 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.341075    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlzkj\" (UniqueName: \"kubernetes.io/projected/99cab7b9-099b-4b1f-bfd5-ae34ca916791-kube-api-access-wlzkj\") pod \"istiod-openshift-gateway-5677ccb49b-znd67\" (UID: \"99cab7b9-099b-4b1f-bfd5-ae34ca916791\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.388724 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.388696    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99cab7b9-099b-4b1f-bfd5-ae34ca916791-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-znd67\" (UID: \"99cab7b9-099b-4b1f-bfd5-ae34ca916791\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.644573 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.644547    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:16.801677 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:16.801624    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"]
Aug 04 18:34:16.804600 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:34:16.804575    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99cab7b9_099b_4b1f_bfd5_ae34ca916791.slice/crio-e32ddc736c796420350521fe41520d4fd377debdfd84d61cc1027ef45d126b32 WatchSource:0}: Error finding container e32ddc736c796420350521fe41520d4fd377debdfd84d61cc1027ef45d126b32: Status 404 returned error can't find the container with id e32ddc736c796420350521fe41520d4fd377debdfd84d61cc1027ef45d126b32
Aug 04 18:34:17.483870 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:17.483831    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67" event={"ID":"99cab7b9-099b-4b1f-bfd5-ae34ca916791","Type":"ContainerStarted","Data":"e32ddc736c796420350521fe41520d4fd377debdfd84d61cc1027ef45d126b32"}
Aug 04 18:34:19.093214 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:19.093175    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Aug 04 18:34:19.093612 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:19.093258    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Aug 04 18:34:19.495735 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:19.495698    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67" event={"ID":"99cab7b9-099b-4b1f-bfd5-ae34ca916791","Type":"ContainerStarted","Data":"f32a7c9d5883409c307e61242bdf92f56ad2e6edf33aefd85c73119485c17b33"}
Aug 04 18:34:19.495950 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:19.495795    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:34:19.538449 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:19.538393    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67" podStartSLOduration=2.251838212 podStartE2EDuration="4.538374566s" totalImagesPullingTime="2.286536354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:34:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:34:19.536447638 +0000 UTC m=+380.070630726" watchObservedRunningTime="2026-08-04 18:34:19.538374566 +0000 UTC m=+380.072557655"
Aug 04 18:34:20.502044 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:20.502008    2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-znd67 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 18:34:20.502503 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:20.502070    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67" podUID="99cab7b9-099b-4b1f-bfd5-ae34ca916791" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:34:21.457624 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:21.457594    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6f7c986d68-88m26"
Aug 04 18:34:23.501164 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:34:23.501133    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67"
Aug 04 18:35:57.479992 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:35:57.479960    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2"]
Aug 04 18:35:57.483333 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:35:57.483307    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2"
Aug 04 18:35:57.490357 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:35:57.490335    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-j8gx9\""
Aug 04 18:35:57.490533 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:35:57.490513    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 04 18:35:57.490975 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:35:57.490869    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 04 18:35:57.534067 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:35:57.534031    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2"]
Aug 04 18:35:57.570561 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:35:57.570526    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7327cca5-2ac1-4e16-8a20-f8eb8f0cd656-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-x4vg2\" (UID: \"7327cca5-2ac1-4e16-8a20-f8eb8f0cd656\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2"
Aug 04 18:35:57.570736 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:35:57.570602    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n2nl\" (UniqueName: \"kubernetes.io/projected/7327cca5-2ac1-4e16-8a20-f8eb8f0cd656-kube-api-access-5n2nl\") pod \"kuadrant-operator-controller-manager-58fc56757c-x4vg2\" (UID: \"7327cca5-2ac1-4e16-8a20-f8eb8f0cd656\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2"
Aug 04 18:35:57.671232 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:35:57.671197    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n2nl\" (UniqueName: \"kubernetes.io/projected/7327cca5-2ac1-4e16-8a20-f8eb8f0cd656-kube-api-access-5n2nl\") pod \"kuadrant-operator-controller-manager-58fc56757c-x4vg2\" (UID: \"7327cca5-2ac1-4e16-8a20-f8eb8f0cd656\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2"
Aug 04 18:35:57.671417 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:35:57.671253    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7327cca5-2ac1-4e16-8a20-f8eb8f0cd656-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-x4vg2\" (UID: \"7327cca5-2ac1-4e16-8a20-f8eb8f0cd656\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2"
Aug 04 18:35:57.671653 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:35:57.671615    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7327cca5-2ac1-4e16-8a20-f8eb8f0cd656-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-x4vg2\" (UID: \"7327cca5-2ac1-4e16-8a20-f8eb8f0cd656\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2"
Aug 04 18:35:57.691345 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:35:57.691320    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n2nl\" (UniqueName: \"kubernetes.io/projected/7327cca5-2ac1-4e16-8a20-f8eb8f0cd656-kube-api-access-5n2nl\") pod \"kuadrant-operator-controller-manager-58fc56757c-x4vg2\" (UID: \"7327cca5-2ac1-4e16-8a20-f8eb8f0cd656\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2"
Aug 04 18:35:57.795851 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:35:57.795753    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2"
Aug 04 18:35:57.946601 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:35:57.946568    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2"]
Aug 04 18:35:57.951140 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:35:57.951103    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7327cca5_2ac1_4e16_8a20_f8eb8f0cd656.slice/crio-b46ec23dafb627ede932401401b222e5100880856874e897655c75f393df2872 WatchSource:0}: Error finding container b46ec23dafb627ede932401401b222e5100880856874e897655c75f393df2872: Status 404 returned error can't find the container with id b46ec23dafb627ede932401401b222e5100880856874e897655c75f393df2872
Aug 04 18:35:58.912008 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:35:58.911966    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2" event={"ID":"7327cca5-2ac1-4e16-8a20-f8eb8f0cd656","Type":"ContainerStarted","Data":"b46ec23dafb627ede932401401b222e5100880856874e897655c75f393df2872"}
Aug 04 18:36:02.936457 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:02.936422    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2" event={"ID":"7327cca5-2ac1-4e16-8a20-f8eb8f0cd656","Type":"ContainerStarted","Data":"c05eac445248b694b20a0452fd2813294440ec3ce7321dd1ede82182cf140f53"}
Aug 04 18:36:02.936886 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:02.936545    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2"
Aug 04 18:36:02.960735 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:02.960686    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2" podStartSLOduration=1.908943144 podStartE2EDuration="5.960669645s" totalImagesPullingTime="4.051726501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:35:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:36:02.95859413 +0000 UTC m=+483.492777219" watchObservedRunningTime="2026-08-04 18:36:02.960669645 +0000 UTC m=+483.494852730"
Aug 04 18:36:11.751482 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:11.751445    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2"]
Aug 04 18:36:11.752025 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:11.751675    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2" podUID="7327cca5-2ac1-4e16-8a20-f8eb8f0cd656" containerName="manager" containerID="cri-o://c05eac445248b694b20a0452fd2813294440ec3ce7321dd1ede82182cf140f53" gracePeriod=10
Aug 04 18:36:11.753663 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:11.753617    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2"
Aug 04 18:36:11.977815 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:11.977727    2558 generic.go:356] "Generic (PLEG): container finished" podID="7327cca5-2ac1-4e16-8a20-f8eb8f0cd656" containerID="c05eac445248b694b20a0452fd2813294440ec3ce7321dd1ede82182cf140f53" exitCode=0
Aug 04 18:36:11.977815 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:11.977786    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2" event={"ID":"7327cca5-2ac1-4e16-8a20-f8eb8f0cd656","Type":"ContainerDied","Data":"c05eac445248b694b20a0452fd2813294440ec3ce7321dd1ede82182cf140f53"}
Aug 04 18:36:11.977945 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:11.977828    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2" event={"ID":"7327cca5-2ac1-4e16-8a20-f8eb8f0cd656","Type":"ContainerDied","Data":"b46ec23dafb627ede932401401b222e5100880856874e897655c75f393df2872"}
Aug 04 18:36:11.977945 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:11.977844    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b46ec23dafb627ede932401401b222e5100880856874e897655c75f393df2872"
Aug 04 18:36:11.991754 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:11.991726    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2"
Aug 04 18:36:12.089754 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:12.089670    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5n2nl\" (UniqueName: \"kubernetes.io/projected/7327cca5-2ac1-4e16-8a20-f8eb8f0cd656-kube-api-access-5n2nl\") pod \"7327cca5-2ac1-4e16-8a20-f8eb8f0cd656\" (UID: \"7327cca5-2ac1-4e16-8a20-f8eb8f0cd656\") "
Aug 04 18:36:12.089754 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:12.089721    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7327cca5-2ac1-4e16-8a20-f8eb8f0cd656-extensions-socket-volume\") pod \"7327cca5-2ac1-4e16-8a20-f8eb8f0cd656\" (UID: \"7327cca5-2ac1-4e16-8a20-f8eb8f0cd656\") "
Aug 04 18:36:12.090249 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:12.090223    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7327cca5-2ac1-4e16-8a20-f8eb8f0cd656-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7327cca5-2ac1-4e16-8a20-f8eb8f0cd656" (UID: "7327cca5-2ac1-4e16-8a20-f8eb8f0cd656"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:36:12.091975 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:12.091951    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7327cca5-2ac1-4e16-8a20-f8eb8f0cd656-kube-api-access-5n2nl" (OuterVolumeSpecName: "kube-api-access-5n2nl") pod "7327cca5-2ac1-4e16-8a20-f8eb8f0cd656" (UID: "7327cca5-2ac1-4e16-8a20-f8eb8f0cd656"). InnerVolumeSpecName "kube-api-access-5n2nl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:36:12.190552 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:12.190518    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5n2nl\" (UniqueName: \"kubernetes.io/projected/7327cca5-2ac1-4e16-8a20-f8eb8f0cd656-kube-api-access-5n2nl\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:36:12.190552 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:12.190545    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7327cca5-2ac1-4e16-8a20-f8eb8f0cd656-extensions-socket-volume\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:36:12.982198 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:12.982157    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2"
Aug 04 18:36:13.008087 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:13.008059    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2"]
Aug 04 18:36:13.025096 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:13.025062    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x4vg2"]
Aug 04 18:36:13.962793 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:13.962762    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7327cca5-2ac1-4e16-8a20-f8eb8f0cd656" path="/var/lib/kubelet/pods/7327cca5-2ac1-4e16-8a20-f8eb8f0cd656/volumes"
Aug 04 18:36:29.770042 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:29.770006    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-64bx2"]
Aug 04 18:36:29.770436 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:29.770344    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7327cca5-2ac1-4e16-8a20-f8eb8f0cd656" containerName="manager"
Aug 04 18:36:29.770436 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:29.770356    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7327cca5-2ac1-4e16-8a20-f8eb8f0cd656" containerName="manager"
Aug 04 18:36:29.770436 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:29.770423    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7327cca5-2ac1-4e16-8a20-f8eb8f0cd656" containerName="manager"
Aug 04 18:36:29.773361 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:29.773341    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-64bx2"
Aug 04 18:36:29.775742 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:29.775711    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 04 18:36:29.775742 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:29.775711    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Aug 04 18:36:29.775899 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:29.775711    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 04 18:36:29.776361 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:29.776344    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zvb7z\""
Aug 04 18:36:29.783510 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:29.783490    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-64bx2"]
Aug 04 18:36:29.836732 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:29.836616    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4dd6\" (UniqueName: \"kubernetes.io/projected/0e9638c3-ed05-4b77-8620-c438418f4a39-kube-api-access-w4dd6\") pod \"limitador-limitador-859c4d96d6-64bx2\" (UID: \"0e9638c3-ed05-4b77-8620-c438418f4a39\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-64bx2"
Aug 04 18:36:29.836909 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:29.836740    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0e9638c3-ed05-4b77-8620-c438418f4a39-config-file\") pod \"limitador-limitador-859c4d96d6-64bx2\" (UID: \"0e9638c3-ed05-4b77-8620-c438418f4a39\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-64bx2"
Aug 04 18:36:29.866060 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:29.866022    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-64bx2"]
Aug 04 18:36:29.938079 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:29.938040    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0e9638c3-ed05-4b77-8620-c438418f4a39-config-file\") pod \"limitador-limitador-859c4d96d6-64bx2\" (UID: \"0e9638c3-ed05-4b77-8620-c438418f4a39\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-64bx2"
Aug 04 18:36:29.938267 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:29.938115    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4dd6\" (UniqueName: \"kubernetes.io/projected/0e9638c3-ed05-4b77-8620-c438418f4a39-kube-api-access-w4dd6\") pod \"limitador-limitador-859c4d96d6-64bx2\" (UID: \"0e9638c3-ed05-4b77-8620-c438418f4a39\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-64bx2"
Aug 04 18:36:29.938791 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:29.938772    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0e9638c3-ed05-4b77-8620-c438418f4a39-config-file\") pod \"limitador-limitador-859c4d96d6-64bx2\" (UID: \"0e9638c3-ed05-4b77-8620-c438418f4a39\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-64bx2"
Aug 04 18:36:29.949299 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:29.949274    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4dd6\" (UniqueName: \"kubernetes.io/projected/0e9638c3-ed05-4b77-8620-c438418f4a39-kube-api-access-w4dd6\") pod \"limitador-limitador-859c4d96d6-64bx2\" (UID: \"0e9638c3-ed05-4b77-8620-c438418f4a39\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-64bx2"
Aug 04 18:36:30.083745 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:30.083661    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-64bx2"
Aug 04 18:36:30.231140 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:30.231113    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-64bx2"]
Aug 04 18:36:30.233172 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:36:30.233146    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e9638c3_ed05_4b77_8620_c438418f4a39.slice/crio-3c6a11a26af1c0d9ab5c9340e5bf6e77d08283262c088b7261c1d16983af7a93 WatchSource:0}: Error finding container 3c6a11a26af1c0d9ab5c9340e5bf6e77d08283262c088b7261c1d16983af7a93: Status 404 returned error can't find the container with id 3c6a11a26af1c0d9ab5c9340e5bf6e77d08283262c088b7261c1d16983af7a93
Aug 04 18:36:31.058854 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:31.058813    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-64bx2" event={"ID":"0e9638c3-ed05-4b77-8620-c438418f4a39","Type":"ContainerStarted","Data":"3c6a11a26af1c0d9ab5c9340e5bf6e77d08283262c088b7261c1d16983af7a93"}
Aug 04 18:36:32.064282 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:32.064246    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-64bx2" event={"ID":"0e9638c3-ed05-4b77-8620-c438418f4a39","Type":"ContainerStarted","Data":"c61b82df7fc6b02672ac8767e077c4d729882438889e586def486be965945767"}
Aug 04 18:36:32.064684 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:32.064311    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-64bx2"
Aug 04 18:36:32.081533 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:32.081478    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-64bx2" podStartSLOduration=2.056952216 podStartE2EDuration="3.081461302s" totalImagesPullingTime="1.024509086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:36:32.081091928 +0000 UTC m=+512.615275017" watchObservedRunningTime="2026-08-04 18:36:32.081461302 +0000 UTC m=+512.615644391"
Aug 04 18:36:43.069876 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:43.069845    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-64bx2"
Aug 04 18:36:45.187119 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:45.187082    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-64bx2"]
Aug 04 18:36:45.187567 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:45.187261    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-64bx2" podUID="0e9638c3-ed05-4b77-8620-c438418f4a39" containerName="limitador" containerID="cri-o://c61b82df7fc6b02672ac8767e077c4d729882438889e586def486be965945767" gracePeriod=30
Aug 04 18:36:45.726113 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:45.726090    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-64bx2"
Aug 04 18:36:45.868342 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:45.868257    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0e9638c3-ed05-4b77-8620-c438418f4a39-config-file\") pod \"0e9638c3-ed05-4b77-8620-c438418f4a39\" (UID: \"0e9638c3-ed05-4b77-8620-c438418f4a39\") "
Aug 04 18:36:45.868342 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:45.868311    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4dd6\" (UniqueName: \"kubernetes.io/projected/0e9638c3-ed05-4b77-8620-c438418f4a39-kube-api-access-w4dd6\") pod \"0e9638c3-ed05-4b77-8620-c438418f4a39\" (UID: \"0e9638c3-ed05-4b77-8620-c438418f4a39\") "
Aug 04 18:36:45.868621 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:45.868598    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e9638c3-ed05-4b77-8620-c438418f4a39-config-file" (OuterVolumeSpecName: "config-file") pod "0e9638c3-ed05-4b77-8620-c438418f4a39" (UID: "0e9638c3-ed05-4b77-8620-c438418f4a39"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:36:45.870377 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:45.870354    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e9638c3-ed05-4b77-8620-c438418f4a39-kube-api-access-w4dd6" (OuterVolumeSpecName: "kube-api-access-w4dd6") pod "0e9638c3-ed05-4b77-8620-c438418f4a39" (UID: "0e9638c3-ed05-4b77-8620-c438418f4a39"). InnerVolumeSpecName "kube-api-access-w4dd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:36:45.968969 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:45.968935    2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0e9638c3-ed05-4b77-8620-c438418f4a39-config-file\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:36:45.968969 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:45.968968    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4dd6\" (UniqueName: \"kubernetes.io/projected/0e9638c3-ed05-4b77-8620-c438418f4a39-kube-api-access-w4dd6\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:36:46.126452 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:46.126364    2558 generic.go:356] "Generic (PLEG): container finished" podID="0e9638c3-ed05-4b77-8620-c438418f4a39" containerID="c61b82df7fc6b02672ac8767e077c4d729882438889e586def486be965945767" exitCode=0
Aug 04 18:36:46.126452 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:46.126409    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-64bx2"
Aug 04 18:36:46.126722 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:46.126458    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-64bx2" event={"ID":"0e9638c3-ed05-4b77-8620-c438418f4a39","Type":"ContainerDied","Data":"c61b82df7fc6b02672ac8767e077c4d729882438889e586def486be965945767"}
Aug 04 18:36:46.126722 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:46.126519    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-64bx2" event={"ID":"0e9638c3-ed05-4b77-8620-c438418f4a39","Type":"ContainerDied","Data":"3c6a11a26af1c0d9ab5c9340e5bf6e77d08283262c088b7261c1d16983af7a93"}
Aug 04 18:36:46.126722 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:46.126548    2558 scope.go:117] "RemoveContainer" containerID="c61b82df7fc6b02672ac8767e077c4d729882438889e586def486be965945767"
Aug 04 18:36:46.140216 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:46.134836    2558 scope.go:117] "RemoveContainer" containerID="c61b82df7fc6b02672ac8767e077c4d729882438889e586def486be965945767"
Aug 04 18:36:46.140216 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:36:46.135151    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c61b82df7fc6b02672ac8767e077c4d729882438889e586def486be965945767\": container with ID starting with c61b82df7fc6b02672ac8767e077c4d729882438889e586def486be965945767 not found: ID does not exist" containerID="c61b82df7fc6b02672ac8767e077c4d729882438889e586def486be965945767"
Aug 04 18:36:46.140216 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:46.135188    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c61b82df7fc6b02672ac8767e077c4d729882438889e586def486be965945767"} err="failed to get container status \"c61b82df7fc6b02672ac8767e077c4d729882438889e586def486be965945767\": rpc error: code = NotFound desc = could not find container \"c61b82df7fc6b02672ac8767e077c4d729882438889e586def486be965945767\": container with ID starting with c61b82df7fc6b02672ac8767e077c4d729882438889e586def486be965945767 not found: ID does not exist"
Aug 04 18:36:46.146396 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:46.146373    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-64bx2"]
Aug 04 18:36:46.152680 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:46.152646    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-64bx2"]
Aug 04 18:36:47.962525 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:47.962487    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e9638c3-ed05-4b77-8620-c438418f4a39" path="/var/lib/kubelet/pods/0e9638c3-ed05-4b77-8620-c438418f4a39/volumes"
Aug 04 18:36:51.417512 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:51.417479    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mcff7"]
Aug 04 18:36:51.417907 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:51.417818    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e9638c3-ed05-4b77-8620-c438418f4a39" containerName="limitador"
Aug 04 18:36:51.417907 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:51.417830    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e9638c3-ed05-4b77-8620-c438418f4a39" containerName="limitador"
Aug 04 18:36:51.417907 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:51.417884    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e9638c3-ed05-4b77-8620-c438418f4a39" containerName="limitador"
Aug 04 18:36:51.420367 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:51.420347    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mcff7"
Aug 04 18:36:51.423325 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:51.423293    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Aug 04 18:36:51.423325 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:51.423313    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-wjt7b\""
Aug 04 18:36:51.423502 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:51.423442    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 18:36:51.423616 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:51.423602    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:36:51.433503 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:51.433482    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mcff7"]
Aug 04 18:36:51.516487 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:51.516455    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e78ebb59-7ab9-4460-aa75-1d8cd044639d-data\") pod \"postgres-69fb4594cf-mcff7\" (UID: \"e78ebb59-7ab9-4460-aa75-1d8cd044639d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mcff7"
Aug 04 18:36:51.516655 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:51.516526    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkjdb\" (UniqueName: \"kubernetes.io/projected/e78ebb59-7ab9-4460-aa75-1d8cd044639d-kube-api-access-wkjdb\") pod \"postgres-69fb4594cf-mcff7\" (UID: \"e78ebb59-7ab9-4460-aa75-1d8cd044639d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mcff7"
Aug 04 18:36:51.617607 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:51.617580    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e78ebb59-7ab9-4460-aa75-1d8cd044639d-data\") pod \"postgres-69fb4594cf-mcff7\" (UID: \"e78ebb59-7ab9-4460-aa75-1d8cd044639d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mcff7"
Aug 04 18:36:51.617775 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:51.617622    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkjdb\" (UniqueName: \"kubernetes.io/projected/e78ebb59-7ab9-4460-aa75-1d8cd044639d-kube-api-access-wkjdb\") pod \"postgres-69fb4594cf-mcff7\" (UID: \"e78ebb59-7ab9-4460-aa75-1d8cd044639d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mcff7"
Aug 04 18:36:51.617928 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:51.617910    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e78ebb59-7ab9-4460-aa75-1d8cd044639d-data\") pod \"postgres-69fb4594cf-mcff7\" (UID: \"e78ebb59-7ab9-4460-aa75-1d8cd044639d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mcff7"
Aug 04 18:36:51.626169 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:51.626138    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkjdb\" (UniqueName: \"kubernetes.io/projected/e78ebb59-7ab9-4460-aa75-1d8cd044639d-kube-api-access-wkjdb\") pod \"postgres-69fb4594cf-mcff7\" (UID: \"e78ebb59-7ab9-4460-aa75-1d8cd044639d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mcff7"
Aug 04 18:36:51.730929 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:51.730856    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mcff7"
Aug 04 18:36:51.866403 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:51.866234    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mcff7"]
Aug 04 18:36:51.869195 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:36:51.869167    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode78ebb59_7ab9_4460_aa75_1d8cd044639d.slice/crio-353764250b7721f50002e22b2f39ab8066147a1cc9175faf754245ee612760d6 WatchSource:0}: Error finding container 353764250b7721f50002e22b2f39ab8066147a1cc9175faf754245ee612760d6: Status 404 returned error can't find the container with id 353764250b7721f50002e22b2f39ab8066147a1cc9175faf754245ee612760d6
Aug 04 18:36:52.152580 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:52.152541    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mcff7" event={"ID":"e78ebb59-7ab9-4460-aa75-1d8cd044639d","Type":"ContainerStarted","Data":"353764250b7721f50002e22b2f39ab8066147a1cc9175faf754245ee612760d6"}
Aug 04 18:36:57.179829 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:57.179796    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mcff7" event={"ID":"e78ebb59-7ab9-4460-aa75-1d8cd044639d","Type":"ContainerStarted","Data":"94f383cdfb83d46e6492577ef33f9fdde4570bcf3a44825269a5d84b14fdf596"}
Aug 04 18:36:57.180198 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:57.179939    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mcff7"
Aug 04 18:36:57.196963 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:36:57.196913    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mcff7" podStartSLOduration=1.02291723 podStartE2EDuration="6.196895515s" totalImagesPullingTime="5.173978285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:36:57.19670882 +0000 UTC m=+537.730891909" watchObservedRunningTime="2026-08-04 18:36:57.196895515 +0000 UTC m=+537.731078604"
Aug 04 18:37:03.212779 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:03.212752    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mcff7"
Aug 04 18:37:10.001891 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.001857    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-cfd6b4d4-4cbbn"]
Aug 04 18:37:10.007626 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.007600    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cfd6b4d4-4cbbn"
Aug 04 18:37:10.010044 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.009994    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 04 18:37:10.010196 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.010053    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 04 18:37:10.010344 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.010326    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-86kd4\""
Aug 04 18:37:10.015790 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.015719    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cfd6b4d4-4cbbn"]
Aug 04 18:37:10.166317 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.166284    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-549599b85-s679m"]
Aug 04 18:37:10.170079 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.170063    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-549599b85-s679m"
Aug 04 18:37:10.180113 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.180088    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-549599b85-s679m"]
Aug 04 18:37:10.184892 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.184871    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j47qk\" (UniqueName: \"kubernetes.io/projected/1499761d-56ec-4b12-99d5-51d2366820a3-kube-api-access-j47qk\") pod \"maas-controller-cfd6b4d4-4cbbn\" (UID: \"1499761d-56ec-4b12-99d5-51d2366820a3\") " pod="opendatahub/maas-controller-cfd6b4d4-4cbbn"
Aug 04 18:37:10.185009 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.184936    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1499761d-56ec-4b12-99d5-51d2366820a3-webhook-cert\") pod \"maas-controller-cfd6b4d4-4cbbn\" (UID: \"1499761d-56ec-4b12-99d5-51d2366820a3\") " pod="opendatahub/maas-controller-cfd6b4d4-4cbbn"
Aug 04 18:37:10.285749 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.285650    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1499761d-56ec-4b12-99d5-51d2366820a3-webhook-cert\") pod \"maas-controller-cfd6b4d4-4cbbn\" (UID: \"1499761d-56ec-4b12-99d5-51d2366820a3\") " pod="opendatahub/maas-controller-cfd6b4d4-4cbbn"
Aug 04 18:37:10.285749 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.285697    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d699d0a4-34f5-4939-a1bf-08c1fa2289bd-webhook-cert\") pod \"maas-controller-549599b85-s679m\" (UID: \"d699d0a4-34f5-4939-a1bf-08c1fa2289bd\") " pod="opendatahub/maas-controller-549599b85-s679m"
Aug 04 18:37:10.285968 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.285787    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j47qk\" (UniqueName: \"kubernetes.io/projected/1499761d-56ec-4b12-99d5-51d2366820a3-kube-api-access-j47qk\") pod \"maas-controller-cfd6b4d4-4cbbn\" (UID: \"1499761d-56ec-4b12-99d5-51d2366820a3\") " pod="opendatahub/maas-controller-cfd6b4d4-4cbbn"
Aug 04 18:37:10.285968 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.285827    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-964r5\" (UniqueName: \"kubernetes.io/projected/d699d0a4-34f5-4939-a1bf-08c1fa2289bd-kube-api-access-964r5\") pod \"maas-controller-549599b85-s679m\" (UID: \"d699d0a4-34f5-4939-a1bf-08c1fa2289bd\") " pod="opendatahub/maas-controller-549599b85-s679m"
Aug 04 18:37:10.288239 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.288210    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1499761d-56ec-4b12-99d5-51d2366820a3-webhook-cert\") pod \"maas-controller-cfd6b4d4-4cbbn\" (UID: \"1499761d-56ec-4b12-99d5-51d2366820a3\") " pod="opendatahub/maas-controller-cfd6b4d4-4cbbn"
Aug 04 18:37:10.299397 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.299372    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j47qk\" (UniqueName: \"kubernetes.io/projected/1499761d-56ec-4b12-99d5-51d2366820a3-kube-api-access-j47qk\") pod \"maas-controller-cfd6b4d4-4cbbn\" (UID: \"1499761d-56ec-4b12-99d5-51d2366820a3\") " pod="opendatahub/maas-controller-cfd6b4d4-4cbbn"
Aug 04 18:37:10.321210 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.321185    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cfd6b4d4-4cbbn"
Aug 04 18:37:10.386764 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.386737    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d699d0a4-34f5-4939-a1bf-08c1fa2289bd-webhook-cert\") pod \"maas-controller-549599b85-s679m\" (UID: \"d699d0a4-34f5-4939-a1bf-08c1fa2289bd\") " pod="opendatahub/maas-controller-549599b85-s679m"
Aug 04 18:37:10.386880 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.386804    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-964r5\" (UniqueName: \"kubernetes.io/projected/d699d0a4-34f5-4939-a1bf-08c1fa2289bd-kube-api-access-964r5\") pod \"maas-controller-549599b85-s679m\" (UID: \"d699d0a4-34f5-4939-a1bf-08c1fa2289bd\") " pod="opendatahub/maas-controller-549599b85-s679m"
Aug 04 18:37:10.389176 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.389148    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d699d0a4-34f5-4939-a1bf-08c1fa2289bd-webhook-cert\") pod \"maas-controller-549599b85-s679m\" (UID: \"d699d0a4-34f5-4939-a1bf-08c1fa2289bd\") " pod="opendatahub/maas-controller-549599b85-s679m"
Aug 04 18:37:10.396847 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.396821    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-964r5\" (UniqueName: \"kubernetes.io/projected/d699d0a4-34f5-4939-a1bf-08c1fa2289bd-kube-api-access-964r5\") pod \"maas-controller-549599b85-s679m\" (UID: \"d699d0a4-34f5-4939-a1bf-08c1fa2289bd\") " pod="opendatahub/maas-controller-549599b85-s679m"
Aug 04 18:37:10.450954 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.450928    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cfd6b4d4-4cbbn"]
Aug 04 18:37:10.453378 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:37:10.453348    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1499761d_56ec_4b12_99d5_51d2366820a3.slice/crio-f63e9ae6a962a2ac9bd13f975b98f3779b4b7d2397f693269eefa4b2c027f164 WatchSource:0}: Error finding container f63e9ae6a962a2ac9bd13f975b98f3779b4b7d2397f693269eefa4b2c027f164: Status 404 returned error can't find the container with id f63e9ae6a962a2ac9bd13f975b98f3779b4b7d2397f693269eefa4b2c027f164
Aug 04 18:37:10.480747 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.480719    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-549599b85-s679m"
Aug 04 18:37:10.615151 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:10.615124    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-549599b85-s679m"]
Aug 04 18:37:10.617471 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:37:10.617447    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd699d0a4_34f5_4939_a1bf_08c1fa2289bd.slice/crio-38e2aa5cf57052affcc5ffa5e7b6fa9f80db00921885c81624fb298caeb1a750 WatchSource:0}: Error finding container 38e2aa5cf57052affcc5ffa5e7b6fa9f80db00921885c81624fb298caeb1a750: Status 404 returned error can't find the container with id 38e2aa5cf57052affcc5ffa5e7b6fa9f80db00921885c81624fb298caeb1a750
Aug 04 18:37:11.238604 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:11.238556    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-549599b85-s679m" event={"ID":"d699d0a4-34f5-4939-a1bf-08c1fa2289bd","Type":"ContainerStarted","Data":"38e2aa5cf57052affcc5ffa5e7b6fa9f80db00921885c81624fb298caeb1a750"}
Aug 04 18:37:11.239698 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:11.239675    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cfd6b4d4-4cbbn" event={"ID":"1499761d-56ec-4b12-99d5-51d2366820a3","Type":"ContainerStarted","Data":"f63e9ae6a962a2ac9bd13f975b98f3779b4b7d2397f693269eefa4b2c027f164"}
Aug 04 18:37:14.257005 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:14.256962    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-549599b85-s679m" event={"ID":"d699d0a4-34f5-4939-a1bf-08c1fa2289bd","Type":"ContainerStarted","Data":"59977f1b16a510a0bd434e9fed621a8b5effbf1ee0927fc0c2acfcea521523f4"}
Aug 04 18:37:14.257525 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:14.257073    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-549599b85-s679m"
Aug 04 18:37:14.258442 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:14.258418    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cfd6b4d4-4cbbn" event={"ID":"1499761d-56ec-4b12-99d5-51d2366820a3","Type":"ContainerStarted","Data":"7ea81144aa27c805dd3641d3284a8b32eaab6abd2a53f6bc91319ec5cc9cb163"}
Aug 04 18:37:14.258560 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:14.258514    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-cfd6b4d4-4cbbn"
Aug 04 18:37:14.281951 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:14.281899    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-549599b85-s679m" podStartSLOduration=1.533553418 podStartE2EDuration="4.281880719s" totalImagesPullingTime="2.748327301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:37:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:37:14.280124107 +0000 UTC m=+554.814307197" watchObservedRunningTime="2026-08-04 18:37:14.281880719 +0000 UTC m=+554.816063810"
Aug 04 18:37:14.298926 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:14.298872    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-cfd6b4d4-4cbbn" podStartSLOduration=2.392943066 podStartE2EDuration="5.298854843s" totalImagesPullingTime="2.905911777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:37:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:37:14.298105632 +0000 UTC m=+554.832288722" watchObservedRunningTime="2026-08-04 18:37:14.298854843 +0000 UTC m=+554.833037934"
Aug 04 18:37:25.264298 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:25.264267    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-cfd6b4d4-4cbbn"
Aug 04 18:37:25.264729 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:25.264343    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-549599b85-s679m"
Aug 04 18:37:25.325821 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:25.325790    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cfd6b4d4-4cbbn"]
Aug 04 18:37:25.326019 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:25.325992    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-cfd6b4d4-4cbbn" podUID="1499761d-56ec-4b12-99d5-51d2366820a3" containerName="manager" containerID="cri-o://7ea81144aa27c805dd3641d3284a8b32eaab6abd2a53f6bc91319ec5cc9cb163" gracePeriod=30
Aug 04 18:37:25.569686 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:25.569661    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cfd6b4d4-4cbbn"
Aug 04 18:37:25.615442 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:25.615414    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1499761d-56ec-4b12-99d5-51d2366820a3-webhook-cert\") pod \"1499761d-56ec-4b12-99d5-51d2366820a3\" (UID: \"1499761d-56ec-4b12-99d5-51d2366820a3\") "
Aug 04 18:37:25.615622 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:25.615538    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j47qk\" (UniqueName: \"kubernetes.io/projected/1499761d-56ec-4b12-99d5-51d2366820a3-kube-api-access-j47qk\") pod \"1499761d-56ec-4b12-99d5-51d2366820a3\" (UID: \"1499761d-56ec-4b12-99d5-51d2366820a3\") "
Aug 04 18:37:25.617683 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:25.617656    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1499761d-56ec-4b12-99d5-51d2366820a3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1499761d-56ec-4b12-99d5-51d2366820a3" (UID: "1499761d-56ec-4b12-99d5-51d2366820a3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:37:25.617804 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:25.617783    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1499761d-56ec-4b12-99d5-51d2366820a3-kube-api-access-j47qk" (OuterVolumeSpecName: "kube-api-access-j47qk") pod "1499761d-56ec-4b12-99d5-51d2366820a3" (UID: "1499761d-56ec-4b12-99d5-51d2366820a3"). InnerVolumeSpecName "kube-api-access-j47qk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:37:25.716597 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:25.716566    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1499761d-56ec-4b12-99d5-51d2366820a3-webhook-cert\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:37:25.716597 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:25.716592    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j47qk\" (UniqueName: \"kubernetes.io/projected/1499761d-56ec-4b12-99d5-51d2366820a3-kube-api-access-j47qk\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:37:26.311051 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:26.310963    2558 generic.go:356] "Generic (PLEG): container finished" podID="1499761d-56ec-4b12-99d5-51d2366820a3" containerID="7ea81144aa27c805dd3641d3284a8b32eaab6abd2a53f6bc91319ec5cc9cb163" exitCode=0
Aug 04 18:37:26.311051 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:26.311006    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cfd6b4d4-4cbbn"
Aug 04 18:37:26.311051 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:26.311041    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cfd6b4d4-4cbbn" event={"ID":"1499761d-56ec-4b12-99d5-51d2366820a3","Type":"ContainerDied","Data":"7ea81144aa27c805dd3641d3284a8b32eaab6abd2a53f6bc91319ec5cc9cb163"}
Aug 04 18:37:26.311531 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:26.311098    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cfd6b4d4-4cbbn" event={"ID":"1499761d-56ec-4b12-99d5-51d2366820a3","Type":"ContainerDied","Data":"f63e9ae6a962a2ac9bd13f975b98f3779b4b7d2397f693269eefa4b2c027f164"}
Aug 04 18:37:26.311531 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:26.311129    2558 scope.go:117] "RemoveContainer" containerID="7ea81144aa27c805dd3641d3284a8b32eaab6abd2a53f6bc91319ec5cc9cb163"
Aug 04 18:37:26.319627 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:26.319615    2558 scope.go:117] "RemoveContainer" containerID="7ea81144aa27c805dd3641d3284a8b32eaab6abd2a53f6bc91319ec5cc9cb163"
Aug 04 18:37:26.319893 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:37:26.319871    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ea81144aa27c805dd3641d3284a8b32eaab6abd2a53f6bc91319ec5cc9cb163\": container with ID starting with 7ea81144aa27c805dd3641d3284a8b32eaab6abd2a53f6bc91319ec5cc9cb163 not found: ID does not exist" containerID="7ea81144aa27c805dd3641d3284a8b32eaab6abd2a53f6bc91319ec5cc9cb163"
Aug 04 18:37:26.319946 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:26.319902    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ea81144aa27c805dd3641d3284a8b32eaab6abd2a53f6bc91319ec5cc9cb163"} err="failed to get container status \"7ea81144aa27c805dd3641d3284a8b32eaab6abd2a53f6bc91319ec5cc9cb163\": rpc error: code = NotFound desc = could not find container \"7ea81144aa27c805dd3641d3284a8b32eaab6abd2a53f6bc91319ec5cc9cb163\": container with ID starting with 7ea81144aa27c805dd3641d3284a8b32eaab6abd2a53f6bc91319ec5cc9cb163 not found: ID does not exist"
Aug 04 18:37:26.326320 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:26.326296    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cfd6b4d4-4cbbn"]
Aug 04 18:37:26.330438 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:26.330414    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-cfd6b4d4-4cbbn"]
Aug 04 18:37:27.962758 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:27.962718    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1499761d-56ec-4b12-99d5-51d2366820a3" path="/var/lib/kubelet/pods/1499761d-56ec-4b12-99d5-51d2366820a3/volumes"
Aug 04 18:37:43.982867 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:43.982828    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6cbd958b9d-rmhd8"]
Aug 04 18:37:43.983390 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:43.983288    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1499761d-56ec-4b12-99d5-51d2366820a3" containerName="manager"
Aug 04 18:37:43.983390 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:43.983306    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1499761d-56ec-4b12-99d5-51d2366820a3" containerName="manager"
Aug 04 18:37:43.983390 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:43.983385    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1499761d-56ec-4b12-99d5-51d2366820a3" containerName="manager"
Aug 04 18:37:44.001582 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.001549    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6cbd958b9d-rmhd8"]
Aug 04 18:37:44.001763 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.001673    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6cbd958b9d-rmhd8"
Aug 04 18:37:44.004889 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.004868    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Aug 04 18:37:44.004994 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.004869    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2lnvj\""
Aug 04 18:37:44.082918 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.082880    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk7rx\" (UniqueName: \"kubernetes.io/projected/6b0fc874-c6be-4667-8361-c68235b4174b-kube-api-access-dk7rx\") pod \"maas-api-6cbd958b9d-rmhd8\" (UID: \"6b0fc874-c6be-4667-8361-c68235b4174b\") " pod="odh-ai-gateway-infra/maas-api-6cbd958b9d-rmhd8"
Aug 04 18:37:44.082918 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.082919    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b0fc874-c6be-4667-8361-c68235b4174b-openshift-service-ca\") pod \"maas-api-6cbd958b9d-rmhd8\" (UID: \"6b0fc874-c6be-4667-8361-c68235b4174b\") " pod="odh-ai-gateway-infra/maas-api-6cbd958b9d-rmhd8"
Aug 04 18:37:44.083122 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.083005    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b0fc874-c6be-4667-8361-c68235b4174b-maas-api-tls\") pod \"maas-api-6cbd958b9d-rmhd8\" (UID: \"6b0fc874-c6be-4667-8361-c68235b4174b\") " pod="odh-ai-gateway-infra/maas-api-6cbd958b9d-rmhd8"
Aug 04 18:37:44.183928 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.183874    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b0fc874-c6be-4667-8361-c68235b4174b-maas-api-tls\") pod \"maas-api-6cbd958b9d-rmhd8\" (UID: \"6b0fc874-c6be-4667-8361-c68235b4174b\") " pod="odh-ai-gateway-infra/maas-api-6cbd958b9d-rmhd8"
Aug 04 18:37:44.184138 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.183979    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk7rx\" (UniqueName: \"kubernetes.io/projected/6b0fc874-c6be-4667-8361-c68235b4174b-kube-api-access-dk7rx\") pod \"maas-api-6cbd958b9d-rmhd8\" (UID: \"6b0fc874-c6be-4667-8361-c68235b4174b\") " pod="odh-ai-gateway-infra/maas-api-6cbd958b9d-rmhd8"
Aug 04 18:37:44.184138 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.184010    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b0fc874-c6be-4667-8361-c68235b4174b-openshift-service-ca\") pod \"maas-api-6cbd958b9d-rmhd8\" (UID: \"6b0fc874-c6be-4667-8361-c68235b4174b\") " pod="odh-ai-gateway-infra/maas-api-6cbd958b9d-rmhd8"
Aug 04 18:37:44.184752 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.184726    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b0fc874-c6be-4667-8361-c68235b4174b-openshift-service-ca\") pod \"maas-api-6cbd958b9d-rmhd8\" (UID: \"6b0fc874-c6be-4667-8361-c68235b4174b\") " pod="odh-ai-gateway-infra/maas-api-6cbd958b9d-rmhd8"
Aug 04 18:37:44.186558 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.186535    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b0fc874-c6be-4667-8361-c68235b4174b-maas-api-tls\") pod \"maas-api-6cbd958b9d-rmhd8\" (UID: \"6b0fc874-c6be-4667-8361-c68235b4174b\") " pod="odh-ai-gateway-infra/maas-api-6cbd958b9d-rmhd8"
Aug 04 18:37:44.192419 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.192396    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk7rx\" (UniqueName: \"kubernetes.io/projected/6b0fc874-c6be-4667-8361-c68235b4174b-kube-api-access-dk7rx\") pod \"maas-api-6cbd958b9d-rmhd8\" (UID: \"6b0fc874-c6be-4667-8361-c68235b4174b\") " pod="odh-ai-gateway-infra/maas-api-6cbd958b9d-rmhd8"
Aug 04 18:37:44.313945 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.313866    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6cbd958b9d-rmhd8"
Aug 04 18:37:44.457581 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.457557    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6cbd958b9d-rmhd8"]
Aug 04 18:37:44.460562 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:37:44.460538    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b0fc874_c6be_4667_8361_c68235b4174b.slice/crio-7751fad72269734080f4e244ef422c6f48aa28106d8ea24642365eaf4148b980 WatchSource:0}: Error finding container 7751fad72269734080f4e244ef422c6f48aa28106d8ea24642365eaf4148b980: Status 404 returned error can't find the container with id 7751fad72269734080f4e244ef422c6f48aa28106d8ea24642365eaf4148b980
Aug 04 18:37:44.547990 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.547957    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-km5dc"]
Aug 04 18:37:44.552365 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.552342    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-km5dc"
Aug 04 18:37:44.554596 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.554573    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-d4xk8\""
Aug 04 18:37:44.555060 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.555044    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Aug 04 18:37:44.562927 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.562907    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-km5dc"]
Aug 04 18:37:44.687713 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.687678    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjfw4\" (UniqueName: \"kubernetes.io/projected/c846dd43-dccc-4edf-9893-358dd6e879c1-kube-api-access-pjfw4\") pod \"payload-processing-5cc6cd444b-km5dc\" (UID: \"c846dd43-dccc-4edf-9893-358dd6e879c1\") " pod="openshift-ingress/payload-processing-5cc6cd444b-km5dc"
Aug 04 18:37:44.687897 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.687750    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c846dd43-dccc-4edf-9893-358dd6e879c1-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-km5dc\" (UID: \"c846dd43-dccc-4edf-9893-358dd6e879c1\") " pod="openshift-ingress/payload-processing-5cc6cd444b-km5dc"
Aug 04 18:37:44.788461 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.788427    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c846dd43-dccc-4edf-9893-358dd6e879c1-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-km5dc\" (UID: \"c846dd43-dccc-4edf-9893-358dd6e879c1\") " pod="openshift-ingress/payload-processing-5cc6cd444b-km5dc"
Aug 04 18:37:44.788621 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.788500    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfw4\" (UniqueName: \"kubernetes.io/projected/c846dd43-dccc-4edf-9893-358dd6e879c1-kube-api-access-pjfw4\") pod \"payload-processing-5cc6cd444b-km5dc\" (UID: \"c846dd43-dccc-4edf-9893-358dd6e879c1\") " pod="openshift-ingress/payload-processing-5cc6cd444b-km5dc"
Aug 04 18:37:44.789124 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.789106    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c846dd43-dccc-4edf-9893-358dd6e879c1-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-km5dc\" (UID: \"c846dd43-dccc-4edf-9893-358dd6e879c1\") " pod="openshift-ingress/payload-processing-5cc6cd444b-km5dc"
Aug 04 18:37:44.800991 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.800963    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjfw4\" (UniqueName: \"kubernetes.io/projected/c846dd43-dccc-4edf-9893-358dd6e879c1-kube-api-access-pjfw4\") pod \"payload-processing-5cc6cd444b-km5dc\" (UID: \"c846dd43-dccc-4edf-9893-358dd6e879c1\") " pod="openshift-ingress/payload-processing-5cc6cd444b-km5dc"
Aug 04 18:37:44.863884 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:44.863847    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-km5dc"
Aug 04 18:37:45.030667 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:45.030623    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-km5dc"]
Aug 04 18:37:45.032499 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:37:45.032472    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc846dd43_dccc_4edf_9893_358dd6e879c1.slice/crio-3166e0d8235f65e76391dc67bc1c4728948c21cb55bb42de45da3c9ab373568b WatchSource:0}: Error finding container 3166e0d8235f65e76391dc67bc1c4728948c21cb55bb42de45da3c9ab373568b: Status 404 returned error can't find the container with id 3166e0d8235f65e76391dc67bc1c4728948c21cb55bb42de45da3c9ab373568b
Aug 04 18:37:45.399027 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:45.398993    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6cbd958b9d-rmhd8" event={"ID":"6b0fc874-c6be-4667-8361-c68235b4174b","Type":"ContainerStarted","Data":"7751fad72269734080f4e244ef422c6f48aa28106d8ea24642365eaf4148b980"}
Aug 04 18:37:45.400361 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:45.400327    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-km5dc" event={"ID":"c846dd43-dccc-4edf-9893-358dd6e879c1","Type":"ContainerStarted","Data":"3166e0d8235f65e76391dc67bc1c4728948c21cb55bb42de45da3c9ab373568b"}
Aug 04 18:37:48.417652 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:48.417595    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6cbd958b9d-rmhd8" event={"ID":"6b0fc874-c6be-4667-8361-c68235b4174b","Type":"ContainerStarted","Data":"8917d9e74e2d938ba051e0c3df3d5bf8f9897ceb4b25ab75324be558ef413ff0"}
Aug 04 18:37:48.418127 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:48.417693    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6cbd958b9d-rmhd8"
Aug 04 18:37:48.419281 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:48.419249    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-km5dc" event={"ID":"c846dd43-dccc-4edf-9893-358dd6e879c1","Type":"ContainerStarted","Data":"2ed352c1767386372ae2c616312aca7cc885541b735d5fcad5afa31470159a74"}
Aug 04 18:37:48.419400 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:48.419307    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-km5dc"
Aug 04 18:37:48.438677 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:48.438604    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6cbd958b9d-rmhd8" podStartSLOduration=2.429381237 podStartE2EDuration="5.438589271s" totalImagesPullingTime="3.009208034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:37:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:37:48.437573424 +0000 UTC m=+588.971756513" watchObservedRunningTime="2026-08-04 18:37:48.438589271 +0000 UTC m=+588.972772359"
Aug 04 18:37:48.460931 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:48.460879    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-km5dc" podStartSLOduration=1.9762939720000001 podStartE2EDuration="4.460863071s" totalImagesPullingTime="2.484569099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:37:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:37:48.459819212 +0000 UTC m=+588.994002294" watchObservedRunningTime="2026-08-04 18:37:48.460863071 +0000 UTC m=+588.995046158"
Aug 04 18:37:54.429287 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:54.429252    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6cbd958b9d-rmhd8"
Aug 04 18:37:59.426120 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:37:59.426088    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-km5dc"
Aug 04 18:38:02.786466 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.786432    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"]
Aug 04 18:38:02.791755 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.791731    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:02.794821 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.794797    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Aug 04 18:38:02.794956 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.794825    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 04 18:38:02.794956 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.794854    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fqx86\""
Aug 04 18:38:02.794956 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.794924    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 04 18:38:02.805120 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.805102    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"]
Aug 04 18:38:02.842722 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.842693    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsrxg\" (UniqueName: \"kubernetes.io/projected/5feecb2c-b22d-4b99-b32d-4cbb02e1759d-kube-api-access-bsrxg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v\" (UID: \"5feecb2c-b22d-4b99-b32d-4cbb02e1759d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:02.842844 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.842727    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5feecb2c-b22d-4b99-b32d-4cbb02e1759d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v\" (UID: \"5feecb2c-b22d-4b99-b32d-4cbb02e1759d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:02.842844 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.842754    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5feecb2c-b22d-4b99-b32d-4cbb02e1759d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v\" (UID: \"5feecb2c-b22d-4b99-b32d-4cbb02e1759d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:02.842844 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.842815    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5feecb2c-b22d-4b99-b32d-4cbb02e1759d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v\" (UID: \"5feecb2c-b22d-4b99-b32d-4cbb02e1759d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:02.842844 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.842840    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5feecb2c-b22d-4b99-b32d-4cbb02e1759d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v\" (UID: \"5feecb2c-b22d-4b99-b32d-4cbb02e1759d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:02.842993 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.842892    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5feecb2c-b22d-4b99-b32d-4cbb02e1759d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v\" (UID: \"5feecb2c-b22d-4b99-b32d-4cbb02e1759d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:02.944154 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.944121    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5feecb2c-b22d-4b99-b32d-4cbb02e1759d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v\" (UID: \"5feecb2c-b22d-4b99-b32d-4cbb02e1759d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:02.944321 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.944164    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5feecb2c-b22d-4b99-b32d-4cbb02e1759d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v\" (UID: \"5feecb2c-b22d-4b99-b32d-4cbb02e1759d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:02.944321 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.944190    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5feecb2c-b22d-4b99-b32d-4cbb02e1759d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v\" (UID: \"5feecb2c-b22d-4b99-b32d-4cbb02e1759d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:02.944321 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.944262    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5feecb2c-b22d-4b99-b32d-4cbb02e1759d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v\" (UID: \"5feecb2c-b22d-4b99-b32d-4cbb02e1759d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:02.944321 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.944309    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsrxg\" (UniqueName: \"kubernetes.io/projected/5feecb2c-b22d-4b99-b32d-4cbb02e1759d-kube-api-access-bsrxg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v\" (UID: \"5feecb2c-b22d-4b99-b32d-4cbb02e1759d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:02.944619 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.944338    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5feecb2c-b22d-4b99-b32d-4cbb02e1759d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v\" (UID: \"5feecb2c-b22d-4b99-b32d-4cbb02e1759d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:02.944619 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.944536    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5feecb2c-b22d-4b99-b32d-4cbb02e1759d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v\" (UID: \"5feecb2c-b22d-4b99-b32d-4cbb02e1759d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:02.944766 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.944672    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5feecb2c-b22d-4b99-b32d-4cbb02e1759d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v\" (UID: \"5feecb2c-b22d-4b99-b32d-4cbb02e1759d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:02.944766 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.944736    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5feecb2c-b22d-4b99-b32d-4cbb02e1759d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v\" (UID: \"5feecb2c-b22d-4b99-b32d-4cbb02e1759d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:02.946555 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.946528    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5feecb2c-b22d-4b99-b32d-4cbb02e1759d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v\" (UID: \"5feecb2c-b22d-4b99-b32d-4cbb02e1759d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:02.946811 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.946794    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5feecb2c-b22d-4b99-b32d-4cbb02e1759d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v\" (UID: \"5feecb2c-b22d-4b99-b32d-4cbb02e1759d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:02.955197 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:02.955176    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsrxg\" (UniqueName: \"kubernetes.io/projected/5feecb2c-b22d-4b99-b32d-4cbb02e1759d-kube-api-access-bsrxg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v\" (UID: \"5feecb2c-b22d-4b99-b32d-4cbb02e1759d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:03.101550 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:03.101472    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:03.239448 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:03.239415    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"]
Aug 04 18:38:03.243808 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:38:03.243767    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5feecb2c_b22d_4b99_b32d_4cbb02e1759d.slice/crio-55cbb509e2337dc73a95408808b82f07564f9bd11fc36f135185b9e0446a3a51 WatchSource:0}: Error finding container 55cbb509e2337dc73a95408808b82f07564f9bd11fc36f135185b9e0446a3a51: Status 404 returned error can't find the container with id 55cbb509e2337dc73a95408808b82f07564f9bd11fc36f135185b9e0446a3a51
Aug 04 18:38:03.485755 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:03.485721    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v" event={"ID":"5feecb2c-b22d-4b99-b32d-4cbb02e1759d","Type":"ContainerStarted","Data":"55cbb509e2337dc73a95408808b82f07564f9bd11fc36f135185b9e0446a3a51"}
Aug 04 18:38:04.491419 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:04.491378    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v" event={"ID":"5feecb2c-b22d-4b99-b32d-4cbb02e1759d","Type":"ContainerStarted","Data":"9bd9170594f11d5ed782471241a93742677884cddef815fcd43a483062988d47"}
Aug 04 18:38:04.510192 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:04.510137    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v" podStartSLOduration=1.374652898 podStartE2EDuration="2.510123235s" totalImagesPullingTime="1.135470337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:38:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:38:04.50913785 +0000 UTC m=+605.043320951" watchObservedRunningTime="2026-08-04 18:38:04.510123235 +0000 UTC m=+605.044306323"
Aug 04 18:38:13.102283 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:13.102247    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:13.102709 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:13.102324    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:13.114952 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:13.114931    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:13.542982 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:13.542949    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v"
Aug 04 18:38:43.568122 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.568091    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"]
Aug 04 18:38:43.571156 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.571134    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:43.573336 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.573315    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Aug 04 18:38:43.582369 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.582345    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"]
Aug 04 18:38:43.711684 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.711624    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d4fc0cd-6416-4d06-bfbe-2044bfedd486-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw\" (UID: \"8d4fc0cd-6416-4d06-bfbe-2044bfedd486\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:43.711874 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.711725    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5flfl\" (UniqueName: \"kubernetes.io/projected/8d4fc0cd-6416-4d06-bfbe-2044bfedd486-kube-api-access-5flfl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw\" (UID: \"8d4fc0cd-6416-4d06-bfbe-2044bfedd486\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:43.711874 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.711815    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d4fc0cd-6416-4d06-bfbe-2044bfedd486-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw\" (UID: \"8d4fc0cd-6416-4d06-bfbe-2044bfedd486\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:43.711874 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.711864    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d4fc0cd-6416-4d06-bfbe-2044bfedd486-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw\" (UID: \"8d4fc0cd-6416-4d06-bfbe-2044bfedd486\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:43.711997 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.711884    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d4fc0cd-6416-4d06-bfbe-2044bfedd486-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw\" (UID: \"8d4fc0cd-6416-4d06-bfbe-2044bfedd486\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:43.711997 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.711965    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d4fc0cd-6416-4d06-bfbe-2044bfedd486-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw\" (UID: \"8d4fc0cd-6416-4d06-bfbe-2044bfedd486\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:43.812800 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.812758    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d4fc0cd-6416-4d06-bfbe-2044bfedd486-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw\" (UID: \"8d4fc0cd-6416-4d06-bfbe-2044bfedd486\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:43.812981 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.812855    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d4fc0cd-6416-4d06-bfbe-2044bfedd486-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw\" (UID: \"8d4fc0cd-6416-4d06-bfbe-2044bfedd486\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:43.812981 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.812884    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5flfl\" (UniqueName: \"kubernetes.io/projected/8d4fc0cd-6416-4d06-bfbe-2044bfedd486-kube-api-access-5flfl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw\" (UID: \"8d4fc0cd-6416-4d06-bfbe-2044bfedd486\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:43.812981 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.812921    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d4fc0cd-6416-4d06-bfbe-2044bfedd486-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw\" (UID: \"8d4fc0cd-6416-4d06-bfbe-2044bfedd486\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:43.812981 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.812963    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d4fc0cd-6416-4d06-bfbe-2044bfedd486-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw\" (UID: \"8d4fc0cd-6416-4d06-bfbe-2044bfedd486\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:43.813168 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.812988    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d4fc0cd-6416-4d06-bfbe-2044bfedd486-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw\" (UID: \"8d4fc0cd-6416-4d06-bfbe-2044bfedd486\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:43.813364 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.813335    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d4fc0cd-6416-4d06-bfbe-2044bfedd486-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw\" (UID: \"8d4fc0cd-6416-4d06-bfbe-2044bfedd486\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:43.813364 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.813353    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d4fc0cd-6416-4d06-bfbe-2044bfedd486-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw\" (UID: \"8d4fc0cd-6416-4d06-bfbe-2044bfedd486\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:43.813506 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.813414    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d4fc0cd-6416-4d06-bfbe-2044bfedd486-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw\" (UID: \"8d4fc0cd-6416-4d06-bfbe-2044bfedd486\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:43.815288 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.815256    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d4fc0cd-6416-4d06-bfbe-2044bfedd486-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw\" (UID: \"8d4fc0cd-6416-4d06-bfbe-2044bfedd486\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:43.815419 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.815403    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d4fc0cd-6416-4d06-bfbe-2044bfedd486-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw\" (UID: \"8d4fc0cd-6416-4d06-bfbe-2044bfedd486\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:43.828565 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.828493    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5flfl\" (UniqueName: \"kubernetes.io/projected/8d4fc0cd-6416-4d06-bfbe-2044bfedd486-kube-api-access-5flfl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw\" (UID: \"8d4fc0cd-6416-4d06-bfbe-2044bfedd486\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:43.880777 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:43.880726    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:44.016372 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:44.016346    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"]
Aug 04 18:38:44.018797 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:38:44.018763    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d4fc0cd_6416_4d06_bfbe_2044bfedd486.slice/crio-fab4fcbef0a30a0b78ad3fdde11e19f50970584b3a26664c81f2bf4045be0874 WatchSource:0}: Error finding container fab4fcbef0a30a0b78ad3fdde11e19f50970584b3a26664c81f2bf4045be0874: Status 404 returned error can't find the container with id fab4fcbef0a30a0b78ad3fdde11e19f50970584b3a26664c81f2bf4045be0874
Aug 04 18:38:44.676391 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:44.676354    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw" event={"ID":"8d4fc0cd-6416-4d06-bfbe-2044bfedd486","Type":"ContainerStarted","Data":"aa9758fc3a57c5adb8b69ab68fa61479fbcc518511259a2fceeb31b27521f026"}
Aug 04 18:38:44.676797 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:44.676432    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw" event={"ID":"8d4fc0cd-6416-4d06-bfbe-2044bfedd486","Type":"ContainerStarted","Data":"fab4fcbef0a30a0b78ad3fdde11e19f50970584b3a26664c81f2bf4045be0874"}
Aug 04 18:38:44.696845 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:44.696793    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw" podStartSLOduration=1.451160537 podStartE2EDuration="1.696777157s" totalImagesPullingTime="245.61662ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:38:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:38:44.695113447 +0000 UTC m=+645.229296536" watchObservedRunningTime="2026-08-04 18:38:44.696777157 +0000 UTC m=+645.230960245"
Aug 04 18:38:52.500440 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.500403    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"]
Aug 04 18:38:52.503875 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.503854    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:38:52.511804 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.511784    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Aug 04 18:38:52.545114 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.545082    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"]
Aug 04 18:38:52.588833 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.588795    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa20364a-e43d-4cc0-90db-d25b8d2532c4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ptcb\" (UID: \"fa20364a-e43d-4cc0-90db-d25b8d2532c4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:38:52.588833 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.588838    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trmlf\" (UniqueName: \"kubernetes.io/projected/fa20364a-e43d-4cc0-90db-d25b8d2532c4-kube-api-access-trmlf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ptcb\" (UID: \"fa20364a-e43d-4cc0-90db-d25b8d2532c4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:38:52.589065 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.588869    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa20364a-e43d-4cc0-90db-d25b8d2532c4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ptcb\" (UID: \"fa20364a-e43d-4cc0-90db-d25b8d2532c4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:38:52.589065 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.588928    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa20364a-e43d-4cc0-90db-d25b8d2532c4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ptcb\" (UID: \"fa20364a-e43d-4cc0-90db-d25b8d2532c4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:38:52.589065 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.588965    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa20364a-e43d-4cc0-90db-d25b8d2532c4-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ptcb\" (UID: \"fa20364a-e43d-4cc0-90db-d25b8d2532c4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:38:52.589065 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.589043    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa20364a-e43d-4cc0-90db-d25b8d2532c4-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ptcb\" (UID: \"fa20364a-e43d-4cc0-90db-d25b8d2532c4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:38:52.690089 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.690051    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa20364a-e43d-4cc0-90db-d25b8d2532c4-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ptcb\" (UID: \"fa20364a-e43d-4cc0-90db-d25b8d2532c4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:38:52.690089 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.690098    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa20364a-e43d-4cc0-90db-d25b8d2532c4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ptcb\" (UID: \"fa20364a-e43d-4cc0-90db-d25b8d2532c4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:38:52.690326 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.690118    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trmlf\" (UniqueName: \"kubernetes.io/projected/fa20364a-e43d-4cc0-90db-d25b8d2532c4-kube-api-access-trmlf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ptcb\" (UID: \"fa20364a-e43d-4cc0-90db-d25b8d2532c4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:38:52.690326 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.690250    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa20364a-e43d-4cc0-90db-d25b8d2532c4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ptcb\" (UID: \"fa20364a-e43d-4cc0-90db-d25b8d2532c4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:38:52.690326 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.690304    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa20364a-e43d-4cc0-90db-d25b8d2532c4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ptcb\" (UID: \"fa20364a-e43d-4cc0-90db-d25b8d2532c4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:38:52.690460 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.690369    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa20364a-e43d-4cc0-90db-d25b8d2532c4-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ptcb\" (UID: \"fa20364a-e43d-4cc0-90db-d25b8d2532c4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:38:52.690662 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.690607    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa20364a-e43d-4cc0-90db-d25b8d2532c4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ptcb\" (UID: \"fa20364a-e43d-4cc0-90db-d25b8d2532c4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:38:52.690751 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.690680    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa20364a-e43d-4cc0-90db-d25b8d2532c4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ptcb\" (UID: \"fa20364a-e43d-4cc0-90db-d25b8d2532c4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:38:52.690751 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.690731    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa20364a-e43d-4cc0-90db-d25b8d2532c4-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ptcb\" (UID: \"fa20364a-e43d-4cc0-90db-d25b8d2532c4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:38:52.692454 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.692432    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa20364a-e43d-4cc0-90db-d25b8d2532c4-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ptcb\" (UID: \"fa20364a-e43d-4cc0-90db-d25b8d2532c4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:38:52.692582 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.692565    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa20364a-e43d-4cc0-90db-d25b8d2532c4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ptcb\" (UID: \"fa20364a-e43d-4cc0-90db-d25b8d2532c4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:38:52.700062 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.700024    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trmlf\" (UniqueName: \"kubernetes.io/projected/fa20364a-e43d-4cc0-90db-d25b8d2532c4-kube-api-access-trmlf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ptcb\" (UID: \"fa20364a-e43d-4cc0-90db-d25b8d2532c4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:38:52.814249 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.814123    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:38:52.955950 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.955929    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"]
Aug 04 18:38:52.958545 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:38:52.958521    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa20364a_e43d_4cc0_90db_d25b8d2532c4.slice/crio-8e7afdae36e0515a4a21beb401def9b9f2e054cfc2d14802722f7d6d5c934cdc WatchSource:0}: Error finding container 8e7afdae36e0515a4a21beb401def9b9f2e054cfc2d14802722f7d6d5c934cdc: Status 404 returned error can't find the container with id 8e7afdae36e0515a4a21beb401def9b9f2e054cfc2d14802722f7d6d5c934cdc
Aug 04 18:38:52.959966 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:52.959946    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:38:53.716842 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:53.716805    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb" event={"ID":"fa20364a-e43d-4cc0-90db-d25b8d2532c4","Type":"ContainerStarted","Data":"001eb02877b597374fac6e15360623455ebd6360ac0c7162006c8d5c179f6df1"}
Aug 04 18:38:53.717234 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:53.716864    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb" event={"ID":"fa20364a-e43d-4cc0-90db-d25b8d2532c4","Type":"ContainerStarted","Data":"8e7afdae36e0515a4a21beb401def9b9f2e054cfc2d14802722f7d6d5c934cdc"}
Aug 04 18:38:53.746321 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:53.746265    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb" podStartSLOduration=1.501547924 podStartE2EDuration="1.746248411s" totalImagesPullingTime="244.700487ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:38:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:38:53.744256523 +0000 UTC m=+654.278439622" watchObservedRunningTime="2026-08-04 18:38:53.746248411 +0000 UTC m=+654.280431499"
Aug 04 18:38:53.881111 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:53.881069    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:53.881262 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:53.881137    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:53.894040 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:53.894010    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:38:54.732305 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:38:54.732271    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw"
Aug 04 18:39:02.814802 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:39:02.814753    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:39:02.815196 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:39:02.814824    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:39:02.827090 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:39:02.827065    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:39:03.771512 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:39:03.771484    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ptcb"
Aug 04 18:40:41.282470 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:40:41.282432    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-549599b85-s679m"]
Aug 04 18:40:41.283048 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:40:41.282627    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-549599b85-s679m" podUID="d699d0a4-34f5-4939-a1bf-08c1fa2289bd" containerName="manager" containerID="cri-o://59977f1b16a510a0bd434e9fed621a8b5effbf1ee0927fc0c2acfcea521523f4" gracePeriod=30
Aug 04 18:40:41.534371 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:40:41.534312    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-549599b85-s679m"
Aug 04 18:40:41.675708 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:40:41.675679    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-964r5\" (UniqueName: \"kubernetes.io/projected/d699d0a4-34f5-4939-a1bf-08c1fa2289bd-kube-api-access-964r5\") pod \"d699d0a4-34f5-4939-a1bf-08c1fa2289bd\" (UID: \"d699d0a4-34f5-4939-a1bf-08c1fa2289bd\") "
Aug 04 18:40:41.675924 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:40:41.675782    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d699d0a4-34f5-4939-a1bf-08c1fa2289bd-webhook-cert\") pod \"d699d0a4-34f5-4939-a1bf-08c1fa2289bd\" (UID: \"d699d0a4-34f5-4939-a1bf-08c1fa2289bd\") "
Aug 04 18:40:41.677813 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:40:41.677775    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d699d0a4-34f5-4939-a1bf-08c1fa2289bd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d699d0a4-34f5-4939-a1bf-08c1fa2289bd" (UID: "d699d0a4-34f5-4939-a1bf-08c1fa2289bd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:40:41.677933 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:40:41.677892    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d699d0a4-34f5-4939-a1bf-08c1fa2289bd-kube-api-access-964r5" (OuterVolumeSpecName: "kube-api-access-964r5") pod "d699d0a4-34f5-4939-a1bf-08c1fa2289bd" (UID: "d699d0a4-34f5-4939-a1bf-08c1fa2289bd"). InnerVolumeSpecName "kube-api-access-964r5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:40:41.776533 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:40:41.776489    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d699d0a4-34f5-4939-a1bf-08c1fa2289bd-webhook-cert\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:40:41.776533 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:40:41.776525    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-964r5\" (UniqueName: \"kubernetes.io/projected/d699d0a4-34f5-4939-a1bf-08c1fa2289bd-kube-api-access-964r5\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:40:42.192373 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:40:42.192342    2558 generic.go:356] "Generic (PLEG): container finished" podID="d699d0a4-34f5-4939-a1bf-08c1fa2289bd" containerID="59977f1b16a510a0bd434e9fed621a8b5effbf1ee0927fc0c2acfcea521523f4" exitCode=0
Aug 04 18:40:42.192562 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:40:42.192398    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-549599b85-s679m"
Aug 04 18:40:42.192562 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:40:42.192427    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-549599b85-s679m" event={"ID":"d699d0a4-34f5-4939-a1bf-08c1fa2289bd","Type":"ContainerDied","Data":"59977f1b16a510a0bd434e9fed621a8b5effbf1ee0927fc0c2acfcea521523f4"}
Aug 04 18:40:42.192562 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:40:42.192487    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-549599b85-s679m" event={"ID":"d699d0a4-34f5-4939-a1bf-08c1fa2289bd","Type":"ContainerDied","Data":"38e2aa5cf57052affcc5ffa5e7b6fa9f80db00921885c81624fb298caeb1a750"}
Aug 04 18:40:42.192562 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:40:42.192509    2558 scope.go:117] "RemoveContainer" containerID="59977f1b16a510a0bd434e9fed621a8b5effbf1ee0927fc0c2acfcea521523f4"
Aug 04 18:40:42.203199 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:40:42.203185    2558 scope.go:117] "RemoveContainer" containerID="59977f1b16a510a0bd434e9fed621a8b5effbf1ee0927fc0c2acfcea521523f4"
Aug 04 18:40:42.203482 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:40:42.203461    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59977f1b16a510a0bd434e9fed621a8b5effbf1ee0927fc0c2acfcea521523f4\": container with ID starting with 59977f1b16a510a0bd434e9fed621a8b5effbf1ee0927fc0c2acfcea521523f4 not found: ID does not exist" containerID="59977f1b16a510a0bd434e9fed621a8b5effbf1ee0927fc0c2acfcea521523f4"
Aug 04 18:40:42.203542 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:40:42.203491    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59977f1b16a510a0bd434e9fed621a8b5effbf1ee0927fc0c2acfcea521523f4"} err="failed to get container status \"59977f1b16a510a0bd434e9fed621a8b5effbf1ee0927fc0c2acfcea521523f4\": rpc error: code = NotFound desc = could not find container \"59977f1b16a510a0bd434e9fed621a8b5effbf1ee0927fc0c2acfcea521523f4\": container with ID starting with 59977f1b16a510a0bd434e9fed621a8b5effbf1ee0927fc0c2acfcea521523f4 not found: ID does not exist"
Aug 04 18:40:42.228887 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:40:42.228824    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-549599b85-s679m"]
Aug 04 18:40:42.231334 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:40:42.231307    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-549599b85-s679m"]
Aug 04 18:40:43.963150 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:40:43.963118    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d699d0a4-34f5-4939-a1bf-08c1fa2289bd" path="/var/lib/kubelet/pods/d699d0a4-34f5-4939-a1bf-08c1fa2289bd/volumes"
Aug 04 18:41:43.052255 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:41:43.052218    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-549599b85-j48kn"]
Aug 04 18:41:43.052688 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:41:43.052551    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d699d0a4-34f5-4939-a1bf-08c1fa2289bd" containerName="manager"
Aug 04 18:41:43.052688 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:41:43.052563    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d699d0a4-34f5-4939-a1bf-08c1fa2289bd" containerName="manager"
Aug 04 18:41:43.052688 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:41:43.052625    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d699d0a4-34f5-4939-a1bf-08c1fa2289bd" containerName="manager"
Aug 04 18:41:43.063547 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:41:43.063066    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-549599b85-j48kn"
Aug 04 18:41:43.065211 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:41:43.065143    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-549599b85-j48kn"]
Aug 04 18:41:43.066376 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:41:43.066346    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-86kd4\""
Aug 04 18:41:43.066502 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:41:43.066419    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 04 18:41:43.066502 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:41:43.066431    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 04 18:41:43.234213 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:41:43.234183    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7qm6\" (UniqueName: \"kubernetes.io/projected/dda89d40-011c-41af-9ca8-e6556a13ee7c-kube-api-access-j7qm6\") pod \"maas-controller-549599b85-j48kn\" (UID: \"dda89d40-011c-41af-9ca8-e6556a13ee7c\") " pod="opendatahub/maas-controller-549599b85-j48kn"
Aug 04 18:41:43.234387 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:41:43.234219    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dda89d40-011c-41af-9ca8-e6556a13ee7c-webhook-cert\") pod \"maas-controller-549599b85-j48kn\" (UID: \"dda89d40-011c-41af-9ca8-e6556a13ee7c\") " pod="opendatahub/maas-controller-549599b85-j48kn"
Aug 04 18:41:43.335470 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:41:43.335376    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7qm6\" (UniqueName: \"kubernetes.io/projected/dda89d40-011c-41af-9ca8-e6556a13ee7c-kube-api-access-j7qm6\") pod \"maas-controller-549599b85-j48kn\" (UID: \"dda89d40-011c-41af-9ca8-e6556a13ee7c\") " pod="opendatahub/maas-controller-549599b85-j48kn"
Aug 04 18:41:43.335470 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:41:43.335418    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dda89d40-011c-41af-9ca8-e6556a13ee7c-webhook-cert\") pod \"maas-controller-549599b85-j48kn\" (UID: \"dda89d40-011c-41af-9ca8-e6556a13ee7c\") " pod="opendatahub/maas-controller-549599b85-j48kn"
Aug 04 18:41:43.337893 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:41:43.337859    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dda89d40-011c-41af-9ca8-e6556a13ee7c-webhook-cert\") pod \"maas-controller-549599b85-j48kn\" (UID: \"dda89d40-011c-41af-9ca8-e6556a13ee7c\") " pod="opendatahub/maas-controller-549599b85-j48kn"
Aug 04 18:41:43.344202 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:41:43.344181    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7qm6\" (UniqueName: \"kubernetes.io/projected/dda89d40-011c-41af-9ca8-e6556a13ee7c-kube-api-access-j7qm6\") pod \"maas-controller-549599b85-j48kn\" (UID: \"dda89d40-011c-41af-9ca8-e6556a13ee7c\") " pod="opendatahub/maas-controller-549599b85-j48kn"
Aug 04 18:41:43.375181 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:41:43.375147    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-549599b85-j48kn"
Aug 04 18:41:43.511457 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:41:43.511279    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-549599b85-j48kn"]
Aug 04 18:41:43.514301 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:41:43.514271    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda89d40_011c_41af_9ca8_e6556a13ee7c.slice/crio-ff12cd36a056a29a29b32b1446ef252c97414e9c06261be7d56e9d795c71f944 WatchSource:0}: Error finding container ff12cd36a056a29a29b32b1446ef252c97414e9c06261be7d56e9d795c71f944: Status 404 returned error can't find the container with id ff12cd36a056a29a29b32b1446ef252c97414e9c06261be7d56e9d795c71f944
Aug 04 18:41:44.479228 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:41:44.479190    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-549599b85-j48kn" event={"ID":"dda89d40-011c-41af-9ca8-e6556a13ee7c","Type":"ContainerStarted","Data":"fe9aa172e5d2304a538d74c17769a2d4e341ba8f3aba6427f9879a99dac663d7"}
Aug 04 18:41:44.479605 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:41:44.479238    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-549599b85-j48kn" event={"ID":"dda89d40-011c-41af-9ca8-e6556a13ee7c","Type":"ContainerStarted","Data":"ff12cd36a056a29a29b32b1446ef252c97414e9c06261be7d56e9d795c71f944"}
Aug 04 18:41:44.479605 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:41:44.479270    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-549599b85-j48kn"
Aug 04 18:41:44.503608 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:41:44.503554    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-549599b85-j48kn" podStartSLOduration=0.956282456 podStartE2EDuration="1.503540511s" totalImagesPullingTime="547.258055ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:41:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:41:44.502857381 +0000 UTC m=+825.037040469" watchObservedRunningTime="2026-08-04 18:41:44.503540511 +0000 UTC m=+825.037723629"
Aug 04 18:41:55.487415 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:41:55.487384    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-549599b85-j48kn"
Aug 04 18:42:00.155360 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:00.155322    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-549599b85-j48kn"]
Aug 04 18:42:00.155800 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:00.155554    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-549599b85-j48kn" podUID="dda89d40-011c-41af-9ca8-e6556a13ee7c" containerName="manager" containerID="cri-o://fe9aa172e5d2304a538d74c17769a2d4e341ba8f3aba6427f9879a99dac663d7" gracePeriod=30
Aug 04 18:42:00.405182 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:00.405157    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-549599b85-j48kn"
Aug 04 18:42:00.480035 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:00.479962    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dda89d40-011c-41af-9ca8-e6556a13ee7c-webhook-cert\") pod \"dda89d40-011c-41af-9ca8-e6556a13ee7c\" (UID: \"dda89d40-011c-41af-9ca8-e6556a13ee7c\") "
Aug 04 18:42:00.480176 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:00.480093    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7qm6\" (UniqueName: \"kubernetes.io/projected/dda89d40-011c-41af-9ca8-e6556a13ee7c-kube-api-access-j7qm6\") pod \"dda89d40-011c-41af-9ca8-e6556a13ee7c\" (UID: \"dda89d40-011c-41af-9ca8-e6556a13ee7c\") "
Aug 04 18:42:00.482100 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:00.482068    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dda89d40-011c-41af-9ca8-e6556a13ee7c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "dda89d40-011c-41af-9ca8-e6556a13ee7c" (UID: "dda89d40-011c-41af-9ca8-e6556a13ee7c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:42:00.482251 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:00.482160    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dda89d40-011c-41af-9ca8-e6556a13ee7c-kube-api-access-j7qm6" (OuterVolumeSpecName: "kube-api-access-j7qm6") pod "dda89d40-011c-41af-9ca8-e6556a13ee7c" (UID: "dda89d40-011c-41af-9ca8-e6556a13ee7c"). InnerVolumeSpecName "kube-api-access-j7qm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:42:00.549948 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:00.549911    2558 generic.go:356] "Generic (PLEG): container finished" podID="dda89d40-011c-41af-9ca8-e6556a13ee7c" containerID="fe9aa172e5d2304a538d74c17769a2d4e341ba8f3aba6427f9879a99dac663d7" exitCode=0
Aug 04 18:42:00.550142 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:00.549958    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-549599b85-j48kn"
Aug 04 18:42:00.550142 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:00.549995    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-549599b85-j48kn" event={"ID":"dda89d40-011c-41af-9ca8-e6556a13ee7c","Type":"ContainerDied","Data":"fe9aa172e5d2304a538d74c17769a2d4e341ba8f3aba6427f9879a99dac663d7"}
Aug 04 18:42:00.550142 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:00.550071    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-549599b85-j48kn" event={"ID":"dda89d40-011c-41af-9ca8-e6556a13ee7c","Type":"ContainerDied","Data":"ff12cd36a056a29a29b32b1446ef252c97414e9c06261be7d56e9d795c71f944"}
Aug 04 18:42:00.550142 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:00.550093    2558 scope.go:117] "RemoveContainer" containerID="fe9aa172e5d2304a538d74c17769a2d4e341ba8f3aba6427f9879a99dac663d7"
Aug 04 18:42:00.559251 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:00.559222    2558 scope.go:117] "RemoveContainer" containerID="fe9aa172e5d2304a538d74c17769a2d4e341ba8f3aba6427f9879a99dac663d7"
Aug 04 18:42:00.559497 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:42:00.559475    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe9aa172e5d2304a538d74c17769a2d4e341ba8f3aba6427f9879a99dac663d7\": container with ID starting with fe9aa172e5d2304a538d74c17769a2d4e341ba8f3aba6427f9879a99dac663d7 not found: ID does not exist" containerID="fe9aa172e5d2304a538d74c17769a2d4e341ba8f3aba6427f9879a99dac663d7"
Aug 04 18:42:00.559540 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:00.559507    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe9aa172e5d2304a538d74c17769a2d4e341ba8f3aba6427f9879a99dac663d7"} err="failed to get container status \"fe9aa172e5d2304a538d74c17769a2d4e341ba8f3aba6427f9879a99dac663d7\": rpc error: code = NotFound desc = could not find container \"fe9aa172e5d2304a538d74c17769a2d4e341ba8f3aba6427f9879a99dac663d7\": container with ID starting with fe9aa172e5d2304a538d74c17769a2d4e341ba8f3aba6427f9879a99dac663d7 not found: ID does not exist"
Aug 04 18:42:00.575721 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:00.575700    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-549599b85-j48kn"]
Aug 04 18:42:00.580864 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:00.580843    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7qm6\" (UniqueName: \"kubernetes.io/projected/dda89d40-011c-41af-9ca8-e6556a13ee7c-kube-api-access-j7qm6\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:42:00.580959 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:00.580870    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dda89d40-011c-41af-9ca8-e6556a13ee7c-webhook-cert\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:42:00.582159 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:00.582140    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-549599b85-j48kn"]
Aug 04 18:42:01.434274 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:01.434242    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-549599b85-k65h8"]
Aug 04 18:42:01.434667 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:01.434567    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dda89d40-011c-41af-9ca8-e6556a13ee7c" containerName="manager"
Aug 04 18:42:01.434667 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:01.434577    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dda89d40-011c-41af-9ca8-e6556a13ee7c" containerName="manager"
Aug 04 18:42:01.434667 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:01.434660    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="dda89d40-011c-41af-9ca8-e6556a13ee7c" containerName="manager"
Aug 04 18:42:01.438972 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:01.438956    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-549599b85-k65h8"
Aug 04 18:42:01.442949 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:01.442925    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 04 18:42:01.443082 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:01.442925    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 04 18:42:01.443082 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:01.442930    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-86kd4\""
Aug 04 18:42:01.452963 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:01.452938    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-549599b85-k65h8"]
Aug 04 18:42:01.489253 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:01.489220    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93984f28-492d-4655-aeb6-8347387196de-webhook-cert\") pod \"maas-controller-549599b85-k65h8\" (UID: \"93984f28-492d-4655-aeb6-8347387196de\") " pod="opendatahub/maas-controller-549599b85-k65h8"
Aug 04 18:42:01.489412 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:01.489272    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv5m2\" (UniqueName: \"kubernetes.io/projected/93984f28-492d-4655-aeb6-8347387196de-kube-api-access-qv5m2\") pod \"maas-controller-549599b85-k65h8\" (UID: \"93984f28-492d-4655-aeb6-8347387196de\") " pod="opendatahub/maas-controller-549599b85-k65h8"
Aug 04 18:42:01.590524 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:01.590493    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93984f28-492d-4655-aeb6-8347387196de-webhook-cert\") pod \"maas-controller-549599b85-k65h8\" (UID: \"93984f28-492d-4655-aeb6-8347387196de\") " pod="opendatahub/maas-controller-549599b85-k65h8"
Aug 04 18:42:01.590747 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:01.590549    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv5m2\" (UniqueName: \"kubernetes.io/projected/93984f28-492d-4655-aeb6-8347387196de-kube-api-access-qv5m2\") pod \"maas-controller-549599b85-k65h8\" (UID: \"93984f28-492d-4655-aeb6-8347387196de\") " pod="opendatahub/maas-controller-549599b85-k65h8"
Aug 04 18:42:01.592983 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:01.592959    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93984f28-492d-4655-aeb6-8347387196de-webhook-cert\") pod \"maas-controller-549599b85-k65h8\" (UID: \"93984f28-492d-4655-aeb6-8347387196de\") " pod="opendatahub/maas-controller-549599b85-k65h8"
Aug 04 18:42:01.600549 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:01.600523    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv5m2\" (UniqueName: \"kubernetes.io/projected/93984f28-492d-4655-aeb6-8347387196de-kube-api-access-qv5m2\") pod \"maas-controller-549599b85-k65h8\" (UID: \"93984f28-492d-4655-aeb6-8347387196de\") " pod="opendatahub/maas-controller-549599b85-k65h8"
Aug 04 18:42:01.749699 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:01.749589    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-549599b85-k65h8"
Aug 04 18:42:01.962849 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:01.962820    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dda89d40-011c-41af-9ca8-e6556a13ee7c" path="/var/lib/kubelet/pods/dda89d40-011c-41af-9ca8-e6556a13ee7c/volumes"
Aug 04 18:42:02.088933 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:02.088891    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-549599b85-k65h8"]
Aug 04 18:42:02.091183 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:42:02.091155    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93984f28_492d_4655_aeb6_8347387196de.slice/crio-ce8d711b3df45cebcbdc377c4fcd204f6a7783f95105bf9419a11014d69ec027 WatchSource:0}: Error finding container ce8d711b3df45cebcbdc377c4fcd204f6a7783f95105bf9419a11014d69ec027: Status 404 returned error can't find the container with id ce8d711b3df45cebcbdc377c4fcd204f6a7783f95105bf9419a11014d69ec027
Aug 04 18:42:02.559997 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:02.559961    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-549599b85-k65h8" event={"ID":"93984f28-492d-4655-aeb6-8347387196de","Type":"ContainerStarted","Data":"ce8d711b3df45cebcbdc377c4fcd204f6a7783f95105bf9419a11014d69ec027"}
Aug 04 18:42:03.566023 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:03.565936    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-549599b85-k65h8" event={"ID":"93984f28-492d-4655-aeb6-8347387196de","Type":"ContainerStarted","Data":"1f2e1fa2e50373fec90613dae6ae7e2446fb19eb5cc5daf8bb26fc746bf0b1d1"}
Aug 04 18:42:03.566023 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:03.566002    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-549599b85-k65h8"
Aug 04 18:42:03.584301 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:03.584254    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-549599b85-k65h8" podStartSLOduration=1.534028945 podStartE2EDuration="2.584239167s" totalImagesPullingTime="1.050210222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:42:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:42:03.582989523 +0000 UTC m=+844.117172623" watchObservedRunningTime="2026-08-04 18:42:03.584239167 +0000 UTC m=+844.118422255"
Aug 04 18:42:14.573324 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:14.573290    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-549599b85-k65h8"
Aug 04 18:42:59.932929 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:42:59.932844    2558 scope.go:117] "RemoveContainer" containerID="c05eac445248b694b20a0452fd2813294440ec3ce7321dd1ede82182cf140f53"
Aug 04 18:57:45.760432 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:45.760394    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5"]
Aug 04 18:57:45.763739 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:45.763720    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5"
Aug 04 18:57:45.766524 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:45.766503    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-93cfcc2b-serving-cert\""
Aug 04 18:57:45.776499 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:45.776480    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5"]
Aug 04 18:57:45.835133 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:45.835100    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa8aca36-b3bf-45e1-9e12-d33677ebc2ac-openshift-service-ca\") pod \"maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5\" (UID: \"fa8aca36-b3bf-45e1-9e12-d33677ebc2ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5"
Aug 04 18:57:45.835312 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:45.835144    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa8aca36-b3bf-45e1-9e12-d33677ebc2ac-maas-api-tls\") pod \"maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5\" (UID: \"fa8aca36-b3bf-45e1-9e12-d33677ebc2ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5"
Aug 04 18:57:45.835312 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:45.835216    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk7rn\" (UniqueName: \"kubernetes.io/projected/fa8aca36-b3bf-45e1-9e12-d33677ebc2ac-kube-api-access-jk7rn\") pod \"maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5\" (UID: \"fa8aca36-b3bf-45e1-9e12-d33677ebc2ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5"
Aug 04 18:57:45.936612 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:45.936574    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa8aca36-b3bf-45e1-9e12-d33677ebc2ac-openshift-service-ca\") pod \"maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5\" (UID: \"fa8aca36-b3bf-45e1-9e12-d33677ebc2ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5"
Aug 04 18:57:45.936612 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:45.936613    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa8aca36-b3bf-45e1-9e12-d33677ebc2ac-maas-api-tls\") pod \"maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5\" (UID: \"fa8aca36-b3bf-45e1-9e12-d33677ebc2ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5"
Aug 04 18:57:45.936893 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:45.936679    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk7rn\" (UniqueName: \"kubernetes.io/projected/fa8aca36-b3bf-45e1-9e12-d33677ebc2ac-kube-api-access-jk7rn\") pod \"maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5\" (UID: \"fa8aca36-b3bf-45e1-9e12-d33677ebc2ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5"
Aug 04 18:57:45.937315 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:45.937288    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa8aca36-b3bf-45e1-9e12-d33677ebc2ac-openshift-service-ca\") pod \"maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5\" (UID: \"fa8aca36-b3bf-45e1-9e12-d33677ebc2ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5"
Aug 04 18:57:45.939298 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:45.939276    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa8aca36-b3bf-45e1-9e12-d33677ebc2ac-maas-api-tls\") pod \"maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5\" (UID: \"fa8aca36-b3bf-45e1-9e12-d33677ebc2ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5"
Aug 04 18:57:45.947242 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:45.947218    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk7rn\" (UniqueName: \"kubernetes.io/projected/fa8aca36-b3bf-45e1-9e12-d33677ebc2ac-kube-api-access-jk7rn\") pod \"maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5\" (UID: \"fa8aca36-b3bf-45e1-9e12-d33677ebc2ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5"
Aug 04 18:57:46.074657 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:46.074570    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5"
Aug 04 18:57:46.238968 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:46.238935    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5"]
Aug 04 18:57:46.240267 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:57:46.240240    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa8aca36_b3bf_45e1_9e12_d33677ebc2ac.slice/crio-c6ae6f53cada94c92adf70d37daebee3be74c51909ec7cac604771fdf3b78ca4 WatchSource:0}: Error finding container c6ae6f53cada94c92adf70d37daebee3be74c51909ec7cac604771fdf3b78ca4: Status 404 returned error can't find the container with id c6ae6f53cada94c92adf70d37daebee3be74c51909ec7cac604771fdf3b78ca4
Aug 04 18:57:46.241561 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:46.241545    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:57:46.749435 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:46.749404    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5" event={"ID":"fa8aca36-b3bf-45e1-9e12-d33677ebc2ac","Type":"ContainerStarted","Data":"c6ae6f53cada94c92adf70d37daebee3be74c51909ec7cac604771fdf3b78ca4"}
Aug 04 18:57:46.887343 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:46.887313    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r"]
Aug 04 18:57:46.890822 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:46.890801    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r"
Aug 04 18:57:46.893737 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:46.893705    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-93cfcc2b\""
Aug 04 18:57:46.893912 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:46.893815    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-93cfcc2b-dockercfg-rpm2x\""
Aug 04 18:57:46.921002 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:46.920978    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r"]
Aug 04 18:57:46.945251 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:46.945222    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzvk8\" (UniqueName: \"kubernetes.io/projected/ae24bcb8-bf0f-4ded-9a4a-14237788dcaa-kube-api-access-tzvk8\") pod \"payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r\" (UID: \"ae24bcb8-bf0f-4ded-9a4a-14237788dcaa\") " pod="openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r"
Aug 04 18:57:46.945394 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:46.945262    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae24bcb8-bf0f-4ded-9a4a-14237788dcaa-plugins-config-volume\") pod \"payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r\" (UID: \"ae24bcb8-bf0f-4ded-9a4a-14237788dcaa\") " pod="openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r"
Aug 04 18:57:47.046392 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:47.046312    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzvk8\" (UniqueName: \"kubernetes.io/projected/ae24bcb8-bf0f-4ded-9a4a-14237788dcaa-kube-api-access-tzvk8\") pod \"payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r\" (UID: \"ae24bcb8-bf0f-4ded-9a4a-14237788dcaa\") " pod="openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r"
Aug 04 18:57:47.046392 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:47.046350    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae24bcb8-bf0f-4ded-9a4a-14237788dcaa-plugins-config-volume\") pod \"payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r\" (UID: \"ae24bcb8-bf0f-4ded-9a4a-14237788dcaa\") " pod="openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r"
Aug 04 18:57:47.047037 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:47.047015    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae24bcb8-bf0f-4ded-9a4a-14237788dcaa-plugins-config-volume\") pod \"payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r\" (UID: \"ae24bcb8-bf0f-4ded-9a4a-14237788dcaa\") " pod="openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r"
Aug 04 18:57:47.076591 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:47.076563    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzvk8\" (UniqueName: \"kubernetes.io/projected/ae24bcb8-bf0f-4ded-9a4a-14237788dcaa-kube-api-access-tzvk8\") pod \"payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r\" (UID: \"ae24bcb8-bf0f-4ded-9a4a-14237788dcaa\") " pod="openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r"
Aug 04 18:57:47.201158 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:47.201130    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r"
Aug 04 18:57:47.366650 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:47.366549    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r"]
Aug 04 18:57:47.371120 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:57:47.371093    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae24bcb8_bf0f_4ded_9a4a_14237788dcaa.slice/crio-a03cbacf6d0765d0e625b50ff90fe8141afcf8c0a75be5d1943b4b455d1ca5b4 WatchSource:0}: Error finding container a03cbacf6d0765d0e625b50ff90fe8141afcf8c0a75be5d1943b4b455d1ca5b4: Status 404 returned error can't find the container with id a03cbacf6d0765d0e625b50ff90fe8141afcf8c0a75be5d1943b4b455d1ca5b4
Aug 04 18:57:47.755881 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:47.755845    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5" event={"ID":"fa8aca36-b3bf-45e1-9e12-d33677ebc2ac","Type":"ContainerStarted","Data":"eaa00ab2848cb2bfa5a433fe1017dbab79e2bbc55541068f9afcf74d970be5b3"}
Aug 04 18:57:47.756062 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:47.755932    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5"
Aug 04 18:57:47.757387 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:47.757362    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r" event={"ID":"ae24bcb8-bf0f-4ded-9a4a-14237788dcaa","Type":"ContainerStarted","Data":"02e1aca5d906b90a3b1447e1299a54b5f8b9ad5c70d3e2da08829bd2759c6b41"}
Aug 04 18:57:47.757511 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:47.757411    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r"
Aug 04 18:57:47.757511 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:47.757435    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r" event={"ID":"ae24bcb8-bf0f-4ded-9a4a-14237788dcaa","Type":"ContainerStarted","Data":"a03cbacf6d0765d0e625b50ff90fe8141afcf8c0a75be5d1943b4b455d1ca5b4"}
Aug 04 18:57:47.779156 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:47.779109    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5" podStartSLOduration=2.266859525 podStartE2EDuration="2.779095671s" totalImagesPullingTime="512.236146ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:57:47.777861071 +0000 UTC m=+1788.312044161" watchObservedRunningTime="2026-08-04 18:57:47.779095671 +0000 UTC m=+1788.313278759"
Aug 04 18:57:47.799079 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:47.799010    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r" podStartSLOduration=1.798991485 podStartE2EDuration="1.798991485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:57:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:57:47.79793391 +0000 UTC m=+1788.332117001" watchObservedRunningTime="2026-08-04 18:57:47.798991485 +0000 UTC m=+1788.333174567"
Aug 04 18:57:53.768664 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:53.768572    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5"
Aug 04 18:57:58.764269 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:57:58.764234    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r"
Aug 04 18:58:16.301253 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.301218    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5"]
Aug 04 18:58:16.304034 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.303961    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5" podUID="fa8aca36-b3bf-45e1-9e12-d33677ebc2ac" containerName="maas-api" containerID="cri-o://eaa00ab2848cb2bfa5a433fe1017dbab79e2bbc55541068f9afcf74d970be5b3" gracePeriod=30
Aug 04 18:58:16.361152 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.361115    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r"]
Aug 04 18:58:16.361464 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.361416    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r" podUID="ae24bcb8-bf0f-4ded-9a4a-14237788dcaa" containerName="payload-processing" containerID="cri-o://02e1aca5d906b90a3b1447e1299a54b5f8b9ad5c70d3e2da08829bd2759c6b41" gracePeriod=30
Aug 04 18:58:16.608181 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.608154    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5"
Aug 04 18:58:16.645430 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.645407    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r"
Aug 04 18:58:16.723697 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.723663    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jk7rn\" (UniqueName: \"kubernetes.io/projected/fa8aca36-b3bf-45e1-9e12-d33677ebc2ac-kube-api-access-jk7rn\") pod \"fa8aca36-b3bf-45e1-9e12-d33677ebc2ac\" (UID: \"fa8aca36-b3bf-45e1-9e12-d33677ebc2ac\") "
Aug 04 18:58:16.723889 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.723750    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae24bcb8-bf0f-4ded-9a4a-14237788dcaa-plugins-config-volume\") pod \"ae24bcb8-bf0f-4ded-9a4a-14237788dcaa\" (UID: \"ae24bcb8-bf0f-4ded-9a4a-14237788dcaa\") "
Aug 04 18:58:16.723889 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.723804    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzvk8\" (UniqueName: \"kubernetes.io/projected/ae24bcb8-bf0f-4ded-9a4a-14237788dcaa-kube-api-access-tzvk8\") pod \"ae24bcb8-bf0f-4ded-9a4a-14237788dcaa\" (UID: \"ae24bcb8-bf0f-4ded-9a4a-14237788dcaa\") "
Aug 04 18:58:16.723889 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.723854    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa8aca36-b3bf-45e1-9e12-d33677ebc2ac-openshift-service-ca\") pod \"fa8aca36-b3bf-45e1-9e12-d33677ebc2ac\" (UID: \"fa8aca36-b3bf-45e1-9e12-d33677ebc2ac\") "
Aug 04 18:58:16.724099 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.723901    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa8aca36-b3bf-45e1-9e12-d33677ebc2ac-maas-api-tls\") pod \"fa8aca36-b3bf-45e1-9e12-d33677ebc2ac\" (UID: \"fa8aca36-b3bf-45e1-9e12-d33677ebc2ac\") "
Aug 04 18:58:16.724247 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.724199    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa8aca36-b3bf-45e1-9e12-d33677ebc2ac-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fa8aca36-b3bf-45e1-9e12-d33677ebc2ac" (UID: "fa8aca36-b3bf-45e1-9e12-d33677ebc2ac"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:58:16.724247 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.724204    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae24bcb8-bf0f-4ded-9a4a-14237788dcaa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ae24bcb8-bf0f-4ded-9a4a-14237788dcaa" (UID: "ae24bcb8-bf0f-4ded-9a4a-14237788dcaa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:58:16.726189 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.726151    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa8aca36-b3bf-45e1-9e12-d33677ebc2ac-kube-api-access-jk7rn" (OuterVolumeSpecName: "kube-api-access-jk7rn") pod "fa8aca36-b3bf-45e1-9e12-d33677ebc2ac" (UID: "fa8aca36-b3bf-45e1-9e12-d33677ebc2ac"). InnerVolumeSpecName "kube-api-access-jk7rn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:58:16.726189 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.726151    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8aca36-b3bf-45e1-9e12-d33677ebc2ac-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fa8aca36-b3bf-45e1-9e12-d33677ebc2ac" (UID: "fa8aca36-b3bf-45e1-9e12-d33677ebc2ac"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:58:16.726349 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.726224    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae24bcb8-bf0f-4ded-9a4a-14237788dcaa-kube-api-access-tzvk8" (OuterVolumeSpecName: "kube-api-access-tzvk8") pod "ae24bcb8-bf0f-4ded-9a4a-14237788dcaa" (UID: "ae24bcb8-bf0f-4ded-9a4a-14237788dcaa"). InnerVolumeSpecName "kube-api-access-tzvk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:58:16.825170 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.825075    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzvk8\" (UniqueName: \"kubernetes.io/projected/ae24bcb8-bf0f-4ded-9a4a-14237788dcaa-kube-api-access-tzvk8\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:58:16.825170 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.825110    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa8aca36-b3bf-45e1-9e12-d33677ebc2ac-openshift-service-ca\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:58:16.825170 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.825122    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa8aca36-b3bf-45e1-9e12-d33677ebc2ac-maas-api-tls\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:58:16.825170 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.825133    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jk7rn\" (UniqueName: \"kubernetes.io/projected/fa8aca36-b3bf-45e1-9e12-d33677ebc2ac-kube-api-access-jk7rn\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:58:16.825170 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.825146    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae24bcb8-bf0f-4ded-9a4a-14237788dcaa-plugins-config-volume\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:58:16.890678 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.890618    2558 generic.go:356] "Generic (PLEG): container finished" podID="ae24bcb8-bf0f-4ded-9a4a-14237788dcaa" containerID="02e1aca5d906b90a3b1447e1299a54b5f8b9ad5c70d3e2da08829bd2759c6b41" exitCode=0
Aug 04 18:58:16.890678 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.890672    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r" event={"ID":"ae24bcb8-bf0f-4ded-9a4a-14237788dcaa","Type":"ContainerDied","Data":"02e1aca5d906b90a3b1447e1299a54b5f8b9ad5c70d3e2da08829bd2759c6b41"}
Aug 04 18:58:16.890896 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.890688    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r"
Aug 04 18:58:16.890896 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.890734    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r" event={"ID":"ae24bcb8-bf0f-4ded-9a4a-14237788dcaa","Type":"ContainerDied","Data":"a03cbacf6d0765d0e625b50ff90fe8141afcf8c0a75be5d1943b4b455d1ca5b4"}
Aug 04 18:58:16.890896 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.890763    2558 scope.go:117] "RemoveContainer" containerID="02e1aca5d906b90a3b1447e1299a54b5f8b9ad5c70d3e2da08829bd2759c6b41"
Aug 04 18:58:16.891994 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.891973    2558 generic.go:356] "Generic (PLEG): container finished" podID="fa8aca36-b3bf-45e1-9e12-d33677ebc2ac" containerID="eaa00ab2848cb2bfa5a433fe1017dbab79e2bbc55541068f9afcf74d970be5b3" exitCode=0
Aug 04 18:58:16.892082 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.892008    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5" event={"ID":"fa8aca36-b3bf-45e1-9e12-d33677ebc2ac","Type":"ContainerDied","Data":"eaa00ab2848cb2bfa5a433fe1017dbab79e2bbc55541068f9afcf74d970be5b3"}
Aug 04 18:58:16.892082 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.892015    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5"
Aug 04 18:58:16.892082 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.892046    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5" event={"ID":"fa8aca36-b3bf-45e1-9e12-d33677ebc2ac","Type":"ContainerDied","Data":"c6ae6f53cada94c92adf70d37daebee3be74c51909ec7cac604771fdf3b78ca4"}
Aug 04 18:58:16.899987 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.899969    2558 scope.go:117] "RemoveContainer" containerID="02e1aca5d906b90a3b1447e1299a54b5f8b9ad5c70d3e2da08829bd2759c6b41"
Aug 04 18:58:16.900287 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:58:16.900263    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02e1aca5d906b90a3b1447e1299a54b5f8b9ad5c70d3e2da08829bd2759c6b41\": container with ID starting with 02e1aca5d906b90a3b1447e1299a54b5f8b9ad5c70d3e2da08829bd2759c6b41 not found: ID does not exist" containerID="02e1aca5d906b90a3b1447e1299a54b5f8b9ad5c70d3e2da08829bd2759c6b41"
Aug 04 18:58:16.900334 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.900302    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02e1aca5d906b90a3b1447e1299a54b5f8b9ad5c70d3e2da08829bd2759c6b41"} err="failed to get container status \"02e1aca5d906b90a3b1447e1299a54b5f8b9ad5c70d3e2da08829bd2759c6b41\": rpc error: code = NotFound desc = could not find container \"02e1aca5d906b90a3b1447e1299a54b5f8b9ad5c70d3e2da08829bd2759c6b41\": container with ID starting with 02e1aca5d906b90a3b1447e1299a54b5f8b9ad5c70d3e2da08829bd2759c6b41 not found: ID does not exist"
Aug 04 18:58:16.900334 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.900327    2558 scope.go:117] "RemoveContainer" containerID="eaa00ab2848cb2bfa5a433fe1017dbab79e2bbc55541068f9afcf74d970be5b3"
Aug 04 18:58:16.908203 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.908187    2558 scope.go:117] "RemoveContainer" containerID="eaa00ab2848cb2bfa5a433fe1017dbab79e2bbc55541068f9afcf74d970be5b3"
Aug 04 18:58:16.908464 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:58:16.908447    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaa00ab2848cb2bfa5a433fe1017dbab79e2bbc55541068f9afcf74d970be5b3\": container with ID starting with eaa00ab2848cb2bfa5a433fe1017dbab79e2bbc55541068f9afcf74d970be5b3 not found: ID does not exist" containerID="eaa00ab2848cb2bfa5a433fe1017dbab79e2bbc55541068f9afcf74d970be5b3"
Aug 04 18:58:16.908513 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.908471    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaa00ab2848cb2bfa5a433fe1017dbab79e2bbc55541068f9afcf74d970be5b3"} err="failed to get container status \"eaa00ab2848cb2bfa5a433fe1017dbab79e2bbc55541068f9afcf74d970be5b3\": rpc error: code = NotFound desc = could not find container \"eaa00ab2848cb2bfa5a433fe1017dbab79e2bbc55541068f9afcf74d970be5b3\": container with ID starting with eaa00ab2848cb2bfa5a433fe1017dbab79e2bbc55541068f9afcf74d970be5b3 not found: ID does not exist"
Aug 04 18:58:16.919399 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.919372    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5"]
Aug 04 18:58:16.922083 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.922063    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-93cfcc2b-85d49585f4-9nxw5"]
Aug 04 18:58:16.932339 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.932319    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r"]
Aug 04 18:58:16.942642 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:16.942613    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r"]
Aug 04 18:58:17.963914 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:17.963883    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae24bcb8-bf0f-4ded-9a4a-14237788dcaa" path="/var/lib/kubelet/pods/ae24bcb8-bf0f-4ded-9a4a-14237788dcaa/volumes"
Aug 04 18:58:17.964459 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:17.964440    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa8aca36-b3bf-45e1-9e12-d33677ebc2ac" path="/var/lib/kubelet/pods/fa8aca36-b3bf-45e1-9e12-d33677ebc2ac/volumes"
Aug 04 18:58:20.423756 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:20.423721    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh"]
Aug 04 18:58:20.424229 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:20.424095    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa8aca36-b3bf-45e1-9e12-d33677ebc2ac" containerName="maas-api"
Aug 04 18:58:20.424229 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:20.424110    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa8aca36-b3bf-45e1-9e12-d33677ebc2ac" containerName="maas-api"
Aug 04 18:58:20.424229 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:20.424126    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae24bcb8-bf0f-4ded-9a4a-14237788dcaa" containerName="payload-processing"
Aug 04 18:58:20.424229 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:20.424133    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae24bcb8-bf0f-4ded-9a4a-14237788dcaa" containerName="payload-processing"
Aug 04 18:58:20.424229 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:20.424194    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae24bcb8-bf0f-4ded-9a4a-14237788dcaa" containerName="payload-processing"
Aug 04 18:58:20.424229 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:20.424206    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa8aca36-b3bf-45e1-9e12-d33677ebc2ac" containerName="maas-api"
Aug 04 18:58:20.428550 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:20.428527    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh"
Aug 04 18:58:20.435852 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:20.435834    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-2646b40b-serving-cert\""
Aug 04 18:58:20.447205 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:20.445997    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh"]
Aug 04 18:58:20.557237 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:20.557194    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6cdc108-5cd2-40af-8dc6-17fce1c3931b-openshift-service-ca\") pod \"maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh\" (UID: \"d6cdc108-5cd2-40af-8dc6-17fce1c3931b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh"
Aug 04 18:58:20.557406 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:20.557299    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqwcq\" (UniqueName: \"kubernetes.io/projected/d6cdc108-5cd2-40af-8dc6-17fce1c3931b-kube-api-access-wqwcq\") pod \"maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh\" (UID: \"d6cdc108-5cd2-40af-8dc6-17fce1c3931b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh"
Aug 04 18:58:20.557406 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:20.557384    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6cdc108-5cd2-40af-8dc6-17fce1c3931b-maas-api-tls\") pod \"maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh\" (UID: \"d6cdc108-5cd2-40af-8dc6-17fce1c3931b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh"
Aug 04 18:58:20.658461 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:20.658420    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6cdc108-5cd2-40af-8dc6-17fce1c3931b-maas-api-tls\") pod \"maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh\" (UID: \"d6cdc108-5cd2-40af-8dc6-17fce1c3931b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh"
Aug 04 18:58:20.658613 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:20.658480    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6cdc108-5cd2-40af-8dc6-17fce1c3931b-openshift-service-ca\") pod \"maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh\" (UID: \"d6cdc108-5cd2-40af-8dc6-17fce1c3931b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh"
Aug 04 18:58:20.658613 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:20.658517    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqwcq\" (UniqueName: \"kubernetes.io/projected/d6cdc108-5cd2-40af-8dc6-17fce1c3931b-kube-api-access-wqwcq\") pod \"maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh\" (UID: \"d6cdc108-5cd2-40af-8dc6-17fce1c3931b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh"
Aug 04 18:58:20.658739 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:58:20.658605    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-serving-cert: secret "maas-api-e2e-migrate-2646b40b-serving-cert" not found
Aug 04 18:58:20.658739 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:58:20.658720    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6cdc108-5cd2-40af-8dc6-17fce1c3931b-maas-api-tls podName:d6cdc108-5cd2-40af-8dc6-17fce1c3931b nodeName:}" failed. No retries permitted until 2026-08-04 18:58:21.158697024 +0000 UTC m=+1821.692880096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d6cdc108-5cd2-40af-8dc6-17fce1c3931b-maas-api-tls") pod "maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh" (UID: "d6cdc108-5cd2-40af-8dc6-17fce1c3931b") : secret "maas-api-e2e-migrate-2646b40b-serving-cert" not found
Aug 04 18:58:20.659167 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:20.659149    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6cdc108-5cd2-40af-8dc6-17fce1c3931b-openshift-service-ca\") pod \"maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh\" (UID: \"d6cdc108-5cd2-40af-8dc6-17fce1c3931b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh"
Aug 04 18:58:20.668114 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:20.668087    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqwcq\" (UniqueName: \"kubernetes.io/projected/d6cdc108-5cd2-40af-8dc6-17fce1c3931b-kube-api-access-wqwcq\") pod \"maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh\" (UID: \"d6cdc108-5cd2-40af-8dc6-17fce1c3931b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh"
Aug 04 18:58:21.145410 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.145374    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75"]
Aug 04 18:58:21.149165 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.149141    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75"
Aug 04 18:58:21.151687 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.151665    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-2646b40b\""
Aug 04 18:58:21.151962 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.151946    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-2646b40b-dockercfg-5bbf2\""
Aug 04 18:58:21.159903 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.159879    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75"]
Aug 04 18:58:21.163432 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.163395    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6cdc108-5cd2-40af-8dc6-17fce1c3931b-maas-api-tls\") pod \"maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh\" (UID: \"d6cdc108-5cd2-40af-8dc6-17fce1c3931b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh"
Aug 04 18:58:21.165718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.165697    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6cdc108-5cd2-40af-8dc6-17fce1c3931b-maas-api-tls\") pod \"maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh\" (UID: \"d6cdc108-5cd2-40af-8dc6-17fce1c3931b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh"
Aug 04 18:58:21.264826 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.264787    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de316415-cb7c-4a37-af2d-96c6ece9839e-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75\" (UID: \"de316415-cb7c-4a37-af2d-96c6ece9839e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75"
Aug 04 18:58:21.264990 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.264833    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdpg6\" (UniqueName: \"kubernetes.io/projected/de316415-cb7c-4a37-af2d-96c6ece9839e-kube-api-access-xdpg6\") pod \"payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75\" (UID: \"de316415-cb7c-4a37-af2d-96c6ece9839e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75"
Aug 04 18:58:21.339337 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.339292    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh"
Aug 04 18:58:21.365486 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.365455    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de316415-cb7c-4a37-af2d-96c6ece9839e-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75\" (UID: \"de316415-cb7c-4a37-af2d-96c6ece9839e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75"
Aug 04 18:58:21.365640 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.365500    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdpg6\" (UniqueName: \"kubernetes.io/projected/de316415-cb7c-4a37-af2d-96c6ece9839e-kube-api-access-xdpg6\") pod \"payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75\" (UID: \"de316415-cb7c-4a37-af2d-96c6ece9839e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75"
Aug 04 18:58:21.366125 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.366106    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de316415-cb7c-4a37-af2d-96c6ece9839e-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75\" (UID: \"de316415-cb7c-4a37-af2d-96c6ece9839e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75"
Aug 04 18:58:21.374272 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.374247    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdpg6\" (UniqueName: \"kubernetes.io/projected/de316415-cb7c-4a37-af2d-96c6ece9839e-kube-api-access-xdpg6\") pod \"payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75\" (UID: \"de316415-cb7c-4a37-af2d-96c6ece9839e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75"
Aug 04 18:58:21.461603 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.461569    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75"
Aug 04 18:58:21.483316 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.483287    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh"]
Aug 04 18:58:21.486241 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:58:21.486196    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6cdc108_5cd2_40af_8dc6_17fce1c3931b.slice/crio-be5f3cd4449c08a1b81744cf6d7e515fb9821caf94e753c0a10333fa0a946444 WatchSource:0}: Error finding container be5f3cd4449c08a1b81744cf6d7e515fb9821caf94e753c0a10333fa0a946444: Status 404 returned error can't find the container with id be5f3cd4449c08a1b81744cf6d7e515fb9821caf94e753c0a10333fa0a946444
Aug 04 18:58:21.606168 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.606144    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75"]
Aug 04 18:58:21.608247 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:58:21.608222    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde316415_cb7c_4a37_af2d_96c6ece9839e.slice/crio-d931fd09fd467f765200885fd27b54a92d140fac6e4b374868d0e3a71db32004 WatchSource:0}: Error finding container d931fd09fd467f765200885fd27b54a92d140fac6e4b374868d0e3a71db32004: Status 404 returned error can't find the container with id d931fd09fd467f765200885fd27b54a92d140fac6e4b374868d0e3a71db32004
Aug 04 18:58:21.919543 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.919507    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh" event={"ID":"d6cdc108-5cd2-40af-8dc6-17fce1c3931b","Type":"ContainerStarted","Data":"6788d51afb92b20e12192647d1f6631310d7253c363b72a653f8e2150cf53a24"}
Aug 04 18:58:21.919887 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.919571    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh" event={"ID":"d6cdc108-5cd2-40af-8dc6-17fce1c3931b","Type":"ContainerStarted","Data":"be5f3cd4449c08a1b81744cf6d7e515fb9821caf94e753c0a10333fa0a946444"}
Aug 04 18:58:21.919887 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.919597    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh"
Aug 04 18:58:21.921072 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.921042    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75" event={"ID":"de316415-cb7c-4a37-af2d-96c6ece9839e","Type":"ContainerStarted","Data":"aa9f2d85c7b9ae2a627d25a7236076d05563b3f238c3fcaac18083af33f357c6"}
Aug 04 18:58:21.921202 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.921090    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75" event={"ID":"de316415-cb7c-4a37-af2d-96c6ece9839e","Type":"ContainerStarted","Data":"d931fd09fd467f765200885fd27b54a92d140fac6e4b374868d0e3a71db32004"}
Aug 04 18:58:21.921202 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.921174    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75"
Aug 04 18:58:21.940321 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.940247    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh" podStartSLOduration=1.600576413 podStartE2EDuration="1.940225077s" totalImagesPullingTime="339.648664ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:58:21.937942771 +0000 UTC m=+1822.472125860" watchObservedRunningTime="2026-08-04 18:58:21.940225077 +0000 UTC m=+1822.474408168"
Aug 04 18:58:21.957337 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:21.957288    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75" podStartSLOduration=0.957272049 podStartE2EDuration="957.272049ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:58:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:58:21.955370251 +0000 UTC m=+1822.489553343" watchObservedRunningTime="2026-08-04 18:58:21.957272049 +0000 UTC m=+1822.491455197"
Aug 04 18:58:27.932615 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:27.932580    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh"
Aug 04 18:58:32.928922 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:32.928886    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75"
Aug 04 18:58:51.798454 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:51.798416    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh"]
Aug 04 18:58:51.798869 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:51.798682    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh" podUID="d6cdc108-5cd2-40af-8dc6-17fce1c3931b" containerName="maas-api" containerID="cri-o://6788d51afb92b20e12192647d1f6631310d7253c363b72a653f8e2150cf53a24" gracePeriod=30
Aug 04 18:58:51.892850 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:51.892817    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75"]
Aug 04 18:58:51.893066 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:51.893032    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75" podUID="de316415-cb7c-4a37-af2d-96c6ece9839e" containerName="payload-pre-processing" containerID="cri-o://aa9f2d85c7b9ae2a627d25a7236076d05563b3f238c3fcaac18083af33f357c6" gracePeriod=30
Aug 04 18:58:52.079039 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:52.078987    2558 generic.go:356] "Generic (PLEG): container finished" podID="de316415-cb7c-4a37-af2d-96c6ece9839e" containerID="aa9f2d85c7b9ae2a627d25a7236076d05563b3f238c3fcaac18083af33f357c6" exitCode=0
Aug 04 18:58:52.079363 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:52.079110    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75" event={"ID":"de316415-cb7c-4a37-af2d-96c6ece9839e","Type":"ContainerDied","Data":"aa9f2d85c7b9ae2a627d25a7236076d05563b3f238c3fcaac18083af33f357c6"}
Aug 04 18:58:52.081363 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:52.081336    2558 generic.go:356] "Generic (PLEG): container finished" podID="d6cdc108-5cd2-40af-8dc6-17fce1c3931b" containerID="6788d51afb92b20e12192647d1f6631310d7253c363b72a653f8e2150cf53a24" exitCode=0
Aug 04 18:58:52.081456 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:52.081384    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh" event={"ID":"d6cdc108-5cd2-40af-8dc6-17fce1c3931b","Type":"ContainerDied","Data":"6788d51afb92b20e12192647d1f6631310d7253c363b72a653f8e2150cf53a24"}
Aug 04 18:58:52.146979 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:52.146944    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh"
Aug 04 18:58:52.183499 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:52.183448    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75"
Aug 04 18:58:52.255769 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:52.255606    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de316415-cb7c-4a37-af2d-96c6ece9839e-plugins-config-volume\") pod \"de316415-cb7c-4a37-af2d-96c6ece9839e\" (UID: \"de316415-cb7c-4a37-af2d-96c6ece9839e\") "
Aug 04 18:58:52.255981 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:52.255913    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdpg6\" (UniqueName: \"kubernetes.io/projected/de316415-cb7c-4a37-af2d-96c6ece9839e-kube-api-access-xdpg6\") pod \"de316415-cb7c-4a37-af2d-96c6ece9839e\" (UID: \"de316415-cb7c-4a37-af2d-96c6ece9839e\") "
Aug 04 18:58:52.255981 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:52.255970    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6cdc108-5cd2-40af-8dc6-17fce1c3931b-maas-api-tls\") pod \"d6cdc108-5cd2-40af-8dc6-17fce1c3931b\" (UID: \"d6cdc108-5cd2-40af-8dc6-17fce1c3931b\") "
Aug 04 18:58:52.256102 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:52.256018    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqwcq\" (UniqueName: \"kubernetes.io/projected/d6cdc108-5cd2-40af-8dc6-17fce1c3931b-kube-api-access-wqwcq\") pod \"d6cdc108-5cd2-40af-8dc6-17fce1c3931b\" (UID: \"d6cdc108-5cd2-40af-8dc6-17fce1c3931b\") "
Aug 04 18:58:52.256102 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:52.255964    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de316415-cb7c-4a37-af2d-96c6ece9839e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "de316415-cb7c-4a37-af2d-96c6ece9839e" (UID: "de316415-cb7c-4a37-af2d-96c6ece9839e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:58:52.256208 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:52.256104    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6cdc108-5cd2-40af-8dc6-17fce1c3931b-openshift-service-ca\") pod \"d6cdc108-5cd2-40af-8dc6-17fce1c3931b\" (UID: \"d6cdc108-5cd2-40af-8dc6-17fce1c3931b\") "
Aug 04 18:58:52.256442 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:52.256417    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de316415-cb7c-4a37-af2d-96c6ece9839e-plugins-config-volume\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:58:52.256548 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:52.256451    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6cdc108-5cd2-40af-8dc6-17fce1c3931b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d6cdc108-5cd2-40af-8dc6-17fce1c3931b" (UID: "d6cdc108-5cd2-40af-8dc6-17fce1c3931b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:58:52.258091 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:52.258069    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6cdc108-5cd2-40af-8dc6-17fce1c3931b-kube-api-access-wqwcq" (OuterVolumeSpecName: "kube-api-access-wqwcq") pod "d6cdc108-5cd2-40af-8dc6-17fce1c3931b" (UID: "d6cdc108-5cd2-40af-8dc6-17fce1c3931b"). InnerVolumeSpecName "kube-api-access-wqwcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:58:52.258497 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:52.258474    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6cdc108-5cd2-40af-8dc6-17fce1c3931b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d6cdc108-5cd2-40af-8dc6-17fce1c3931b" (UID: "d6cdc108-5cd2-40af-8dc6-17fce1c3931b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:58:52.258575 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:52.258492    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de316415-cb7c-4a37-af2d-96c6ece9839e-kube-api-access-xdpg6" (OuterVolumeSpecName: "kube-api-access-xdpg6") pod "de316415-cb7c-4a37-af2d-96c6ece9839e" (UID: "de316415-cb7c-4a37-af2d-96c6ece9839e"). InnerVolumeSpecName "kube-api-access-xdpg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:58:52.357111 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:52.357016    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdpg6\" (UniqueName: \"kubernetes.io/projected/de316415-cb7c-4a37-af2d-96c6ece9839e-kube-api-access-xdpg6\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:58:52.357111 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:52.357051    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6cdc108-5cd2-40af-8dc6-17fce1c3931b-maas-api-tls\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:58:52.357111 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:52.357065    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqwcq\" (UniqueName: \"kubernetes.io/projected/d6cdc108-5cd2-40af-8dc6-17fce1c3931b-kube-api-access-wqwcq\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:58:52.357111 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:52.357076    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6cdc108-5cd2-40af-8dc6-17fce1c3931b-openshift-service-ca\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:58:53.087809 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:53.087708    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh"
Aug 04 18:58:53.087809 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:53.087748    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh" event={"ID":"d6cdc108-5cd2-40af-8dc6-17fce1c3931b","Type":"ContainerDied","Data":"be5f3cd4449c08a1b81744cf6d7e515fb9821caf94e753c0a10333fa0a946444"}
Aug 04 18:58:53.087809 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:53.087809    2558 scope.go:117] "RemoveContainer" containerID="6788d51afb92b20e12192647d1f6631310d7253c363b72a653f8e2150cf53a24"
Aug 04 18:58:53.089218 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:53.089172    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75" event={"ID":"de316415-cb7c-4a37-af2d-96c6ece9839e","Type":"ContainerDied","Data":"d931fd09fd467f765200885fd27b54a92d140fac6e4b374868d0e3a71db32004"}
Aug 04 18:58:53.089290 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:53.089254    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75"
Aug 04 18:58:53.102569 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:53.102529    2558 scope.go:117] "RemoveContainer" containerID="aa9f2d85c7b9ae2a627d25a7236076d05563b3f238c3fcaac18083af33f357c6"
Aug 04 18:58:53.125518 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:53.125487    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh"]
Aug 04 18:58:53.129996 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:53.129970    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2646b40b-788dcb4c7d-9nslh"]
Aug 04 18:58:53.142836 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:53.142805    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75"]
Aug 04 18:58:53.146679 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:53.146653    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75"]
Aug 04 18:58:53.963041 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:53.963010    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6cdc108-5cd2-40af-8dc6-17fce1c3931b" path="/var/lib/kubelet/pods/d6cdc108-5cd2-40af-8dc6-17fce1c3931b/volumes"
Aug 04 18:58:53.963405 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:53.963391    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de316415-cb7c-4a37-af2d-96c6ece9839e" path="/var/lib/kubelet/pods/de316415-cb7c-4a37-af2d-96c6ece9839e/volumes"
Aug 04 18:58:56.414220 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:56.414187    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x"]
Aug 04 18:58:56.414733 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:56.414712    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6cdc108-5cd2-40af-8dc6-17fce1c3931b" containerName="maas-api"
Aug 04 18:58:56.414825 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:56.414735    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6cdc108-5cd2-40af-8dc6-17fce1c3931b" containerName="maas-api"
Aug 04 18:58:56.414825 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:56.414777    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de316415-cb7c-4a37-af2d-96c6ece9839e" containerName="payload-pre-processing"
Aug 04 18:58:56.414825 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:56.414787    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="de316415-cb7c-4a37-af2d-96c6ece9839e" containerName="payload-pre-processing"
Aug 04 18:58:56.414975 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:56.414877    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="de316415-cb7c-4a37-af2d-96c6ece9839e" containerName="payload-pre-processing"
Aug 04 18:58:56.414975 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:56.414893    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6cdc108-5cd2-40af-8dc6-17fce1c3931b" containerName="maas-api"
Aug 04 18:58:56.419375 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:56.419351    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x"
Aug 04 18:58:56.422145 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:56.422110    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-41669ddd-serving-cert\""
Aug 04 18:58:56.442416 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:56.442386    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x"]
Aug 04 18:58:56.597581 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:56.597539    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klfqj\" (UniqueName: \"kubernetes.io/projected/cd51a865-dadf-4197-9793-b001a40346fa-kube-api-access-klfqj\") pod \"maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x\" (UID: \"cd51a865-dadf-4197-9793-b001a40346fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x"
Aug 04 18:58:56.597581 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:56.597589    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd51a865-dadf-4197-9793-b001a40346fa-openshift-service-ca\") pod \"maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x\" (UID: \"cd51a865-dadf-4197-9793-b001a40346fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x"
Aug 04 18:58:56.597832 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:56.597624    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd51a865-dadf-4197-9793-b001a40346fa-maas-api-tls\") pod \"maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x\" (UID: \"cd51a865-dadf-4197-9793-b001a40346fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x"
Aug 04 18:58:56.699145 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:56.699054    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd51a865-dadf-4197-9793-b001a40346fa-maas-api-tls\") pod \"maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x\" (UID: \"cd51a865-dadf-4197-9793-b001a40346fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x"
Aug 04 18:58:56.699145 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:56.699142    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klfqj\" (UniqueName: \"kubernetes.io/projected/cd51a865-dadf-4197-9793-b001a40346fa-kube-api-access-klfqj\") pod \"maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x\" (UID: \"cd51a865-dadf-4197-9793-b001a40346fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x"
Aug 04 18:58:56.699325 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:56.699173    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd51a865-dadf-4197-9793-b001a40346fa-openshift-service-ca\") pod \"maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x\" (UID: \"cd51a865-dadf-4197-9793-b001a40346fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x"
Aug 04 18:58:56.699325 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:58:56.699209    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-serving-cert: secret "maas-api-e2e-ait-41669ddd-serving-cert" not found
Aug 04 18:58:56.699325 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:58:56.699286    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd51a865-dadf-4197-9793-b001a40346fa-maas-api-tls podName:cd51a865-dadf-4197-9793-b001a40346fa nodeName:}" failed. No retries permitted until 2026-08-04 18:58:57.199266267 +0000 UTC m=+1857.733449357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cd51a865-dadf-4197-9793-b001a40346fa-maas-api-tls") pod "maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x" (UID: "cd51a865-dadf-4197-9793-b001a40346fa") : secret "maas-api-e2e-ait-41669ddd-serving-cert" not found
Aug 04 18:58:56.699856 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:56.699839    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd51a865-dadf-4197-9793-b001a40346fa-openshift-service-ca\") pod \"maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x\" (UID: \"cd51a865-dadf-4197-9793-b001a40346fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x"
Aug 04 18:58:56.714290 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:56.714266    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klfqj\" (UniqueName: \"kubernetes.io/projected/cd51a865-dadf-4197-9793-b001a40346fa-kube-api-access-klfqj\") pod \"maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x\" (UID: \"cd51a865-dadf-4197-9793-b001a40346fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x"
Aug 04 18:58:57.204220 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.204189    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd51a865-dadf-4197-9793-b001a40346fa-maas-api-tls\") pod \"maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x\" (UID: \"cd51a865-dadf-4197-9793-b001a40346fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x"
Aug 04 18:58:57.206915 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.206886    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd51a865-dadf-4197-9793-b001a40346fa-maas-api-tls\") pod \"maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x\" (UID: \"cd51a865-dadf-4197-9793-b001a40346fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x"
Aug 04 18:58:57.331372 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.331328    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x"
Aug 04 18:58:57.401190 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.401161    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s"]
Aug 04 18:58:57.404988 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.404969    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s"
Aug 04 18:58:57.407401 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.407379    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-41669ddd-dockercfg-cnd9n\""
Aug 04 18:58:57.407517 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.407412    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-41669ddd\""
Aug 04 18:58:57.418216 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.418157    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s"]
Aug 04 18:58:57.430883 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.430524    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg"]
Aug 04 18:58:57.436465 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.436439    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg"
Aug 04 18:58:57.452498 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.452433    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg"]
Aug 04 18:58:57.500294 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.500180    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x"]
Aug 04 18:58:57.505224 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:58:57.505200    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd51a865_dadf_4197_9793_b001a40346fa.slice/crio-b06f12233f78bab8e573eb04622448fb102413ddca9db2be25aa8582adec91e3 WatchSource:0}: Error finding container b06f12233f78bab8e573eb04622448fb102413ddca9db2be25aa8582adec91e3: Status 404 returned error can't find the container with id b06f12233f78bab8e573eb04622448fb102413ddca9db2be25aa8582adec91e3
Aug 04 18:58:57.506616 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.506586    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwrqz\" (UniqueName: \"kubernetes.io/projected/baa75238-ea86-4a39-816b-576288f33163-kube-api-access-qwrqz\") pod \"payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s\" (UID: \"baa75238-ea86-4a39-816b-576288f33163\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s"
Aug 04 18:58:57.506743 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.506662    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/baa75238-ea86-4a39-816b-576288f33163-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s\" (UID: \"baa75238-ea86-4a39-816b-576288f33163\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s"
Aug 04 18:58:57.607594 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.607559    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqrft\" (UniqueName: \"kubernetes.io/projected/bb464fe4-1d82-4e11-9064-c2e2db222816-kube-api-access-jqrft\") pod \"payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg\" (UID: \"bb464fe4-1d82-4e11-9064-c2e2db222816\") " pod="openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg"
Aug 04 18:58:57.607793 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.607616    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwrqz\" (UniqueName: \"kubernetes.io/projected/baa75238-ea86-4a39-816b-576288f33163-kube-api-access-qwrqz\") pod \"payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s\" (UID: \"baa75238-ea86-4a39-816b-576288f33163\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s"
Aug 04 18:58:57.607793 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.607673    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/baa75238-ea86-4a39-816b-576288f33163-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s\" (UID: \"baa75238-ea86-4a39-816b-576288f33163\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s"
Aug 04 18:58:57.607793 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.607713    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb464fe4-1d82-4e11-9064-c2e2db222816-plugins-config-volume\") pod \"payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg\" (UID: \"bb464fe4-1d82-4e11-9064-c2e2db222816\") " pod="openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg"
Aug 04 18:58:57.608343 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.608324    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/baa75238-ea86-4a39-816b-576288f33163-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s\" (UID: \"baa75238-ea86-4a39-816b-576288f33163\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s"
Aug 04 18:58:57.617118 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.617093    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwrqz\" (UniqueName: \"kubernetes.io/projected/baa75238-ea86-4a39-816b-576288f33163-kube-api-access-qwrqz\") pod \"payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s\" (UID: \"baa75238-ea86-4a39-816b-576288f33163\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s"
Aug 04 18:58:57.708204 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.708169    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqrft\" (UniqueName: \"kubernetes.io/projected/bb464fe4-1d82-4e11-9064-c2e2db222816-kube-api-access-jqrft\") pod \"payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg\" (UID: \"bb464fe4-1d82-4e11-9064-c2e2db222816\") " pod="openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg"
Aug 04 18:58:57.708390 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.708236    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb464fe4-1d82-4e11-9064-c2e2db222816-plugins-config-volume\") pod \"payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg\" (UID: \"bb464fe4-1d82-4e11-9064-c2e2db222816\") " pod="openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg"
Aug 04 18:58:57.708902 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.708883    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb464fe4-1d82-4e11-9064-c2e2db222816-plugins-config-volume\") pod \"payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg\" (UID: \"bb464fe4-1d82-4e11-9064-c2e2db222816\") " pod="openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg"
Aug 04 18:58:57.717818 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.717787    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s"
Aug 04 18:58:57.720171 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.720149    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqrft\" (UniqueName: \"kubernetes.io/projected/bb464fe4-1d82-4e11-9064-c2e2db222816-kube-api-access-jqrft\") pod \"payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg\" (UID: \"bb464fe4-1d82-4e11-9064-c2e2db222816\") " pod="openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg"
Aug 04 18:58:57.749701 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.749675    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg"
Aug 04 18:58:57.878448 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.878419    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s"]
Aug 04 18:58:57.881466 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:58:57.881437    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaa75238_ea86_4a39_816b_576288f33163.slice/crio-2e845995a8e07f0b5a8a1f1162c0f000fbdd16b305ace0406d36830d672b27ba WatchSource:0}: Error finding container 2e845995a8e07f0b5a8a1f1162c0f000fbdd16b305ace0406d36830d672b27ba: Status 404 returned error can't find the container with id 2e845995a8e07f0b5a8a1f1162c0f000fbdd16b305ace0406d36830d672b27ba
Aug 04 18:58:57.904902 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:57.904882    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg"]
Aug 04 18:58:57.914699 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:58:57.914675    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb464fe4_1d82_4e11_9064_c2e2db222816.slice/crio-cf3c02bdeec3759042a05268ebc7077a9711b25b992f37f9dcf9d257c2a0cdab WatchSource:0}: Error finding container cf3c02bdeec3759042a05268ebc7077a9711b25b992f37f9dcf9d257c2a0cdab: Status 404 returned error can't find the container with id cf3c02bdeec3759042a05268ebc7077a9711b25b992f37f9dcf9d257c2a0cdab
Aug 04 18:58:58.116274 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:58.116224    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s" event={"ID":"baa75238-ea86-4a39-816b-576288f33163","Type":"ContainerStarted","Data":"58250396eb954ef378373f433fe748eeb3e01130539000b47224a844018f2482"}
Aug 04 18:58:58.116274 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:58.116294    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s" event={"ID":"baa75238-ea86-4a39-816b-576288f33163","Type":"ContainerStarted","Data":"2e845995a8e07f0b5a8a1f1162c0f000fbdd16b305ace0406d36830d672b27ba"}
Aug 04 18:58:58.116540 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:58.116336    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s"
Aug 04 18:58:58.117820 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:58.117796    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x" event={"ID":"cd51a865-dadf-4197-9793-b001a40346fa","Type":"ContainerStarted","Data":"842c5678784115e2faa0214e29201152cbd25631bca42d257480d56f3e3c0413"}
Aug 04 18:58:58.117973 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:58.117834    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x" event={"ID":"cd51a865-dadf-4197-9793-b001a40346fa","Type":"ContainerStarted","Data":"b06f12233f78bab8e573eb04622448fb102413ddca9db2be25aa8582adec91e3"}
Aug 04 18:58:58.117973 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:58.117900    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x"
Aug 04 18:58:58.119248 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:58.119229    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg" event={"ID":"bb464fe4-1d82-4e11-9064-c2e2db222816","Type":"ContainerStarted","Data":"2cb16629c88444a9d16d628a6a8dabbea157117835f392195dddc6b879b0c808"}
Aug 04 18:58:58.119331 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:58.119263    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg" event={"ID":"bb464fe4-1d82-4e11-9064-c2e2db222816","Type":"ContainerStarted","Data":"cf3c02bdeec3759042a05268ebc7077a9711b25b992f37f9dcf9d257c2a0cdab"}
Aug 04 18:58:58.119380 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:58.119364    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg"
Aug 04 18:58:58.141761 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:58.141714    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s" podStartSLOduration=1.141697928 podStartE2EDuration="1.141697928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:58:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:58:58.139529967 +0000 UTC m=+1858.673713056" watchObservedRunningTime="2026-08-04 18:58:58.141697928 +0000 UTC m=+1858.675881017"
Aug 04 18:58:58.175333 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:58.175261    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x" podStartSLOduration=1.707500615 podStartE2EDuration="2.17524172s" totalImagesPullingTime="467.741105ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:58:58.174691205 +0000 UTC m=+1858.708874295" watchObservedRunningTime="2026-08-04 18:58:58.17524172 +0000 UTC m=+1858.709424815"
Aug 04 18:58:58.197165 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:58:58.197103    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg" podStartSLOduration=1.197079544 podStartE2EDuration="1.197079544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:58:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:58:58.194947851 +0000 UTC m=+1858.729130945" watchObservedRunningTime="2026-08-04 18:58:58.197079544 +0000 UTC m=+1858.731262633"
Aug 04 18:59:04.128949 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:04.128919    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x"
Aug 04 18:59:09.125706 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:09.125677    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg"
Aug 04 18:59:09.126102 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:09.125750    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s"
Aug 04 18:59:27.025952 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.025912    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x"]
Aug 04 18:59:27.026419 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.026185    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x" podUID="cd51a865-dadf-4197-9793-b001a40346fa" containerName="maas-api" containerID="cri-o://842c5678784115e2faa0214e29201152cbd25631bca42d257480d56f3e3c0413" gracePeriod=30
Aug 04 18:59:27.092479 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.092441    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg"]
Aug 04 18:59:27.092758 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.092708    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg" podUID="bb464fe4-1d82-4e11-9064-c2e2db222816" containerName="payload-processing" containerID="cri-o://2cb16629c88444a9d16d628a6a8dabbea157117835f392195dddc6b879b0c808" gracePeriod=30
Aug 04 18:59:27.102478 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.102444    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s"]
Aug 04 18:59:27.102699 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.102673    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s" podUID="baa75238-ea86-4a39-816b-576288f33163" containerName="payload-pre-processing" containerID="cri-o://58250396eb954ef378373f433fe748eeb3e01130539000b47224a844018f2482" gracePeriod=30
Aug 04 18:59:27.265111 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.265016    2558 generic.go:356] "Generic (PLEG): container finished" podID="baa75238-ea86-4a39-816b-576288f33163" containerID="58250396eb954ef378373f433fe748eeb3e01130539000b47224a844018f2482" exitCode=0
Aug 04 18:59:27.265111 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.265115    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s" event={"ID":"baa75238-ea86-4a39-816b-576288f33163","Type":"ContainerDied","Data":"58250396eb954ef378373f433fe748eeb3e01130539000b47224a844018f2482"}
Aug 04 18:59:27.266793 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.266760    2558 generic.go:356] "Generic (PLEG): container finished" podID="cd51a865-dadf-4197-9793-b001a40346fa" containerID="842c5678784115e2faa0214e29201152cbd25631bca42d257480d56f3e3c0413" exitCode=0
Aug 04 18:59:27.266938 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.266870    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x" event={"ID":"cd51a865-dadf-4197-9793-b001a40346fa","Type":"ContainerDied","Data":"842c5678784115e2faa0214e29201152cbd25631bca42d257480d56f3e3c0413"}
Aug 04 18:59:27.268825 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.268778    2558 generic.go:356] "Generic (PLEG): container finished" podID="bb464fe4-1d82-4e11-9064-c2e2db222816" containerID="2cb16629c88444a9d16d628a6a8dabbea157117835f392195dddc6b879b0c808" exitCode=0
Aug 04 18:59:27.268825 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.268824    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg" event={"ID":"bb464fe4-1d82-4e11-9064-c2e2db222816","Type":"ContainerDied","Data":"2cb16629c88444a9d16d628a6a8dabbea157117835f392195dddc6b879b0c808"}
Aug 04 18:59:27.373704 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.373272    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x"
Aug 04 18:59:27.377016 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.376943    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg"
Aug 04 18:59:27.409394 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.409363    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s"
Aug 04 18:59:27.474211 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.474176    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb464fe4-1d82-4e11-9064-c2e2db222816-plugins-config-volume\") pod \"bb464fe4-1d82-4e11-9064-c2e2db222816\" (UID: \"bb464fe4-1d82-4e11-9064-c2e2db222816\") "
Aug 04 18:59:27.474395 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.474283    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd51a865-dadf-4197-9793-b001a40346fa-openshift-service-ca\") pod \"cd51a865-dadf-4197-9793-b001a40346fa\" (UID: \"cd51a865-dadf-4197-9793-b001a40346fa\") "
Aug 04 18:59:27.474395 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.474305    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd51a865-dadf-4197-9793-b001a40346fa-maas-api-tls\") pod \"cd51a865-dadf-4197-9793-b001a40346fa\" (UID: \"cd51a865-dadf-4197-9793-b001a40346fa\") "
Aug 04 18:59:27.474395 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.474326    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/baa75238-ea86-4a39-816b-576288f33163-plugins-config-volume\") pod \"baa75238-ea86-4a39-816b-576288f33163\" (UID: \"baa75238-ea86-4a39-816b-576288f33163\") "
Aug 04 18:59:27.474395 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.474352    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwrqz\" (UniqueName: \"kubernetes.io/projected/baa75238-ea86-4a39-816b-576288f33163-kube-api-access-qwrqz\") pod \"baa75238-ea86-4a39-816b-576288f33163\" (UID: \"baa75238-ea86-4a39-816b-576288f33163\") "
Aug 04 18:59:27.474621 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.474403    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klfqj\" (UniqueName: \"kubernetes.io/projected/cd51a865-dadf-4197-9793-b001a40346fa-kube-api-access-klfqj\") pod \"cd51a865-dadf-4197-9793-b001a40346fa\" (UID: \"cd51a865-dadf-4197-9793-b001a40346fa\") "
Aug 04 18:59:27.474621 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.474436    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqrft\" (UniqueName: \"kubernetes.io/projected/bb464fe4-1d82-4e11-9064-c2e2db222816-kube-api-access-jqrft\") pod \"bb464fe4-1d82-4e11-9064-c2e2db222816\" (UID: \"bb464fe4-1d82-4e11-9064-c2e2db222816\") "
Aug 04 18:59:27.474743 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.474707    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb464fe4-1d82-4e11-9064-c2e2db222816-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bb464fe4-1d82-4e11-9064-c2e2db222816" (UID: "bb464fe4-1d82-4e11-9064-c2e2db222816"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:59:27.474743 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.474728    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd51a865-dadf-4197-9793-b001a40346fa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cd51a865-dadf-4197-9793-b001a40346fa" (UID: "cd51a865-dadf-4197-9793-b001a40346fa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:59:27.474833 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.474764    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baa75238-ea86-4a39-816b-576288f33163-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "baa75238-ea86-4a39-816b-576288f33163" (UID: "baa75238-ea86-4a39-816b-576288f33163"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:59:27.476608 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.476585    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb464fe4-1d82-4e11-9064-c2e2db222816-kube-api-access-jqrft" (OuterVolumeSpecName: "kube-api-access-jqrft") pod "bb464fe4-1d82-4e11-9064-c2e2db222816" (UID: "bb464fe4-1d82-4e11-9064-c2e2db222816"). InnerVolumeSpecName "kube-api-access-jqrft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:59:27.476608 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.476611    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baa75238-ea86-4a39-816b-576288f33163-kube-api-access-qwrqz" (OuterVolumeSpecName: "kube-api-access-qwrqz") pod "baa75238-ea86-4a39-816b-576288f33163" (UID: "baa75238-ea86-4a39-816b-576288f33163"). InnerVolumeSpecName "kube-api-access-qwrqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:59:27.476918 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.476887    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd51a865-dadf-4197-9793-b001a40346fa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cd51a865-dadf-4197-9793-b001a40346fa" (UID: "cd51a865-dadf-4197-9793-b001a40346fa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:59:27.477007 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.476890    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd51a865-dadf-4197-9793-b001a40346fa-kube-api-access-klfqj" (OuterVolumeSpecName: "kube-api-access-klfqj") pod "cd51a865-dadf-4197-9793-b001a40346fa" (UID: "cd51a865-dadf-4197-9793-b001a40346fa"). InnerVolumeSpecName "kube-api-access-klfqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:59:27.575524 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.575465    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqrft\" (UniqueName: \"kubernetes.io/projected/bb464fe4-1d82-4e11-9064-c2e2db222816-kube-api-access-jqrft\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:59:27.575524 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.575486    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb464fe4-1d82-4e11-9064-c2e2db222816-plugins-config-volume\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:59:27.575524 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.575496    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd51a865-dadf-4197-9793-b001a40346fa-openshift-service-ca\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:59:27.575524 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.575504    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd51a865-dadf-4197-9793-b001a40346fa-maas-api-tls\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:59:27.575524 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.575513    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/baa75238-ea86-4a39-816b-576288f33163-plugins-config-volume\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:59:27.575524 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.575521    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwrqz\" (UniqueName: \"kubernetes.io/projected/baa75238-ea86-4a39-816b-576288f33163-kube-api-access-qwrqz\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:59:27.575524 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:27.575529    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klfqj\" (UniqueName: \"kubernetes.io/projected/cd51a865-dadf-4197-9793-b001a40346fa-kube-api-access-klfqj\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 18:59:28.275282 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:28.275188    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s"
Aug 04 18:59:28.275282 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:28.275192    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s" event={"ID":"baa75238-ea86-4a39-816b-576288f33163","Type":"ContainerDied","Data":"2e845995a8e07f0b5a8a1f1162c0f000fbdd16b305ace0406d36830d672b27ba"}
Aug 04 18:59:28.275810 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:28.275327    2558 scope.go:117] "RemoveContainer" containerID="58250396eb954ef378373f433fe748eeb3e01130539000b47224a844018f2482"
Aug 04 18:59:28.276691 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:28.276663    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x"
Aug 04 18:59:28.276787 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:28.276691    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x" event={"ID":"cd51a865-dadf-4197-9793-b001a40346fa","Type":"ContainerDied","Data":"b06f12233f78bab8e573eb04622448fb102413ddca9db2be25aa8582adec91e3"}
Aug 04 18:59:28.278086 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:28.278066    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg" event={"ID":"bb464fe4-1d82-4e11-9064-c2e2db222816","Type":"ContainerDied","Data":"cf3c02bdeec3759042a05268ebc7077a9711b25b992f37f9dcf9d257c2a0cdab"}
Aug 04 18:59:28.278238 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:28.278092    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg"
Aug 04 18:59:28.284896 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:28.284877    2558 scope.go:117] "RemoveContainer" containerID="842c5678784115e2faa0214e29201152cbd25631bca42d257480d56f3e3c0413"
Aug 04 18:59:28.292541 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:28.292526    2558 scope.go:117] "RemoveContainer" containerID="2cb16629c88444a9d16d628a6a8dabbea157117835f392195dddc6b879b0c808"
Aug 04 18:59:28.301738 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:28.301714    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x"]
Aug 04 18:59:28.306788 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:28.306771    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-41669ddd-5bf6cf8747-d7p7x"]
Aug 04 18:59:28.338198 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:28.338171    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg"]
Aug 04 18:59:28.357054 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:28.357027    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg"]
Aug 04 18:59:28.389465 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:28.389433    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s"]
Aug 04 18:59:28.405090 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:28.405063    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s"]
Aug 04 18:59:29.963104 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:29.963066    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baa75238-ea86-4a39-816b-576288f33163" path="/var/lib/kubelet/pods/baa75238-ea86-4a39-816b-576288f33163/volumes"
Aug 04 18:59:29.963471 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:29.963461    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb464fe4-1d82-4e11-9064-c2e2db222816" path="/var/lib/kubelet/pods/bb464fe4-1d82-4e11-9064-c2e2db222816/volumes"
Aug 04 18:59:29.963870 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:29.963856    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd51a865-dadf-4197-9793-b001a40346fa" path="/var/lib/kubelet/pods/cd51a865-dadf-4197-9793-b001a40346fa/volumes"
Aug 04 18:59:32.474989 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:32.474952    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt"]
Aug 04 18:59:32.475583 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:32.475357    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baa75238-ea86-4a39-816b-576288f33163" containerName="payload-pre-processing"
Aug 04 18:59:32.475583 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:32.475371    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="baa75238-ea86-4a39-816b-576288f33163" containerName="payload-pre-processing"
Aug 04 18:59:32.475583 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:32.475387    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb464fe4-1d82-4e11-9064-c2e2db222816" containerName="payload-processing"
Aug 04 18:59:32.475583 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:32.475393    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb464fe4-1d82-4e11-9064-c2e2db222816" containerName="payload-processing"
Aug 04 18:59:32.475583 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:32.475425    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd51a865-dadf-4197-9793-b001a40346fa" containerName="maas-api"
Aug 04 18:59:32.475583 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:32.475433    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd51a865-dadf-4197-9793-b001a40346fa" containerName="maas-api"
Aug 04 18:59:32.475583 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:32.475508    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="baa75238-ea86-4a39-816b-576288f33163" containerName="payload-pre-processing"
Aug 04 18:59:32.475583 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:32.475518    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd51a865-dadf-4197-9793-b001a40346fa" containerName="maas-api"
Aug 04 18:59:32.475583 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:32.475525    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb464fe4-1d82-4e11-9064-c2e2db222816" containerName="payload-processing"
Aug 04 18:59:32.480313 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:32.480289    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt"
Aug 04 18:59:32.483360 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:32.483342    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-43a78dca-serving-cert\""
Aug 04 18:59:32.488718 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:32.488693    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt"]
Aug 04 18:59:32.619001 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:32.618962    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj6jt\" (UniqueName: \"kubernetes.io/projected/93aaa236-b5af-421c-b72b-10ba198a3ecb-kube-api-access-mj6jt\") pod \"maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt\" (UID: \"93aaa236-b5af-421c-b72b-10ba198a3ecb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt"
Aug 04 18:59:32.619162 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:32.619021    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93aaa236-b5af-421c-b72b-10ba198a3ecb-maas-api-tls\") pod \"maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt\" (UID: \"93aaa236-b5af-421c-b72b-10ba198a3ecb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt"
Aug 04 18:59:32.619162 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:32.619047    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93aaa236-b5af-421c-b72b-10ba198a3ecb-openshift-service-ca\") pod \"maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt\" (UID: \"93aaa236-b5af-421c-b72b-10ba198a3ecb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt"
Aug 04 18:59:32.720337 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:32.720303    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj6jt\" (UniqueName: \"kubernetes.io/projected/93aaa236-b5af-421c-b72b-10ba198a3ecb-kube-api-access-mj6jt\") pod \"maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt\" (UID: \"93aaa236-b5af-421c-b72b-10ba198a3ecb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt"
Aug 04 18:59:32.720337 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:32.720353    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93aaa236-b5af-421c-b72b-10ba198a3ecb-maas-api-tls\") pod \"maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt\" (UID: \"93aaa236-b5af-421c-b72b-10ba198a3ecb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt"
Aug 04 18:59:32.720909 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:32.720380    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93aaa236-b5af-421c-b72b-10ba198a3ecb-openshift-service-ca\") pod \"maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt\" (UID: \"93aaa236-b5af-421c-b72b-10ba198a3ecb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt"
Aug 04 18:59:32.720909 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:59:32.720479    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-serving-cert: secret "maas-api-e2e-derive-43a78dca-serving-cert" not found
Aug 04 18:59:32.720909 ip-10-0-132-214 kubenswrapper[2558]: E0804 18:59:32.720550    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93aaa236-b5af-421c-b72b-10ba198a3ecb-maas-api-tls podName:93aaa236-b5af-421c-b72b-10ba198a3ecb nodeName:}" failed. No retries permitted until 2026-08-04 18:59:33.220531136 +0000 UTC m=+1893.754714212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/93aaa236-b5af-421c-b72b-10ba198a3ecb-maas-api-tls") pod "maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt" (UID: "93aaa236-b5af-421c-b72b-10ba198a3ecb") : secret "maas-api-e2e-derive-43a78dca-serving-cert" not found
Aug 04 18:59:32.721056 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:32.721034    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93aaa236-b5af-421c-b72b-10ba198a3ecb-openshift-service-ca\") pod \"maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt\" (UID: \"93aaa236-b5af-421c-b72b-10ba198a3ecb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt"
Aug 04 18:59:32.732581 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:32.732511    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj6jt\" (UniqueName: \"kubernetes.io/projected/93aaa236-b5af-421c-b72b-10ba198a3ecb-kube-api-access-mj6jt\") pod \"maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt\" (UID: \"93aaa236-b5af-421c-b72b-10ba198a3ecb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt"
Aug 04 18:59:33.226037 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:33.226006    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93aaa236-b5af-421c-b72b-10ba198a3ecb-maas-api-tls\") pod \"maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt\" (UID: \"93aaa236-b5af-421c-b72b-10ba198a3ecb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt"
Aug 04 18:59:33.228483 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:33.228444    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93aaa236-b5af-421c-b72b-10ba198a3ecb-maas-api-tls\") pod \"maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt\" (UID: \"93aaa236-b5af-421c-b72b-10ba198a3ecb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt"
Aug 04 18:59:33.272982 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:33.272951    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2"]
Aug 04 18:59:33.276564 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:33.276540    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2"
Aug 04 18:59:33.280725 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:33.280703    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-43a78dca-dockercfg-h6m6t\""
Aug 04 18:59:33.280994 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:33.280977    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-43a78dca\""
Aug 04 18:59:33.291537 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:33.291514    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2"]
Aug 04 18:59:33.392825 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:33.392796    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt"
Aug 04 18:59:33.427910 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:33.427876    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a9bb87a-476f-4b77-b5b9-5abc8a8c742c-plugins-config-volume\") pod \"payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2\" (UID: \"3a9bb87a-476f-4b77-b5b9-5abc8a8c742c\") " pod="openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2"
Aug 04 18:59:33.428075 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:33.427946    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5fk5\" (UniqueName: \"kubernetes.io/projected/3a9bb87a-476f-4b77-b5b9-5abc8a8c742c-kube-api-access-z5fk5\") pod \"payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2\" (UID: \"3a9bb87a-476f-4b77-b5b9-5abc8a8c742c\") " pod="openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2"
Aug 04 18:59:33.535037 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:33.529892    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a9bb87a-476f-4b77-b5b9-5abc8a8c742c-plugins-config-volume\") pod \"payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2\" (UID: \"3a9bb87a-476f-4b77-b5b9-5abc8a8c742c\") " pod="openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2"
Aug 04 18:59:33.535037 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:33.530004    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5fk5\" (UniqueName: \"kubernetes.io/projected/3a9bb87a-476f-4b77-b5b9-5abc8a8c742c-kube-api-access-z5fk5\") pod \"payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2\" (UID: \"3a9bb87a-476f-4b77-b5b9-5abc8a8c742c\") " pod="openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2"
Aug 04 18:59:33.535037 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:33.531231    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a9bb87a-476f-4b77-b5b9-5abc8a8c742c-plugins-config-volume\") pod \"payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2\" (UID: \"3a9bb87a-476f-4b77-b5b9-5abc8a8c742c\") " pod="openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2"
Aug 04 18:59:33.540575 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:33.540545    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt"]
Aug 04 18:59:33.541506 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:59:33.541482    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93aaa236_b5af_421c_b72b_10ba198a3ecb.slice/crio-17817c1892684e1b290e7399988a24b95cc1f56308fa89b0dcdd953b493d2891 WatchSource:0}: Error finding container 17817c1892684e1b290e7399988a24b95cc1f56308fa89b0dcdd953b493d2891: Status 404 returned error can't find the container with id 17817c1892684e1b290e7399988a24b95cc1f56308fa89b0dcdd953b493d2891
Aug 04 18:59:33.542233 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:33.542145    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5fk5\" (UniqueName: \"kubernetes.io/projected/3a9bb87a-476f-4b77-b5b9-5abc8a8c742c-kube-api-access-z5fk5\") pod \"payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2\" (UID: \"3a9bb87a-476f-4b77-b5b9-5abc8a8c742c\") " pod="openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2"
Aug 04 18:59:33.588007 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:33.587970    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2"
Aug 04 18:59:33.725725 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:33.725698    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2"]
Aug 04 18:59:33.727847 ip-10-0-132-214 kubenswrapper[2558]: W0804 18:59:33.727822    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a9bb87a_476f_4b77_b5b9_5abc8a8c742c.slice/crio-80f9e30ef2a91c52f338d04e0cb299b61ff66b28aaf33e04ac86af7993ae80b6 WatchSource:0}: Error finding container 80f9e30ef2a91c52f338d04e0cb299b61ff66b28aaf33e04ac86af7993ae80b6: Status 404 returned error can't find the container with id 80f9e30ef2a91c52f338d04e0cb299b61ff66b28aaf33e04ac86af7993ae80b6
Aug 04 18:59:34.313926 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:34.313821    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2" event={"ID":"3a9bb87a-476f-4b77-b5b9-5abc8a8c742c","Type":"ContainerStarted","Data":"affdd80ff26fd4fcc40f67c147c11cbc25efb49b279ff6dd410a7e3ba567da6a"}
Aug 04 18:59:34.313926 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:34.313883    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2" event={"ID":"3a9bb87a-476f-4b77-b5b9-5abc8a8c742c","Type":"ContainerStarted","Data":"80f9e30ef2a91c52f338d04e0cb299b61ff66b28aaf33e04ac86af7993ae80b6"}
Aug 04 18:59:34.314166 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:34.313980    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2"
Aug 04 18:59:34.315512 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:34.315481    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt" event={"ID":"93aaa236-b5af-421c-b72b-10ba198a3ecb","Type":"ContainerStarted","Data":"b5cee152b4cb8f2b97b8862ef2fc678c15f1274a97a37ea48c16aa61adce1ca1"}
Aug 04 18:59:34.315671 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:34.315528    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt" event={"ID":"93aaa236-b5af-421c-b72b-10ba198a3ecb","Type":"ContainerStarted","Data":"17817c1892684e1b290e7399988a24b95cc1f56308fa89b0dcdd953b493d2891"}
Aug 04 18:59:34.315671 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:34.315593    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt"
Aug 04 18:59:34.344945 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:34.344895    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2" podStartSLOduration=1.34487913 podStartE2EDuration="1.34487913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:59:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:59:34.341713985 +0000 UTC m=+1894.875897078" watchObservedRunningTime="2026-08-04 18:59:34.34487913 +0000 UTC m=+1894.879062196"
Aug 04 18:59:34.420580 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:34.420525    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt" podStartSLOduration=1.970137511 podStartE2EDuration="2.420509129s" totalImagesPullingTime="450.371618ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:59:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:59:34.41814128 +0000 UTC m=+1894.952324415" watchObservedRunningTime="2026-08-04 18:59:34.420509129 +0000 UTC m=+1894.954692216"
Aug 04 18:59:40.331270 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:40.331229    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt"
Aug 04 18:59:45.327410 ip-10-0-132-214 kubenswrapper[2558]: I0804 18:59:45.327376    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2"
Aug 04 19:00:03.071823 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.071787    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt"]
Aug 04 19:00:03.072627 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.072595    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt" podUID="93aaa236-b5af-421c-b72b-10ba198a3ecb" containerName="maas-api" containerID="cri-o://b5cee152b4cb8f2b97b8862ef2fc678c15f1274a97a37ea48c16aa61adce1ca1" gracePeriod=30
Aug 04 19:00:03.139773 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.139736    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2"]
Aug 04 19:00:03.140009 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.139981    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2" podUID="3a9bb87a-476f-4b77-b5b9-5abc8a8c742c" containerName="payload-processing" containerID="cri-o://affdd80ff26fd4fcc40f67c147c11cbc25efb49b279ff6dd410a7e3ba567da6a" gracePeriod=30
Aug 04 19:00:03.389497 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.389469    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt"
Aug 04 19:00:03.421454 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.421423    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2"
Aug 04 19:00:03.451540 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.451507    2558 generic.go:356] "Generic (PLEG): container finished" podID="3a9bb87a-476f-4b77-b5b9-5abc8a8c742c" containerID="affdd80ff26fd4fcc40f67c147c11cbc25efb49b279ff6dd410a7e3ba567da6a" exitCode=0
Aug 04 19:00:03.451738 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.451555    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2"
Aug 04 19:00:03.451738 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.451588    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2" event={"ID":"3a9bb87a-476f-4b77-b5b9-5abc8a8c742c","Type":"ContainerDied","Data":"affdd80ff26fd4fcc40f67c147c11cbc25efb49b279ff6dd410a7e3ba567da6a"}
Aug 04 19:00:03.451738 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.451699    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2" event={"ID":"3a9bb87a-476f-4b77-b5b9-5abc8a8c742c","Type":"ContainerDied","Data":"80f9e30ef2a91c52f338d04e0cb299b61ff66b28aaf33e04ac86af7993ae80b6"}
Aug 04 19:00:03.451738 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.451736    2558 scope.go:117] "RemoveContainer" containerID="affdd80ff26fd4fcc40f67c147c11cbc25efb49b279ff6dd410a7e3ba567da6a"
Aug 04 19:00:03.453143 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.453122    2558 generic.go:356] "Generic (PLEG): container finished" podID="93aaa236-b5af-421c-b72b-10ba198a3ecb" containerID="b5cee152b4cb8f2b97b8862ef2fc678c15f1274a97a37ea48c16aa61adce1ca1" exitCode=0
Aug 04 19:00:03.453273 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.453166    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt" event={"ID":"93aaa236-b5af-421c-b72b-10ba198a3ecb","Type":"ContainerDied","Data":"b5cee152b4cb8f2b97b8862ef2fc678c15f1274a97a37ea48c16aa61adce1ca1"}
Aug 04 19:00:03.453273 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.453188    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt"
Aug 04 19:00:03.453273 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.453202    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt" event={"ID":"93aaa236-b5af-421c-b72b-10ba198a3ecb","Type":"ContainerDied","Data":"17817c1892684e1b290e7399988a24b95cc1f56308fa89b0dcdd953b493d2891"}
Aug 04 19:00:03.461091 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.460997    2558 scope.go:117] "RemoveContainer" containerID="affdd80ff26fd4fcc40f67c147c11cbc25efb49b279ff6dd410a7e3ba567da6a"
Aug 04 19:00:03.461316 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:00:03.461298    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"affdd80ff26fd4fcc40f67c147c11cbc25efb49b279ff6dd410a7e3ba567da6a\": container with ID starting with affdd80ff26fd4fcc40f67c147c11cbc25efb49b279ff6dd410a7e3ba567da6a not found: ID does not exist" containerID="affdd80ff26fd4fcc40f67c147c11cbc25efb49b279ff6dd410a7e3ba567da6a"
Aug 04 19:00:03.461386 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.461339    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"affdd80ff26fd4fcc40f67c147c11cbc25efb49b279ff6dd410a7e3ba567da6a"} err="failed to get container status \"affdd80ff26fd4fcc40f67c147c11cbc25efb49b279ff6dd410a7e3ba567da6a\": rpc error: code = NotFound desc = could not find container \"affdd80ff26fd4fcc40f67c147c11cbc25efb49b279ff6dd410a7e3ba567da6a\": container with ID starting with affdd80ff26fd4fcc40f67c147c11cbc25efb49b279ff6dd410a7e3ba567da6a not found: ID does not exist"
Aug 04 19:00:03.461386 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.461356    2558 scope.go:117] "RemoveContainer" containerID="b5cee152b4cb8f2b97b8862ef2fc678c15f1274a97a37ea48c16aa61adce1ca1"
Aug 04 19:00:03.470379 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.470353    2558 scope.go:117] "RemoveContainer" containerID="b5cee152b4cb8f2b97b8862ef2fc678c15f1274a97a37ea48c16aa61adce1ca1"
Aug 04 19:00:03.470771 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:00:03.470627    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5cee152b4cb8f2b97b8862ef2fc678c15f1274a97a37ea48c16aa61adce1ca1\": container with ID starting with b5cee152b4cb8f2b97b8862ef2fc678c15f1274a97a37ea48c16aa61adce1ca1 not found: ID does not exist" containerID="b5cee152b4cb8f2b97b8862ef2fc678c15f1274a97a37ea48c16aa61adce1ca1"
Aug 04 19:00:03.470851 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.470782    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5cee152b4cb8f2b97b8862ef2fc678c15f1274a97a37ea48c16aa61adce1ca1"} err="failed to get container status \"b5cee152b4cb8f2b97b8862ef2fc678c15f1274a97a37ea48c16aa61adce1ca1\": rpc error: code = NotFound desc = could not find container \"b5cee152b4cb8f2b97b8862ef2fc678c15f1274a97a37ea48c16aa61adce1ca1\": container with ID starting with b5cee152b4cb8f2b97b8862ef2fc678c15f1274a97a37ea48c16aa61adce1ca1 not found: ID does not exist"
Aug 04 19:00:03.502036 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.502007    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93aaa236-b5af-421c-b72b-10ba198a3ecb-openshift-service-ca\") pod \"93aaa236-b5af-421c-b72b-10ba198a3ecb\" (UID: \"93aaa236-b5af-421c-b72b-10ba198a3ecb\") "
Aug 04 19:00:03.502211 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.502062    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a9bb87a-476f-4b77-b5b9-5abc8a8c742c-plugins-config-volume\") pod \"3a9bb87a-476f-4b77-b5b9-5abc8a8c742c\" (UID: \"3a9bb87a-476f-4b77-b5b9-5abc8a8c742c\") "
Aug 04 19:00:03.502211 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.502088    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93aaa236-b5af-421c-b72b-10ba198a3ecb-maas-api-tls\") pod \"93aaa236-b5af-421c-b72b-10ba198a3ecb\" (UID: \"93aaa236-b5af-421c-b72b-10ba198a3ecb\") "
Aug 04 19:00:03.502211 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.502129    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mj6jt\" (UniqueName: \"kubernetes.io/projected/93aaa236-b5af-421c-b72b-10ba198a3ecb-kube-api-access-mj6jt\") pod \"93aaa236-b5af-421c-b72b-10ba198a3ecb\" (UID: \"93aaa236-b5af-421c-b72b-10ba198a3ecb\") "
Aug 04 19:00:03.502211 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.502149    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5fk5\" (UniqueName: \"kubernetes.io/projected/3a9bb87a-476f-4b77-b5b9-5abc8a8c742c-kube-api-access-z5fk5\") pod \"3a9bb87a-476f-4b77-b5b9-5abc8a8c742c\" (UID: \"3a9bb87a-476f-4b77-b5b9-5abc8a8c742c\") "
Aug 04 19:00:03.502426 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.502399    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93aaa236-b5af-421c-b72b-10ba198a3ecb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "93aaa236-b5af-421c-b72b-10ba198a3ecb" (UID: "93aaa236-b5af-421c-b72b-10ba198a3ecb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:00:03.502548 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.502519    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a9bb87a-476f-4b77-b5b9-5abc8a8c742c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3a9bb87a-476f-4b77-b5b9-5abc8a8c742c" (UID: "3a9bb87a-476f-4b77-b5b9-5abc8a8c742c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:00:03.504343 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.504320    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93aaa236-b5af-421c-b72b-10ba198a3ecb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "93aaa236-b5af-421c-b72b-10ba198a3ecb" (UID: "93aaa236-b5af-421c-b72b-10ba198a3ecb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:00:03.504439 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.504363    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93aaa236-b5af-421c-b72b-10ba198a3ecb-kube-api-access-mj6jt" (OuterVolumeSpecName: "kube-api-access-mj6jt") pod "93aaa236-b5af-421c-b72b-10ba198a3ecb" (UID: "93aaa236-b5af-421c-b72b-10ba198a3ecb"). InnerVolumeSpecName "kube-api-access-mj6jt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:00:03.504439 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.504372    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a9bb87a-476f-4b77-b5b9-5abc8a8c742c-kube-api-access-z5fk5" (OuterVolumeSpecName: "kube-api-access-z5fk5") pod "3a9bb87a-476f-4b77-b5b9-5abc8a8c742c" (UID: "3a9bb87a-476f-4b77-b5b9-5abc8a8c742c"). InnerVolumeSpecName "kube-api-access-z5fk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:00:03.603158 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.603070    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93aaa236-b5af-421c-b72b-10ba198a3ecb-openshift-service-ca\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:00:03.603158 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.603099    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a9bb87a-476f-4b77-b5b9-5abc8a8c742c-plugins-config-volume\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:00:03.603158 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.603110    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93aaa236-b5af-421c-b72b-10ba198a3ecb-maas-api-tls\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:00:03.603158 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.603119    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mj6jt\" (UniqueName: \"kubernetes.io/projected/93aaa236-b5af-421c-b72b-10ba198a3ecb-kube-api-access-mj6jt\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:00:03.603158 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.603128    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5fk5\" (UniqueName: \"kubernetes.io/projected/3a9bb87a-476f-4b77-b5b9-5abc8a8c742c-kube-api-access-z5fk5\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:00:03.776342 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.776314    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2"]
Aug 04 19:00:03.779052 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.779027    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2"]
Aug 04 19:00:03.790099 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.790073    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt"]
Aug 04 19:00:03.794069 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.794046    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-43a78dca-56cc7b95c5-zx9wt"]
Aug 04 19:00:03.963725 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.963694    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a9bb87a-476f-4b77-b5b9-5abc8a8c742c" path="/var/lib/kubelet/pods/3a9bb87a-476f-4b77-b5b9-5abc8a8c742c/volumes"
Aug 04 19:00:03.964176 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:00:03.964157    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93aaa236-b5af-421c-b72b-10ba198a3ecb" path="/var/lib/kubelet/pods/93aaa236-b5af-421c-b72b-10ba198a3ecb/volumes"
Aug 04 19:02:12.037295 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:12.037256    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2"]
Aug 04 19:02:12.037901 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:12.037790    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a9bb87a-476f-4b77-b5b9-5abc8a8c742c" containerName="payload-processing"
Aug 04 19:02:12.037901 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:12.037805    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a9bb87a-476f-4b77-b5b9-5abc8a8c742c" containerName="payload-processing"
Aug 04 19:02:12.037901 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:12.037842    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93aaa236-b5af-421c-b72b-10ba198a3ecb" containerName="maas-api"
Aug 04 19:02:12.037901 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:12.037851    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="93aaa236-b5af-421c-b72b-10ba198a3ecb" containerName="maas-api"
Aug 04 19:02:12.038075 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:12.037929    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="93aaa236-b5af-421c-b72b-10ba198a3ecb" containerName="maas-api"
Aug 04 19:02:12.038075 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:12.037946    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a9bb87a-476f-4b77-b5b9-5abc8a8c742c" containerName="payload-processing"
Aug 04 19:02:12.041134 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:12.041113    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2"
Aug 04 19:02:12.043431 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:12.043396    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-2f0c212d-serving-cert\""
Aug 04 19:02:12.050568 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:12.050547    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2"]
Aug 04 19:02:12.078673 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:12.078652    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f69e5ab-e3ff-45c4-a4b0-51d620db74eb-maas-api-tls\") pod \"maas-api-e2e-mt-2f0c212d-794945b78-x7nl2\" (UID: \"4f69e5ab-e3ff-45c4-a4b0-51d620db74eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2"
Aug 04 19:02:12.078797 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:12.078693    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f69e5ab-e3ff-45c4-a4b0-51d620db74eb-openshift-service-ca\") pod \"maas-api-e2e-mt-2f0c212d-794945b78-x7nl2\" (UID: \"4f69e5ab-e3ff-45c4-a4b0-51d620db74eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2"
Aug 04 19:02:12.078863 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:12.078841    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h69tp\" (UniqueName: \"kubernetes.io/projected/4f69e5ab-e3ff-45c4-a4b0-51d620db74eb-kube-api-access-h69tp\") pod \"maas-api-e2e-mt-2f0c212d-794945b78-x7nl2\" (UID: \"4f69e5ab-e3ff-45c4-a4b0-51d620db74eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2"
Aug 04 19:02:12.179961 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:12.179932    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h69tp\" (UniqueName: \"kubernetes.io/projected/4f69e5ab-e3ff-45c4-a4b0-51d620db74eb-kube-api-access-h69tp\") pod \"maas-api-e2e-mt-2f0c212d-794945b78-x7nl2\" (UID: \"4f69e5ab-e3ff-45c4-a4b0-51d620db74eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2"
Aug 04 19:02:12.180107 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:12.179968    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f69e5ab-e3ff-45c4-a4b0-51d620db74eb-maas-api-tls\") pod \"maas-api-e2e-mt-2f0c212d-794945b78-x7nl2\" (UID: \"4f69e5ab-e3ff-45c4-a4b0-51d620db74eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2"
Aug 04 19:02:12.180107 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:12.179994    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f69e5ab-e3ff-45c4-a4b0-51d620db74eb-openshift-service-ca\") pod \"maas-api-e2e-mt-2f0c212d-794945b78-x7nl2\" (UID: \"4f69e5ab-e3ff-45c4-a4b0-51d620db74eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2"
Aug 04 19:02:12.180238 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:02:12.180097    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-serving-cert: secret "maas-api-e2e-mt-2f0c212d-serving-cert" not found
Aug 04 19:02:12.180238 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:02:12.180169    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f69e5ab-e3ff-45c4-a4b0-51d620db74eb-maas-api-tls podName:4f69e5ab-e3ff-45c4-a4b0-51d620db74eb nodeName:}" failed. No retries permitted until 2026-08-04 19:02:12.680148496 +0000 UTC m=+2053.214331566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4f69e5ab-e3ff-45c4-a4b0-51d620db74eb-maas-api-tls") pod "maas-api-e2e-mt-2f0c212d-794945b78-x7nl2" (UID: "4f69e5ab-e3ff-45c4-a4b0-51d620db74eb") : secret "maas-api-e2e-mt-2f0c212d-serving-cert" not found
Aug 04 19:02:12.180533 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:12.180517    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f69e5ab-e3ff-45c4-a4b0-51d620db74eb-openshift-service-ca\") pod \"maas-api-e2e-mt-2f0c212d-794945b78-x7nl2\" (UID: \"4f69e5ab-e3ff-45c4-a4b0-51d620db74eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2"
Aug 04 19:02:12.190157 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:12.190131    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h69tp\" (UniqueName: \"kubernetes.io/projected/4f69e5ab-e3ff-45c4-a4b0-51d620db74eb-kube-api-access-h69tp\") pod \"maas-api-e2e-mt-2f0c212d-794945b78-x7nl2\" (UID: \"4f69e5ab-e3ff-45c4-a4b0-51d620db74eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2"
Aug 04 19:02:12.685300 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:12.685264    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f69e5ab-e3ff-45c4-a4b0-51d620db74eb-maas-api-tls\") pod \"maas-api-e2e-mt-2f0c212d-794945b78-x7nl2\" (UID: \"4f69e5ab-e3ff-45c4-a4b0-51d620db74eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2"
Aug 04 19:02:12.687712 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:12.687682    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f69e5ab-e3ff-45c4-a4b0-51d620db74eb-maas-api-tls\") pod \"maas-api-e2e-mt-2f0c212d-794945b78-x7nl2\" (UID: \"4f69e5ab-e3ff-45c4-a4b0-51d620db74eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2"
Aug 04 19:02:12.953485 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:12.953400    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2"
Aug 04 19:02:13.098988 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:13.098916    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2"]
Aug 04 19:02:13.101255 ip-10-0-132-214 kubenswrapper[2558]: W0804 19:02:13.101230    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f69e5ab_e3ff_45c4_a4b0_51d620db74eb.slice/crio-c8b66ba9a6c31bb3746befa77b55284d8a449ad91bb2e5dc10502e082ca619e9 WatchSource:0}: Error finding container c8b66ba9a6c31bb3746befa77b55284d8a449ad91bb2e5dc10502e082ca619e9: Status 404 returned error can't find the container with id c8b66ba9a6c31bb3746befa77b55284d8a449ad91bb2e5dc10502e082ca619e9
Aug 04 19:02:14.039054 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:14.039021    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2" event={"ID":"4f69e5ab-e3ff-45c4-a4b0-51d620db74eb","Type":"ContainerStarted","Data":"c8b66ba9a6c31bb3746befa77b55284d8a449ad91bb2e5dc10502e082ca619e9"}
Aug 04 19:02:16.050365 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:16.050326    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2" event={"ID":"4f69e5ab-e3ff-45c4-a4b0-51d620db74eb","Type":"ContainerStarted","Data":"4eb0b444b7ac95482a6182beec9abf71a964a145f066cd7157c8acb3721382cf"}
Aug 04 19:02:16.050825 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:16.050474    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2"
Aug 04 19:02:16.073608 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:16.073557    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2" podStartSLOduration=2.138179475 podStartE2EDuration="4.073542622s" totalImagesPullingTime="1.935363147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:02:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:02:16.072914352 +0000 UTC m=+2056.607097439" watchObservedRunningTime="2026-08-04 19:02:16.073542622 +0000 UTC m=+2056.607725710"
Aug 04 19:02:22.061823 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:22.061725    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2"
Aug 04 19:02:54.418848 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:54.418816    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2"]
Aug 04 19:02:54.421421 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:54.419058    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2" podUID="4f69e5ab-e3ff-45c4-a4b0-51d620db74eb" containerName="maas-api" containerID="cri-o://4eb0b444b7ac95482a6182beec9abf71a964a145f066cd7157c8acb3721382cf" gracePeriod=30
Aug 04 19:02:54.681522 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:54.681456    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2"
Aug 04 19:02:54.773993 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:54.773963    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f69e5ab-e3ff-45c4-a4b0-51d620db74eb-openshift-service-ca\") pod \"4f69e5ab-e3ff-45c4-a4b0-51d620db74eb\" (UID: \"4f69e5ab-e3ff-45c4-a4b0-51d620db74eb\") "
Aug 04 19:02:54.774190 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:54.774044    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f69e5ab-e3ff-45c4-a4b0-51d620db74eb-maas-api-tls\") pod \"4f69e5ab-e3ff-45c4-a4b0-51d620db74eb\" (UID: \"4f69e5ab-e3ff-45c4-a4b0-51d620db74eb\") "
Aug 04 19:02:54.774190 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:54.774138    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h69tp\" (UniqueName: \"kubernetes.io/projected/4f69e5ab-e3ff-45c4-a4b0-51d620db74eb-kube-api-access-h69tp\") pod \"4f69e5ab-e3ff-45c4-a4b0-51d620db74eb\" (UID: \"4f69e5ab-e3ff-45c4-a4b0-51d620db74eb\") "
Aug 04 19:02:54.774436 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:54.774410    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f69e5ab-e3ff-45c4-a4b0-51d620db74eb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4f69e5ab-e3ff-45c4-a4b0-51d620db74eb" (UID: "4f69e5ab-e3ff-45c4-a4b0-51d620db74eb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:02:54.776179 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:54.776155    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f69e5ab-e3ff-45c4-a4b0-51d620db74eb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4f69e5ab-e3ff-45c4-a4b0-51d620db74eb" (UID: "4f69e5ab-e3ff-45c4-a4b0-51d620db74eb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:02:54.776375 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:54.776345    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f69e5ab-e3ff-45c4-a4b0-51d620db74eb-kube-api-access-h69tp" (OuterVolumeSpecName: "kube-api-access-h69tp") pod "4f69e5ab-e3ff-45c4-a4b0-51d620db74eb" (UID: "4f69e5ab-e3ff-45c4-a4b0-51d620db74eb"). InnerVolumeSpecName "kube-api-access-h69tp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:02:54.875895 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:54.875861    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f69e5ab-e3ff-45c4-a4b0-51d620db74eb-maas-api-tls\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:02:54.875895 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:54.875889    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h69tp\" (UniqueName: \"kubernetes.io/projected/4f69e5ab-e3ff-45c4-a4b0-51d620db74eb-kube-api-access-h69tp\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:02:54.875895 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:54.875901    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f69e5ab-e3ff-45c4-a4b0-51d620db74eb-openshift-service-ca\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:02:55.223888 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:55.223853    2558 generic.go:356] "Generic (PLEG): container finished" podID="4f69e5ab-e3ff-45c4-a4b0-51d620db74eb" containerID="4eb0b444b7ac95482a6182beec9abf71a964a145f066cd7157c8acb3721382cf" exitCode=0
Aug 04 19:02:55.224057 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:55.223908    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2"
Aug 04 19:02:55.224057 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:55.223937    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2" event={"ID":"4f69e5ab-e3ff-45c4-a4b0-51d620db74eb","Type":"ContainerDied","Data":"4eb0b444b7ac95482a6182beec9abf71a964a145f066cd7157c8acb3721382cf"}
Aug 04 19:02:55.224057 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:55.224010    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2" event={"ID":"4f69e5ab-e3ff-45c4-a4b0-51d620db74eb","Type":"ContainerDied","Data":"c8b66ba9a6c31bb3746befa77b55284d8a449ad91bb2e5dc10502e082ca619e9"}
Aug 04 19:02:55.224057 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:55.224032    2558 scope.go:117] "RemoveContainer" containerID="4eb0b444b7ac95482a6182beec9abf71a964a145f066cd7157c8acb3721382cf"
Aug 04 19:02:55.233277 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:55.233258    2558 scope.go:117] "RemoveContainer" containerID="4eb0b444b7ac95482a6182beec9abf71a964a145f066cd7157c8acb3721382cf"
Aug 04 19:02:55.233541 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:02:55.233522    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eb0b444b7ac95482a6182beec9abf71a964a145f066cd7157c8acb3721382cf\": container with ID starting with 4eb0b444b7ac95482a6182beec9abf71a964a145f066cd7157c8acb3721382cf not found: ID does not exist" containerID="4eb0b444b7ac95482a6182beec9abf71a964a145f066cd7157c8acb3721382cf"
Aug 04 19:02:55.233593 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:55.233549    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eb0b444b7ac95482a6182beec9abf71a964a145f066cd7157c8acb3721382cf"} err="failed to get container status \"4eb0b444b7ac95482a6182beec9abf71a964a145f066cd7157c8acb3721382cf\": rpc error: code = NotFound desc = could not find container \"4eb0b444b7ac95482a6182beec9abf71a964a145f066cd7157c8acb3721382cf\": container with ID starting with 4eb0b444b7ac95482a6182beec9abf71a964a145f066cd7157c8acb3721382cf not found: ID does not exist"
Aug 04 19:02:55.244700 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:55.244674    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2"]
Aug 04 19:02:55.249115 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:55.249095    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2f0c212d-794945b78-x7nl2"]
Aug 04 19:02:55.963272 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:02:55.963237    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f69e5ab-e3ff-45c4-a4b0-51d620db74eb" path="/var/lib/kubelet/pods/4f69e5ab-e3ff-45c4-a4b0-51d620db74eb/volumes"
Aug 04 19:05:22.675405 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:22.675278    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8"]
Aug 04 19:05:22.675867 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:22.675735    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f69e5ab-e3ff-45c4-a4b0-51d620db74eb" containerName="maas-api"
Aug 04 19:05:22.675867 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:22.675751    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f69e5ab-e3ff-45c4-a4b0-51d620db74eb" containerName="maas-api"
Aug 04 19:05:22.675867 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:22.675808    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f69e5ab-e3ff-45c4-a4b0-51d620db74eb" containerName="maas-api"
Aug 04 19:05:22.678400 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:22.678382    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8"
Aug 04 19:05:22.678891 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:22.678850    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hglfq\" (UniqueName: \"kubernetes.io/projected/2db622c3-4a3b-464e-ad03-b95bfc74494f-kube-api-access-hglfq\") pod \"maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8\" (UID: \"2db622c3-4a3b-464e-ad03-b95bfc74494f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8"
Aug 04 19:05:22.679009 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:22.678981    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2db622c3-4a3b-464e-ad03-b95bfc74494f-maas-api-tls\") pod \"maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8\" (UID: \"2db622c3-4a3b-464e-ad03-b95bfc74494f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8"
Aug 04 19:05:22.679076 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:22.679043    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2db622c3-4a3b-464e-ad03-b95bfc74494f-openshift-service-ca\") pod \"maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8\" (UID: \"2db622c3-4a3b-464e-ad03-b95bfc74494f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8"
Aug 04 19:05:22.680799 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:22.680779    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-59f3c9c8-serving-cert\""
Aug 04 19:05:22.689825 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:22.689798    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8"]
Aug 04 19:05:22.780179 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:22.780138    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2db622c3-4a3b-464e-ad03-b95bfc74494f-maas-api-tls\") pod \"maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8\" (UID: \"2db622c3-4a3b-464e-ad03-b95bfc74494f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8"
Aug 04 19:05:22.780405 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:22.780196    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2db622c3-4a3b-464e-ad03-b95bfc74494f-openshift-service-ca\") pod \"maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8\" (UID: \"2db622c3-4a3b-464e-ad03-b95bfc74494f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8"
Aug 04 19:05:22.780405 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:22.780283    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hglfq\" (UniqueName: \"kubernetes.io/projected/2db622c3-4a3b-464e-ad03-b95bfc74494f-kube-api-access-hglfq\") pod \"maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8\" (UID: \"2db622c3-4a3b-464e-ad03-b95bfc74494f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8"
Aug 04 19:05:22.780902 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:22.780877    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2db622c3-4a3b-464e-ad03-b95bfc74494f-openshift-service-ca\") pod \"maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8\" (UID: \"2db622c3-4a3b-464e-ad03-b95bfc74494f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8"
Aug 04 19:05:22.782753 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:22.782728    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2db622c3-4a3b-464e-ad03-b95bfc74494f-maas-api-tls\") pod \"maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8\" (UID: \"2db622c3-4a3b-464e-ad03-b95bfc74494f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8"
Aug 04 19:05:22.789038 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:22.789015    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hglfq\" (UniqueName: \"kubernetes.io/projected/2db622c3-4a3b-464e-ad03-b95bfc74494f-kube-api-access-hglfq\") pod \"maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8\" (UID: \"2db622c3-4a3b-464e-ad03-b95bfc74494f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8"
Aug 04 19:05:22.990883 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:22.990785    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8"
Aug 04 19:05:23.137581 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:23.137553    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8"]
Aug 04 19:05:23.140190 ip-10-0-132-214 kubenswrapper[2558]: W0804 19:05:23.140162    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2db622c3_4a3b_464e_ad03_b95bfc74494f.slice/crio-910b8fa83ed432bcde8e2ecfb5a4945d1b970eec170461fa7499489d3c6b01c7 WatchSource:0}: Error finding container 910b8fa83ed432bcde8e2ecfb5a4945d1b970eec170461fa7499489d3c6b01c7: Status 404 returned error can't find the container with id 910b8fa83ed432bcde8e2ecfb5a4945d1b970eec170461fa7499489d3c6b01c7
Aug 04 19:05:23.141690 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:23.141673    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 19:05:23.883940 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:23.883908    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8" event={"ID":"2db622c3-4a3b-464e-ad03-b95bfc74494f","Type":"ContainerStarted","Data":"155bd8d0a229f44a249a2d2d6a76a1ff1b871032f6c5c256fdd1c623741ae3e8"}
Aug 04 19:05:23.884582 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:23.883966    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8" event={"ID":"2db622c3-4a3b-464e-ad03-b95bfc74494f","Type":"ContainerStarted","Data":"910b8fa83ed432bcde8e2ecfb5a4945d1b970eec170461fa7499489d3c6b01c7"}
Aug 04 19:05:23.884582 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:23.884043    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8"
Aug 04 19:05:23.918482 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:23.918421    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8" podStartSLOduration=1.314319659 podStartE2EDuration="1.918402732s" totalImagesPullingTime="604.083073ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:05:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:05:23.917391637 +0000 UTC m=+2244.451574740" watchObservedRunningTime="2026-08-04 19:05:23.918402732 +0000 UTC m=+2244.452585859"
Aug 04 19:05:29.894776 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:05:29.894741    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8"
Aug 04 19:06:56.848294 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:06:56.848207    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8"]
Aug 04 19:06:56.848893 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:06:56.848416    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8" podUID="2db622c3-4a3b-464e-ad03-b95bfc74494f" containerName="maas-api" containerID="cri-o://155bd8d0a229f44a249a2d2d6a76a1ff1b871032f6c5c256fdd1c623741ae3e8" gracePeriod=30
Aug 04 19:06:57.102253 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:06:57.102169    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8"
Aug 04 19:06:57.146283 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:06:57.146249    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2db622c3-4a3b-464e-ad03-b95bfc74494f-maas-api-tls\") pod \"2db622c3-4a3b-464e-ad03-b95bfc74494f\" (UID: \"2db622c3-4a3b-464e-ad03-b95bfc74494f\") "
Aug 04 19:06:57.146480 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:06:57.146288    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hglfq\" (UniqueName: \"kubernetes.io/projected/2db622c3-4a3b-464e-ad03-b95bfc74494f-kube-api-access-hglfq\") pod \"2db622c3-4a3b-464e-ad03-b95bfc74494f\" (UID: \"2db622c3-4a3b-464e-ad03-b95bfc74494f\") "
Aug 04 19:06:57.146480 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:06:57.146343    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2db622c3-4a3b-464e-ad03-b95bfc74494f-openshift-service-ca\") pod \"2db622c3-4a3b-464e-ad03-b95bfc74494f\" (UID: \"2db622c3-4a3b-464e-ad03-b95bfc74494f\") "
Aug 04 19:06:57.146780 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:06:57.146751    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2db622c3-4a3b-464e-ad03-b95bfc74494f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2db622c3-4a3b-464e-ad03-b95bfc74494f" (UID: "2db622c3-4a3b-464e-ad03-b95bfc74494f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:06:57.148564 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:06:57.148531    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2db622c3-4a3b-464e-ad03-b95bfc74494f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2db622c3-4a3b-464e-ad03-b95bfc74494f" (UID: "2db622c3-4a3b-464e-ad03-b95bfc74494f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:06:57.148889 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:06:57.148864    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2db622c3-4a3b-464e-ad03-b95bfc74494f-kube-api-access-hglfq" (OuterVolumeSpecName: "kube-api-access-hglfq") pod "2db622c3-4a3b-464e-ad03-b95bfc74494f" (UID: "2db622c3-4a3b-464e-ad03-b95bfc74494f"). InnerVolumeSpecName "kube-api-access-hglfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:06:57.246984 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:06:57.246953    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2db622c3-4a3b-464e-ad03-b95bfc74494f-maas-api-tls\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:06:57.246984 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:06:57.246981    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hglfq\" (UniqueName: \"kubernetes.io/projected/2db622c3-4a3b-464e-ad03-b95bfc74494f-kube-api-access-hglfq\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:06:57.246984 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:06:57.246992    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2db622c3-4a3b-464e-ad03-b95bfc74494f-openshift-service-ca\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:06:57.307102 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:06:57.307070    2558 generic.go:356] "Generic (PLEG): container finished" podID="2db622c3-4a3b-464e-ad03-b95bfc74494f" containerID="155bd8d0a229f44a249a2d2d6a76a1ff1b871032f6c5c256fdd1c623741ae3e8" exitCode=0
Aug 04 19:06:57.307254 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:06:57.307115    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8" event={"ID":"2db622c3-4a3b-464e-ad03-b95bfc74494f","Type":"ContainerDied","Data":"155bd8d0a229f44a249a2d2d6a76a1ff1b871032f6c5c256fdd1c623741ae3e8"}
Aug 04 19:06:57.307254 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:06:57.307155    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8" event={"ID":"2db622c3-4a3b-464e-ad03-b95bfc74494f","Type":"ContainerDied","Data":"910b8fa83ed432bcde8e2ecfb5a4945d1b970eec170461fa7499489d3c6b01c7"}
Aug 04 19:06:57.307254 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:06:57.307177    2558 scope.go:117] "RemoveContainer" containerID="155bd8d0a229f44a249a2d2d6a76a1ff1b871032f6c5c256fdd1c623741ae3e8"
Aug 04 19:06:57.307254 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:06:57.307116    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8"
Aug 04 19:06:57.316235 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:06:57.316218    2558 scope.go:117] "RemoveContainer" containerID="155bd8d0a229f44a249a2d2d6a76a1ff1b871032f6c5c256fdd1c623741ae3e8"
Aug 04 19:06:57.316481 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:06:57.316461    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"155bd8d0a229f44a249a2d2d6a76a1ff1b871032f6c5c256fdd1c623741ae3e8\": container with ID starting with 155bd8d0a229f44a249a2d2d6a76a1ff1b871032f6c5c256fdd1c623741ae3e8 not found: ID does not exist" containerID="155bd8d0a229f44a249a2d2d6a76a1ff1b871032f6c5c256fdd1c623741ae3e8"
Aug 04 19:06:57.316530 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:06:57.316491    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"155bd8d0a229f44a249a2d2d6a76a1ff1b871032f6c5c256fdd1c623741ae3e8"} err="failed to get container status \"155bd8d0a229f44a249a2d2d6a76a1ff1b871032f6c5c256fdd1c623741ae3e8\": rpc error: code = NotFound desc = could not find container \"155bd8d0a229f44a249a2d2d6a76a1ff1b871032f6c5c256fdd1c623741ae3e8\": container with ID starting with 155bd8d0a229f44a249a2d2d6a76a1ff1b871032f6c5c256fdd1c623741ae3e8 not found: ID does not exist"
Aug 04 19:06:57.330262 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:06:57.330230    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8"]
Aug 04 19:06:57.334564 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:06:57.334542    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-59f3c9c8-f54858cd-mtph8"]
Aug 04 19:06:57.963698 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:06:57.963659    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2db622c3-4a3b-464e-ad03-b95bfc74494f" path="/var/lib/kubelet/pods/2db622c3-4a3b-464e-ad03-b95bfc74494f/volumes"
Aug 04 19:09:01.454257 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:01.454224    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7"]
Aug 04 19:09:01.454794 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:01.454572    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2db622c3-4a3b-464e-ad03-b95bfc74494f" containerName="maas-api"
Aug 04 19:09:01.454794 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:01.454584    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2db622c3-4a3b-464e-ad03-b95bfc74494f" containerName="maas-api"
Aug 04 19:09:01.454794 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:01.454672    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2db622c3-4a3b-464e-ad03-b95bfc74494f" containerName="maas-api"
Aug 04 19:09:01.457977 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:01.457956    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7"
Aug 04 19:09:01.461154 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:01.461129    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-91f5f5-serving-cert\""
Aug 04 19:09:01.470302 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:01.470276    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7"]
Aug 04 19:09:01.573832 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:01.573791    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b507356c-97be-49f1-80a4-9fbc8578039f-maas-api-tls\") pod \"maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7\" (UID: \"b507356c-97be-49f1-80a4-9fbc8578039f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7"
Aug 04 19:09:01.574037 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:01.573891    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqjbb\" (UniqueName: \"kubernetes.io/projected/b507356c-97be-49f1-80a4-9fbc8578039f-kube-api-access-nqjbb\") pod \"maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7\" (UID: \"b507356c-97be-49f1-80a4-9fbc8578039f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7"
Aug 04 19:09:01.574037 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:01.573921    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b507356c-97be-49f1-80a4-9fbc8578039f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7\" (UID: \"b507356c-97be-49f1-80a4-9fbc8578039f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7"
Aug 04 19:09:01.674776 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:01.674727    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b507356c-97be-49f1-80a4-9fbc8578039f-maas-api-tls\") pod \"maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7\" (UID: \"b507356c-97be-49f1-80a4-9fbc8578039f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7"
Aug 04 19:09:01.674996 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:01.674847    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqjbb\" (UniqueName: \"kubernetes.io/projected/b507356c-97be-49f1-80a4-9fbc8578039f-kube-api-access-nqjbb\") pod \"maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7\" (UID: \"b507356c-97be-49f1-80a4-9fbc8578039f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7"
Aug 04 19:09:01.674996 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:01.674880    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b507356c-97be-49f1-80a4-9fbc8578039f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7\" (UID: \"b507356c-97be-49f1-80a4-9fbc8578039f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7"
Aug 04 19:09:01.674996 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:09:01.674903    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-serving-cert: secret "maas-api-e2e-inf-a-91f5f5-serving-cert" not found
Aug 04 19:09:01.675165 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:09:01.674987    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b507356c-97be-49f1-80a4-9fbc8578039f-maas-api-tls podName:b507356c-97be-49f1-80a4-9fbc8578039f nodeName:}" failed. No retries permitted until 2026-08-04 19:09:02.174966022 +0000 UTC m=+2462.709149089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b507356c-97be-49f1-80a4-9fbc8578039f-maas-api-tls") pod "maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7" (UID: "b507356c-97be-49f1-80a4-9fbc8578039f") : secret "maas-api-e2e-inf-a-91f5f5-serving-cert" not found
Aug 04 19:09:01.675652 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:01.675616    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b507356c-97be-49f1-80a4-9fbc8578039f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7\" (UID: \"b507356c-97be-49f1-80a4-9fbc8578039f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7"
Aug 04 19:09:01.684214 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:01.684183    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqjbb\" (UniqueName: \"kubernetes.io/projected/b507356c-97be-49f1-80a4-9fbc8578039f-kube-api-access-nqjbb\") pod \"maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7\" (UID: \"b507356c-97be-49f1-80a4-9fbc8578039f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7"
Aug 04 19:09:02.179203 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:02.179171    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b507356c-97be-49f1-80a4-9fbc8578039f-maas-api-tls\") pod \"maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7\" (UID: \"b507356c-97be-49f1-80a4-9fbc8578039f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7"
Aug 04 19:09:02.181713 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:02.181683    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b507356c-97be-49f1-80a4-9fbc8578039f-maas-api-tls\") pod \"maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7\" (UID: \"b507356c-97be-49f1-80a4-9fbc8578039f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7"
Aug 04 19:09:02.369168 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:02.369129    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7"
Aug 04 19:09:02.536881 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:02.536850    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7"]
Aug 04 19:09:02.876199 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:02.876109    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7" event={"ID":"b507356c-97be-49f1-80a4-9fbc8578039f","Type":"ContainerStarted","Data":"603f5f836a9ac71d6207bfbc386860c8cfcc619cf0ed9302b42ed27790b96ac3"}
Aug 04 19:09:04.886802 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:04.886764    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7" event={"ID":"b507356c-97be-49f1-80a4-9fbc8578039f","Type":"ContainerStarted","Data":"14c47f12bfa0a63a3f1f7812d0b3643c628c642f16b795062e3901dd4000e21d"}
Aug 04 19:09:04.887210 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:04.886888    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7"
Aug 04 19:09:04.904910 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:04.904856    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7" podStartSLOduration=1.909080231 podStartE2EDuration="3.904838373s" totalImagesPullingTime="1.995758142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:09:04.903675083 +0000 UTC m=+2465.437858172" watchObservedRunningTime="2026-08-04 19:09:04.904838373 +0000 UTC m=+2465.439021462"
Aug 04 19:09:10.898740 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:10.898709    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7"
Aug 04 19:09:29.939404 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:29.939371    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z"]
Aug 04 19:09:29.943349 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:29.943323    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z"
Aug 04 19:09:29.945751 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:29.945725    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-77907c-serving-cert\""
Aug 04 19:09:29.965449 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:29.965419    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z"]
Aug 04 19:09:30.120512 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:30.120474    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41215eaa-4c4a-46d9-bba8-4e8d1d019be1-openshift-service-ca\") pod \"maas-api-e2e-inf-b-77907c-587c84f98-w8j5z\" (UID: \"41215eaa-4c4a-46d9-bba8-4e8d1d019be1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z"
Aug 04 19:09:30.120715 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:30.120536    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41215eaa-4c4a-46d9-bba8-4e8d1d019be1-maas-api-tls\") pod \"maas-api-e2e-inf-b-77907c-587c84f98-w8j5z\" (UID: \"41215eaa-4c4a-46d9-bba8-4e8d1d019be1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z"
Aug 04 19:09:30.120715 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:30.120686    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mzcg\" (UniqueName: \"kubernetes.io/projected/41215eaa-4c4a-46d9-bba8-4e8d1d019be1-kube-api-access-2mzcg\") pod \"maas-api-e2e-inf-b-77907c-587c84f98-w8j5z\" (UID: \"41215eaa-4c4a-46d9-bba8-4e8d1d019be1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z"
Aug 04 19:09:30.221200 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:30.221112    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41215eaa-4c4a-46d9-bba8-4e8d1d019be1-maas-api-tls\") pod \"maas-api-e2e-inf-b-77907c-587c84f98-w8j5z\" (UID: \"41215eaa-4c4a-46d9-bba8-4e8d1d019be1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z"
Aug 04 19:09:30.221358 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:30.221211    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mzcg\" (UniqueName: \"kubernetes.io/projected/41215eaa-4c4a-46d9-bba8-4e8d1d019be1-kube-api-access-2mzcg\") pod \"maas-api-e2e-inf-b-77907c-587c84f98-w8j5z\" (UID: \"41215eaa-4c4a-46d9-bba8-4e8d1d019be1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z"
Aug 04 19:09:30.221358 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:30.221243    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41215eaa-4c4a-46d9-bba8-4e8d1d019be1-openshift-service-ca\") pod \"maas-api-e2e-inf-b-77907c-587c84f98-w8j5z\" (UID: \"41215eaa-4c4a-46d9-bba8-4e8d1d019be1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z"
Aug 04 19:09:30.221961 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:30.221941    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41215eaa-4c4a-46d9-bba8-4e8d1d019be1-openshift-service-ca\") pod \"maas-api-e2e-inf-b-77907c-587c84f98-w8j5z\" (UID: \"41215eaa-4c4a-46d9-bba8-4e8d1d019be1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z"
Aug 04 19:09:30.223681 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:30.223657    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41215eaa-4c4a-46d9-bba8-4e8d1d019be1-maas-api-tls\") pod \"maas-api-e2e-inf-b-77907c-587c84f98-w8j5z\" (UID: \"41215eaa-4c4a-46d9-bba8-4e8d1d019be1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z"
Aug 04 19:09:30.232060 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:30.232031    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mzcg\" (UniqueName: \"kubernetes.io/projected/41215eaa-4c4a-46d9-bba8-4e8d1d019be1-kube-api-access-2mzcg\") pod \"maas-api-e2e-inf-b-77907c-587c84f98-w8j5z\" (UID: \"41215eaa-4c4a-46d9-bba8-4e8d1d019be1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z"
Aug 04 19:09:30.253886 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:30.253850    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z"
Aug 04 19:09:30.402510 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:30.402476    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z"]
Aug 04 19:09:30.405872 ip-10-0-132-214 kubenswrapper[2558]: W0804 19:09:30.405842    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41215eaa_4c4a_46d9_bba8_4e8d1d019be1.slice/crio-0cea003a68fc69b118f26f956be87c16d1971f1b1cdd334e58e668310fc73d65 WatchSource:0}: Error finding container 0cea003a68fc69b118f26f956be87c16d1971f1b1cdd334e58e668310fc73d65: Status 404 returned error can't find the container with id 0cea003a68fc69b118f26f956be87c16d1971f1b1cdd334e58e668310fc73d65
Aug 04 19:09:30.984592 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:30.984561    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v"]
Aug 04 19:09:30.993231 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:30.993193    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v"
Aug 04 19:09:30.996559 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:30.996522    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-77907c-dockercfg-429px\""
Aug 04 19:09:30.996759 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:30.996572    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-77907c\""
Aug 04 19:09:31.013191 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.013156    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z" event={"ID":"41215eaa-4c4a-46d9-bba8-4e8d1d019be1","Type":"ContainerStarted","Data":"298a582880e0ea1b17e537e6a1a97ce94db7a0e97706f9f4ca1acdde695b2b7c"}
Aug 04 19:09:31.013366 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.013208    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z" event={"ID":"41215eaa-4c4a-46d9-bba8-4e8d1d019be1","Type":"ContainerStarted","Data":"0cea003a68fc69b118f26f956be87c16d1971f1b1cdd334e58e668310fc73d65"}
Aug 04 19:09:31.013366 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.013312    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z"
Aug 04 19:09:31.014093 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.014067    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v"]
Aug 04 19:09:31.039914 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.039872    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7"]
Aug 04 19:09:31.044283 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.044257    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7"
Aug 04 19:09:31.054900 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.054861    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7"]
Aug 04 19:09:31.059361 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.059296    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z" podStartSLOduration=1.655986972 podStartE2EDuration="2.059275564s" totalImagesPullingTime="403.288592ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:09:31.056935096 +0000 UTC m=+2491.591118200" watchObservedRunningTime="2026-08-04 19:09:31.059275564 +0000 UTC m=+2491.593458653"
Aug 04 19:09:31.128308 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.128212    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd2tr\" (UniqueName: \"kubernetes.io/projected/48837475-5d4d-4603-8e9f-24a769881dfe-kube-api-access-dd2tr\") pod \"payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v\" (UID: \"48837475-5d4d-4603-8e9f-24a769881dfe\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v"
Aug 04 19:09:31.128308 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.128293    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48837475-5d4d-4603-8e9f-24a769881dfe-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v\" (UID: \"48837475-5d4d-4603-8e9f-24a769881dfe\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v"
Aug 04 19:09:31.128559 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.128340    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7\" (UID: \"3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa\") " pod="openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7"
Aug 04 19:09:31.128559 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.128480    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztzkx\" (UniqueName: \"kubernetes.io/projected/3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa-kube-api-access-ztzkx\") pod \"payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7\" (UID: \"3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa\") " pod="openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7"
Aug 04 19:09:31.229228 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.229193    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztzkx\" (UniqueName: \"kubernetes.io/projected/3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa-kube-api-access-ztzkx\") pod \"payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7\" (UID: \"3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa\") " pod="openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7"
Aug 04 19:09:31.229419 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.229258    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd2tr\" (UniqueName: \"kubernetes.io/projected/48837475-5d4d-4603-8e9f-24a769881dfe-kube-api-access-dd2tr\") pod \"payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v\" (UID: \"48837475-5d4d-4603-8e9f-24a769881dfe\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v"
Aug 04 19:09:31.229419 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.229299    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48837475-5d4d-4603-8e9f-24a769881dfe-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v\" (UID: \"48837475-5d4d-4603-8e9f-24a769881dfe\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v"
Aug 04 19:09:31.229419 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.229328    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7\" (UID: \"3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa\") " pod="openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7"
Aug 04 19:09:31.230265 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.230236    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7\" (UID: \"3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa\") " pod="openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7"
Aug 04 19:09:31.230369 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.230265    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48837475-5d4d-4603-8e9f-24a769881dfe-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v\" (UID: \"48837475-5d4d-4603-8e9f-24a769881dfe\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v"
Aug 04 19:09:31.258577 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.258536    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd2tr\" (UniqueName: \"kubernetes.io/projected/48837475-5d4d-4603-8e9f-24a769881dfe-kube-api-access-dd2tr\") pod \"payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v\" (UID: \"48837475-5d4d-4603-8e9f-24a769881dfe\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v"
Aug 04 19:09:31.258577 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.258576    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztzkx\" (UniqueName: \"kubernetes.io/projected/3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa-kube-api-access-ztzkx\") pod \"payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7\" (UID: \"3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa\") " pod="openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7"
Aug 04 19:09:31.303448 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.303412    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v"
Aug 04 19:09:31.359234 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.358967    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7"
Aug 04 19:09:31.466656 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.466601    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v"]
Aug 04 19:09:31.468865 ip-10-0-132-214 kubenswrapper[2558]: W0804 19:09:31.468837    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48837475_5d4d_4603_8e9f_24a769881dfe.slice/crio-ae8f3824b66d255fd419daf6cdcf2e3d3e365eaf9ba9804b1cd95abadd760cca WatchSource:0}: Error finding container ae8f3824b66d255fd419daf6cdcf2e3d3e365eaf9ba9804b1cd95abadd760cca: Status 404 returned error can't find the container with id ae8f3824b66d255fd419daf6cdcf2e3d3e365eaf9ba9804b1cd95abadd760cca
Aug 04 19:09:31.527198 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:31.527168    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7"]
Aug 04 19:09:31.528757 ip-10-0-132-214 kubenswrapper[2558]: W0804 19:09:31.528726    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eb8ea30_56c8_4c11_ba7e_e0876d02dbaa.slice/crio-82550e382a3dfad95e7b3335f1eebc244d5e3ced3ab9dfad8927e569b1b2e786 WatchSource:0}: Error finding container 82550e382a3dfad95e7b3335f1eebc244d5e3ced3ab9dfad8927e569b1b2e786: Status 404 returned error can't find the container with id 82550e382a3dfad95e7b3335f1eebc244d5e3ced3ab9dfad8927e569b1b2e786
Aug 04 19:09:32.019765 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:32.019727    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7" event={"ID":"3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa","Type":"ContainerStarted","Data":"9cb39f6a803780a7e7174f769758c9738101c78b8ea7ea67267c61f22b385211"}
Aug 04 19:09:32.020224 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:32.019790    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7" event={"ID":"3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa","Type":"ContainerStarted","Data":"82550e382a3dfad95e7b3335f1eebc244d5e3ced3ab9dfad8927e569b1b2e786"}
Aug 04 19:09:32.020224 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:32.019889    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7"
Aug 04 19:09:32.021430 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:32.021406    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v" event={"ID":"48837475-5d4d-4603-8e9f-24a769881dfe","Type":"ContainerStarted","Data":"2ff6ba869e114c3d23dcd9de251674171db827d1331f4ed2815912f34929c641"}
Aug 04 19:09:32.021532 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:32.021449    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v"
Aug 04 19:09:32.021532 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:32.021473    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v" event={"ID":"48837475-5d4d-4603-8e9f-24a769881dfe","Type":"ContainerStarted","Data":"ae8f3824b66d255fd419daf6cdcf2e3d3e365eaf9ba9804b1cd95abadd760cca"}
Aug 04 19:09:32.039212 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:32.039164    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7" podStartSLOduration=1.039150307 podStartE2EDuration="1.039150307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:09:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:09:32.038847465 +0000 UTC m=+2492.573030555" watchObservedRunningTime="2026-08-04 19:09:32.039150307 +0000 UTC m=+2492.573333399"
Aug 04 19:09:32.060702 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:32.060650    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v" podStartSLOduration=2.060612718 podStartE2EDuration="2.060612718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:09:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:09:32.059295466 +0000 UTC m=+2492.593478555" watchObservedRunningTime="2026-08-04 19:09:32.060612718 +0000 UTC m=+2492.594795805"
Aug 04 19:09:37.027227 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:37.027196    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z"
Aug 04 19:09:43.028755 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:43.028711    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7"
Aug 04 19:09:43.029194 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:09:43.028892    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v"
Aug 04 19:11:25.289224 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:25.289134    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7"]
Aug 04 19:11:25.289706 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:25.289406    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7" podUID="b507356c-97be-49f1-80a4-9fbc8578039f" containerName="maas-api" containerID="cri-o://14c47f12bfa0a63a3f1f7812d0b3643c628c642f16b795062e3901dd4000e21d" gracePeriod=30
Aug 04 19:11:25.541492 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:25.541410    2558 generic.go:356] "Generic (PLEG): container finished" podID="b507356c-97be-49f1-80a4-9fbc8578039f" containerID="14c47f12bfa0a63a3f1f7812d0b3643c628c642f16b795062e3901dd4000e21d" exitCode=0
Aug 04 19:11:25.541702 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:25.541485    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7" event={"ID":"b507356c-97be-49f1-80a4-9fbc8578039f","Type":"ContainerDied","Data":"14c47f12bfa0a63a3f1f7812d0b3643c628c642f16b795062e3901dd4000e21d"}
Aug 04 19:11:25.541702 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:25.541553    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7" event={"ID":"b507356c-97be-49f1-80a4-9fbc8578039f","Type":"ContainerDied","Data":"603f5f836a9ac71d6207bfbc386860c8cfcc619cf0ed9302b42ed27790b96ac3"}
Aug 04 19:11:25.541702 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:25.541581    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="603f5f836a9ac71d6207bfbc386860c8cfcc619cf0ed9302b42ed27790b96ac3"
Aug 04 19:11:25.547379 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:25.547357    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7"
Aug 04 19:11:25.647291 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:25.647258    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b507356c-97be-49f1-80a4-9fbc8578039f-openshift-service-ca\") pod \"b507356c-97be-49f1-80a4-9fbc8578039f\" (UID: \"b507356c-97be-49f1-80a4-9fbc8578039f\") "
Aug 04 19:11:25.647468 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:25.647314    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqjbb\" (UniqueName: \"kubernetes.io/projected/b507356c-97be-49f1-80a4-9fbc8578039f-kube-api-access-nqjbb\") pod \"b507356c-97be-49f1-80a4-9fbc8578039f\" (UID: \"b507356c-97be-49f1-80a4-9fbc8578039f\") "
Aug 04 19:11:25.647468 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:25.647395    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b507356c-97be-49f1-80a4-9fbc8578039f-maas-api-tls\") pod \"b507356c-97be-49f1-80a4-9fbc8578039f\" (UID: \"b507356c-97be-49f1-80a4-9fbc8578039f\") "
Aug 04 19:11:25.647660 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:25.647612    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b507356c-97be-49f1-80a4-9fbc8578039f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b507356c-97be-49f1-80a4-9fbc8578039f" (UID: "b507356c-97be-49f1-80a4-9fbc8578039f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:11:25.647737 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:25.647720    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b507356c-97be-49f1-80a4-9fbc8578039f-openshift-service-ca\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:11:25.649479 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:25.649448    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b507356c-97be-49f1-80a4-9fbc8578039f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b507356c-97be-49f1-80a4-9fbc8578039f" (UID: "b507356c-97be-49f1-80a4-9fbc8578039f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:11:25.649595 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:25.649510    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b507356c-97be-49f1-80a4-9fbc8578039f-kube-api-access-nqjbb" (OuterVolumeSpecName: "kube-api-access-nqjbb") pod "b507356c-97be-49f1-80a4-9fbc8578039f" (UID: "b507356c-97be-49f1-80a4-9fbc8578039f"). InnerVolumeSpecName "kube-api-access-nqjbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:11:25.749069 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:25.749034    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqjbb\" (UniqueName: \"kubernetes.io/projected/b507356c-97be-49f1-80a4-9fbc8578039f-kube-api-access-nqjbb\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:11:25.749069 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:25.749063    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b507356c-97be-49f1-80a4-9fbc8578039f-maas-api-tls\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:11:26.546967 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:26.546932    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7"
Aug 04 19:11:26.563071 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:26.563039    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7"]
Aug 04 19:11:26.567518 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:26.567492    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-91f5f5-6fbd6fc5c8-5tpb7"]
Aug 04 19:11:27.964213 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:27.964171    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b507356c-97be-49f1-80a4-9fbc8578039f" path="/var/lib/kubelet/pods/b507356c-97be-49f1-80a4-9fbc8578039f/volumes"
Aug 04 19:11:37.698265 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:37.698229    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z"]
Aug 04 19:11:37.698754 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:37.698532    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z" podUID="41215eaa-4c4a-46d9-bba8-4e8d1d019be1" containerName="maas-api" containerID="cri-o://298a582880e0ea1b17e537e6a1a97ce94db7a0e97706f9f4ca1acdde695b2b7c" gracePeriod=30
Aug 04 19:11:37.770795 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:37.770759    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7"]
Aug 04 19:11:37.771045 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:37.771012    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7" podUID="3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa" containerName="payload-processing" containerID="cri-o://9cb39f6a803780a7e7174f769758c9738101c78b8ea7ea67267c61f22b385211" gracePeriod=30
Aug 04 19:11:37.779728 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:37.779696    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v"]
Aug 04 19:11:37.780459 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:37.780273    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v" podUID="48837475-5d4d-4603-8e9f-24a769881dfe" containerName="payload-pre-processing" containerID="cri-o://2ff6ba869e114c3d23dcd9de251674171db827d1331f4ed2815912f34929c641" gracePeriod=30
Aug 04 19:11:38.045167 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.045134    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z"
Aug 04 19:11:38.064405 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.064374    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7"
Aug 04 19:11:38.101336 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.101300    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v"
Aug 04 19:11:38.169142 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.169105    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa-plugins-config-volume\") pod \"3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa\" (UID: \"3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa\") "
Aug 04 19:11:38.169341 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.169176    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48837475-5d4d-4603-8e9f-24a769881dfe-plugins-config-volume\") pod \"48837475-5d4d-4603-8e9f-24a769881dfe\" (UID: \"48837475-5d4d-4603-8e9f-24a769881dfe\") "
Aug 04 19:11:38.169341 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.169212    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dd2tr\" (UniqueName: \"kubernetes.io/projected/48837475-5d4d-4603-8e9f-24a769881dfe-kube-api-access-dd2tr\") pod \"48837475-5d4d-4603-8e9f-24a769881dfe\" (UID: \"48837475-5d4d-4603-8e9f-24a769881dfe\") "
Aug 04 19:11:38.169341 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.169262    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztzkx\" (UniqueName: \"kubernetes.io/projected/3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa-kube-api-access-ztzkx\") pod \"3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa\" (UID: \"3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa\") "
Aug 04 19:11:38.169341 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.169306    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41215eaa-4c4a-46d9-bba8-4e8d1d019be1-openshift-service-ca\") pod \"41215eaa-4c4a-46d9-bba8-4e8d1d019be1\" (UID: \"41215eaa-4c4a-46d9-bba8-4e8d1d019be1\") "
Aug 04 19:11:38.169341 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.169333    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mzcg\" (UniqueName: \"kubernetes.io/projected/41215eaa-4c4a-46d9-bba8-4e8d1d019be1-kube-api-access-2mzcg\") pod \"41215eaa-4c4a-46d9-bba8-4e8d1d019be1\" (UID: \"41215eaa-4c4a-46d9-bba8-4e8d1d019be1\") "
Aug 04 19:11:38.169610 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.169370    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41215eaa-4c4a-46d9-bba8-4e8d1d019be1-maas-api-tls\") pod \"41215eaa-4c4a-46d9-bba8-4e8d1d019be1\" (UID: \"41215eaa-4c4a-46d9-bba8-4e8d1d019be1\") "
Aug 04 19:11:38.169610 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.169578    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa" (UID: "3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:11:38.169763 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.169651    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48837475-5d4d-4603-8e9f-24a769881dfe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "48837475-5d4d-4603-8e9f-24a769881dfe" (UID: "48837475-5d4d-4603-8e9f-24a769881dfe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:11:38.169763 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.169742    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41215eaa-4c4a-46d9-bba8-4e8d1d019be1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "41215eaa-4c4a-46d9-bba8-4e8d1d019be1" (UID: "41215eaa-4c4a-46d9-bba8-4e8d1d019be1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:11:38.169864 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.169775    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa-plugins-config-volume\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:11:38.169864 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.169795    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48837475-5d4d-4603-8e9f-24a769881dfe-plugins-config-volume\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:11:38.171528 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.171503    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa-kube-api-access-ztzkx" (OuterVolumeSpecName: "kube-api-access-ztzkx") pod "3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa" (UID: "3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa"). InnerVolumeSpecName "kube-api-access-ztzkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:11:38.171652 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.171546    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41215eaa-4c4a-46d9-bba8-4e8d1d019be1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "41215eaa-4c4a-46d9-bba8-4e8d1d019be1" (UID: "41215eaa-4c4a-46d9-bba8-4e8d1d019be1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:11:38.171652 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.171560    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48837475-5d4d-4603-8e9f-24a769881dfe-kube-api-access-dd2tr" (OuterVolumeSpecName: "kube-api-access-dd2tr") pod "48837475-5d4d-4603-8e9f-24a769881dfe" (UID: "48837475-5d4d-4603-8e9f-24a769881dfe"). InnerVolumeSpecName "kube-api-access-dd2tr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:11:38.171652 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.171546    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41215eaa-4c4a-46d9-bba8-4e8d1d019be1-kube-api-access-2mzcg" (OuterVolumeSpecName: "kube-api-access-2mzcg") pod "41215eaa-4c4a-46d9-bba8-4e8d1d019be1" (UID: "41215eaa-4c4a-46d9-bba8-4e8d1d019be1"). InnerVolumeSpecName "kube-api-access-2mzcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:11:38.271140 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.271046    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dd2tr\" (UniqueName: \"kubernetes.io/projected/48837475-5d4d-4603-8e9f-24a769881dfe-kube-api-access-dd2tr\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:11:38.271140 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.271081    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztzkx\" (UniqueName: \"kubernetes.io/projected/3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa-kube-api-access-ztzkx\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:11:38.271140 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.271092    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41215eaa-4c4a-46d9-bba8-4e8d1d019be1-openshift-service-ca\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:11:38.271140 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.271100    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mzcg\" (UniqueName: \"kubernetes.io/projected/41215eaa-4c4a-46d9-bba8-4e8d1d019be1-kube-api-access-2mzcg\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:11:38.271140 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.271111    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41215eaa-4c4a-46d9-bba8-4e8d1d019be1-maas-api-tls\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:11:38.601378 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.601292    2558 generic.go:356] "Generic (PLEG): container finished" podID="48837475-5d4d-4603-8e9f-24a769881dfe" containerID="2ff6ba869e114c3d23dcd9de251674171db827d1331f4ed2815912f34929c641" exitCode=0
Aug 04 19:11:38.601378 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.601337    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v"
Aug 04 19:11:38.601604 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.601373    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v" event={"ID":"48837475-5d4d-4603-8e9f-24a769881dfe","Type":"ContainerDied","Data":"2ff6ba869e114c3d23dcd9de251674171db827d1331f4ed2815912f34929c641"}
Aug 04 19:11:38.601604 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.601422    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v" event={"ID":"48837475-5d4d-4603-8e9f-24a769881dfe","Type":"ContainerDied","Data":"ae8f3824b66d255fd419daf6cdcf2e3d3e365eaf9ba9804b1cd95abadd760cca"}
Aug 04 19:11:38.601604 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.601444    2558 scope.go:117] "RemoveContainer" containerID="2ff6ba869e114c3d23dcd9de251674171db827d1331f4ed2815912f34929c641"
Aug 04 19:11:38.602760 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.602731    2558 generic.go:356] "Generic (PLEG): container finished" podID="41215eaa-4c4a-46d9-bba8-4e8d1d019be1" containerID="298a582880e0ea1b17e537e6a1a97ce94db7a0e97706f9f4ca1acdde695b2b7c" exitCode=0
Aug 04 19:11:38.602876 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.602757    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z" event={"ID":"41215eaa-4c4a-46d9-bba8-4e8d1d019be1","Type":"ContainerDied","Data":"298a582880e0ea1b17e537e6a1a97ce94db7a0e97706f9f4ca1acdde695b2b7c"}
Aug 04 19:11:38.602876 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.602784    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z"
Aug 04 19:11:38.602876 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.602815    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z" event={"ID":"41215eaa-4c4a-46d9-bba8-4e8d1d019be1","Type":"ContainerDied","Data":"0cea003a68fc69b118f26f956be87c16d1971f1b1cdd334e58e668310fc73d65"}
Aug 04 19:11:38.604153 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.604132    2558 generic.go:356] "Generic (PLEG): container finished" podID="3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa" containerID="9cb39f6a803780a7e7174f769758c9738101c78b8ea7ea67267c61f22b385211" exitCode=0
Aug 04 19:11:38.604279 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.604174    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7" event={"ID":"3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa","Type":"ContainerDied","Data":"9cb39f6a803780a7e7174f769758c9738101c78b8ea7ea67267c61f22b385211"}
Aug 04 19:11:38.604279 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.604177    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7"
Aug 04 19:11:38.604279 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.604212    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7" event={"ID":"3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa","Type":"ContainerDied","Data":"82550e382a3dfad95e7b3335f1eebc244d5e3ced3ab9dfad8927e569b1b2e786"}
Aug 04 19:11:38.613051 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.613033    2558 scope.go:117] "RemoveContainer" containerID="2ff6ba869e114c3d23dcd9de251674171db827d1331f4ed2815912f34929c641"
Aug 04 19:11:38.613366 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:11:38.613342    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ff6ba869e114c3d23dcd9de251674171db827d1331f4ed2815912f34929c641\": container with ID starting with 2ff6ba869e114c3d23dcd9de251674171db827d1331f4ed2815912f34929c641 not found: ID does not exist" containerID="2ff6ba869e114c3d23dcd9de251674171db827d1331f4ed2815912f34929c641"
Aug 04 19:11:38.613434 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.613378    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ff6ba869e114c3d23dcd9de251674171db827d1331f4ed2815912f34929c641"} err="failed to get container status \"2ff6ba869e114c3d23dcd9de251674171db827d1331f4ed2815912f34929c641\": rpc error: code = NotFound desc = could not find container \"2ff6ba869e114c3d23dcd9de251674171db827d1331f4ed2815912f34929c641\": container with ID starting with 2ff6ba869e114c3d23dcd9de251674171db827d1331f4ed2815912f34929c641 not found: ID does not exist"
Aug 04 19:11:38.613434 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.613400    2558 scope.go:117] "RemoveContainer" containerID="298a582880e0ea1b17e537e6a1a97ce94db7a0e97706f9f4ca1acdde695b2b7c"
Aug 04 19:11:38.621675 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.621657    2558 scope.go:117] "RemoveContainer" containerID="298a582880e0ea1b17e537e6a1a97ce94db7a0e97706f9f4ca1acdde695b2b7c"
Aug 04 19:11:38.621955 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:11:38.621928    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"298a582880e0ea1b17e537e6a1a97ce94db7a0e97706f9f4ca1acdde695b2b7c\": container with ID starting with 298a582880e0ea1b17e537e6a1a97ce94db7a0e97706f9f4ca1acdde695b2b7c not found: ID does not exist" containerID="298a582880e0ea1b17e537e6a1a97ce94db7a0e97706f9f4ca1acdde695b2b7c"
Aug 04 19:11:38.622036 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.621971    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"298a582880e0ea1b17e537e6a1a97ce94db7a0e97706f9f4ca1acdde695b2b7c"} err="failed to get container status \"298a582880e0ea1b17e537e6a1a97ce94db7a0e97706f9f4ca1acdde695b2b7c\": rpc error: code = NotFound desc = could not find container \"298a582880e0ea1b17e537e6a1a97ce94db7a0e97706f9f4ca1acdde695b2b7c\": container with ID starting with 298a582880e0ea1b17e537e6a1a97ce94db7a0e97706f9f4ca1acdde695b2b7c not found: ID does not exist"
Aug 04 19:11:38.622036 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.621993    2558 scope.go:117] "RemoveContainer" containerID="9cb39f6a803780a7e7174f769758c9738101c78b8ea7ea67267c61f22b385211"
Aug 04 19:11:38.624601 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.624580    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v"]
Aug 04 19:11:38.629296 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.629276    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v"]
Aug 04 19:11:38.630339 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.630323    2558 scope.go:117] "RemoveContainer" containerID="9cb39f6a803780a7e7174f769758c9738101c78b8ea7ea67267c61f22b385211"
Aug 04 19:11:38.630572 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:11:38.630554    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cb39f6a803780a7e7174f769758c9738101c78b8ea7ea67267c61f22b385211\": container with ID starting with 9cb39f6a803780a7e7174f769758c9738101c78b8ea7ea67267c61f22b385211 not found: ID does not exist" containerID="9cb39f6a803780a7e7174f769758c9738101c78b8ea7ea67267c61f22b385211"
Aug 04 19:11:38.630623 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.630578    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cb39f6a803780a7e7174f769758c9738101c78b8ea7ea67267c61f22b385211"} err="failed to get container status \"9cb39f6a803780a7e7174f769758c9738101c78b8ea7ea67267c61f22b385211\": rpc error: code = NotFound desc = could not find container \"9cb39f6a803780a7e7174f769758c9738101c78b8ea7ea67267c61f22b385211\": container with ID starting with 9cb39f6a803780a7e7174f769758c9738101c78b8ea7ea67267c61f22b385211 not found: ID does not exist"
Aug 04 19:11:38.638666 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.638624    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7"]
Aug 04 19:11:38.642868 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.642847    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7"]
Aug 04 19:11:38.653702 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.653671    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z"]
Aug 04 19:11:38.659912 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:38.659888    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-77907c-587c84f98-w8j5z"]
Aug 04 19:11:39.964778 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:39.964746    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa" path="/var/lib/kubelet/pods/3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa/volumes"
Aug 04 19:11:39.965159 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:39.965152    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41215eaa-4c4a-46d9-bba8-4e8d1d019be1" path="/var/lib/kubelet/pods/41215eaa-4c4a-46d9-bba8-4e8d1d019be1/volumes"
Aug 04 19:11:39.965464 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:39.965450    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48837475-5d4d-4603-8e9f-24a769881dfe" path="/var/lib/kubelet/pods/48837475-5d4d-4603-8e9f-24a769881dfe/volumes"
Aug 04 19:11:49.941449 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:49.941412    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v"]
Aug 04 19:11:49.941962 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:49.941947    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b507356c-97be-49f1-80a4-9fbc8578039f" containerName="maas-api"
Aug 04 19:11:49.942037 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:49.941967    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b507356c-97be-49f1-80a4-9fbc8578039f" containerName="maas-api"
Aug 04 19:11:49.942037 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:49.941991    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48837475-5d4d-4603-8e9f-24a769881dfe" containerName="payload-pre-processing"
Aug 04 19:11:49.942037 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:49.942000    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="48837475-5d4d-4603-8e9f-24a769881dfe" containerName="payload-pre-processing"
Aug 04 19:11:49.942037 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:49.942017    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41215eaa-4c4a-46d9-bba8-4e8d1d019be1" containerName="maas-api"
Aug 04 19:11:49.942037 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:49.942026    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="41215eaa-4c4a-46d9-bba8-4e8d1d019be1" containerName="maas-api"
Aug 04 19:11:49.942290 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:49.942041    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa" containerName="payload-processing"
Aug 04 19:11:49.942290 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:49.942050    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa" containerName="payload-processing"
Aug 04 19:11:49.942290 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:49.942135    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3eb8ea30-56c8-4c11-ba7e-e0876d02dbaa" containerName="payload-processing"
Aug 04 19:11:49.942290 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:49.942147    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b507356c-97be-49f1-80a4-9fbc8578039f" containerName="maas-api"
Aug 04 19:11:49.942290 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:49.942157    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="41215eaa-4c4a-46d9-bba8-4e8d1d019be1" containerName="maas-api"
Aug 04 19:11:49.942290 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:49.942177    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="48837475-5d4d-4603-8e9f-24a769881dfe" containerName="payload-pre-processing"
Aug 04 19:11:49.947292 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:49.947270    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v"
Aug 04 19:11:49.950451 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:49.950428    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-c028db-serving-cert\""
Aug 04 19:11:49.956221 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:49.956195    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v"]
Aug 04 19:11:50.077459 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:50.077422    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b8cf6ee-6526-4dac-98cf-491a102f1bd0-maas-api-tls\") pod \"maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v\" (UID: \"5b8cf6ee-6526-4dac-98cf-491a102f1bd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v"
Aug 04 19:11:50.077674 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:50.077537    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn5xf\" (UniqueName: \"kubernetes.io/projected/5b8cf6ee-6526-4dac-98cf-491a102f1bd0-kube-api-access-dn5xf\") pod \"maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v\" (UID: \"5b8cf6ee-6526-4dac-98cf-491a102f1bd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v"
Aug 04 19:11:50.077674 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:50.077595    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b8cf6ee-6526-4dac-98cf-491a102f1bd0-openshift-service-ca\") pod \"maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v\" (UID: \"5b8cf6ee-6526-4dac-98cf-491a102f1bd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v"
Aug 04 19:11:50.178777 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:50.178737    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b8cf6ee-6526-4dac-98cf-491a102f1bd0-maas-api-tls\") pod \"maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v\" (UID: \"5b8cf6ee-6526-4dac-98cf-491a102f1bd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v"
Aug 04 19:11:50.178943 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:50.178822    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn5xf\" (UniqueName: \"kubernetes.io/projected/5b8cf6ee-6526-4dac-98cf-491a102f1bd0-kube-api-access-dn5xf\") pod \"maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v\" (UID: \"5b8cf6ee-6526-4dac-98cf-491a102f1bd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v"
Aug 04 19:11:50.178943 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:50.178856    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b8cf6ee-6526-4dac-98cf-491a102f1bd0-openshift-service-ca\") pod \"maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v\" (UID: \"5b8cf6ee-6526-4dac-98cf-491a102f1bd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v"
Aug 04 19:11:50.178943 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:11:50.178886    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-serving-cert: secret "maas-api-e2e-api-a-c028db-serving-cert" not found
Aug 04 19:11:50.179092 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:11:50.178967    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b8cf6ee-6526-4dac-98cf-491a102f1bd0-maas-api-tls podName:5b8cf6ee-6526-4dac-98cf-491a102f1bd0 nodeName:}" failed. No retries permitted until 2026-08-04 19:11:50.678947405 +0000 UTC m=+2631.213130476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5b8cf6ee-6526-4dac-98cf-491a102f1bd0-maas-api-tls") pod "maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v" (UID: "5b8cf6ee-6526-4dac-98cf-491a102f1bd0") : secret "maas-api-e2e-api-a-c028db-serving-cert" not found
Aug 04 19:11:50.179495 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:50.179477    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b8cf6ee-6526-4dac-98cf-491a102f1bd0-openshift-service-ca\") pod \"maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v\" (UID: \"5b8cf6ee-6526-4dac-98cf-491a102f1bd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v"
Aug 04 19:11:50.189823 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:50.189788    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn5xf\" (UniqueName: \"kubernetes.io/projected/5b8cf6ee-6526-4dac-98cf-491a102f1bd0-kube-api-access-dn5xf\") pod \"maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v\" (UID: \"5b8cf6ee-6526-4dac-98cf-491a102f1bd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v"
Aug 04 19:11:50.683456 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:50.683419    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b8cf6ee-6526-4dac-98cf-491a102f1bd0-maas-api-tls\") pod \"maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v\" (UID: \"5b8cf6ee-6526-4dac-98cf-491a102f1bd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v"
Aug 04 19:11:50.686007 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:50.685976    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b8cf6ee-6526-4dac-98cf-491a102f1bd0-maas-api-tls\") pod \"maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v\" (UID: \"5b8cf6ee-6526-4dac-98cf-491a102f1bd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v"
Aug 04 19:11:50.718316 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:50.718283    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp"]
Aug 04 19:11:50.721921 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:50.721901    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp"
Aug 04 19:11:50.724857 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:50.724822    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-c028db\""
Aug 04 19:11:50.725003 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:50.724870    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-c028db-dockercfg-9gfz9\""
Aug 04 19:11:50.731422 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:50.731385    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp"]
Aug 04 19:11:50.859141 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:50.859107    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v"
Aug 04 19:11:50.885368 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:50.885336    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqplg\" (UniqueName: \"kubernetes.io/projected/47b35651-d486-49a6-a647-23da04a9842e-kube-api-access-vqplg\") pod \"payload-processing-e2e-api-a-c028db-d79557994-p8pvp\" (UID: \"47b35651-d486-49a6-a647-23da04a9842e\") " pod="openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp"
Aug 04 19:11:50.885535 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:50.885399    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47b35651-d486-49a6-a647-23da04a9842e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-c028db-d79557994-p8pvp\" (UID: \"47b35651-d486-49a6-a647-23da04a9842e\") " pod="openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp"
Aug 04 19:11:50.986725 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:50.986692    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqplg\" (UniqueName: \"kubernetes.io/projected/47b35651-d486-49a6-a647-23da04a9842e-kube-api-access-vqplg\") pod \"payload-processing-e2e-api-a-c028db-d79557994-p8pvp\" (UID: \"47b35651-d486-49a6-a647-23da04a9842e\") " pod="openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp"
Aug 04 19:11:50.987121 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:50.986758    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47b35651-d486-49a6-a647-23da04a9842e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-c028db-d79557994-p8pvp\" (UID: \"47b35651-d486-49a6-a647-23da04a9842e\") " pod="openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp"
Aug 04 19:11:50.987715 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:50.987693    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47b35651-d486-49a6-a647-23da04a9842e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-c028db-d79557994-p8pvp\" (UID: \"47b35651-d486-49a6-a647-23da04a9842e\") " pod="openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp"
Aug 04 19:11:50.995429 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:50.995404    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqplg\" (UniqueName: \"kubernetes.io/projected/47b35651-d486-49a6-a647-23da04a9842e-kube-api-access-vqplg\") pod \"payload-processing-e2e-api-a-c028db-d79557994-p8pvp\" (UID: \"47b35651-d486-49a6-a647-23da04a9842e\") " pod="openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp"
Aug 04 19:11:51.002067 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:51.002032    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v"]
Aug 04 19:11:51.004622 ip-10-0-132-214 kubenswrapper[2558]: W0804 19:11:51.004596    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b8cf6ee_6526_4dac_98cf_491a102f1bd0.slice/crio-f51e4697b28db031444b32880a2b9c2c5f0cc46e2fcb94859755033f59aa983a WatchSource:0}: Error finding container f51e4697b28db031444b32880a2b9c2c5f0cc46e2fcb94859755033f59aa983a: Status 404 returned error can't find the container with id f51e4697b28db031444b32880a2b9c2c5f0cc46e2fcb94859755033f59aa983a
Aug 04 19:11:51.005945 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:51.005929    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 19:11:51.034279 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:51.034253    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp"
Aug 04 19:11:51.172582 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:51.172551    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp"]
Aug 04 19:11:51.175034 ip-10-0-132-214 kubenswrapper[2558]: W0804 19:11:51.175001    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47b35651_d486_49a6_a647_23da04a9842e.slice/crio-c621d436b87b1a62e8cafc5c8e3661f6f0fac9e73e06bc58ba1d40999416a893 WatchSource:0}: Error finding container c621d436b87b1a62e8cafc5c8e3661f6f0fac9e73e06bc58ba1d40999416a893: Status 404 returned error can't find the container with id c621d436b87b1a62e8cafc5c8e3661f6f0fac9e73e06bc58ba1d40999416a893
Aug 04 19:11:51.670971 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:51.670927    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp" event={"ID":"47b35651-d486-49a6-a647-23da04a9842e","Type":"ContainerStarted","Data":"ed0ee11c15dee05e354b22694d4efbdc2eb7ac60428cd6a2ceee2f4701ae316a"}
Aug 04 19:11:51.671213 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:51.670997    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp" event={"ID":"47b35651-d486-49a6-a647-23da04a9842e","Type":"ContainerStarted","Data":"c621d436b87b1a62e8cafc5c8e3661f6f0fac9e73e06bc58ba1d40999416a893"}
Aug 04 19:11:51.671806 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:51.671778    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp"
Aug 04 19:11:51.673341 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:51.673314    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v" event={"ID":"5b8cf6ee-6526-4dac-98cf-491a102f1bd0","Type":"ContainerStarted","Data":"f51e4697b28db031444b32880a2b9c2c5f0cc46e2fcb94859755033f59aa983a"}
Aug 04 19:11:51.687735 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:51.687669    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp" podStartSLOduration=1.687623661 podStartE2EDuration="1.687623661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:11:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:11:51.686888426 +0000 UTC m=+2632.221071514" watchObservedRunningTime="2026-08-04 19:11:51.687623661 +0000 UTC m=+2632.221806755"
Aug 04 19:11:52.679704 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:52.679663    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v" event={"ID":"5b8cf6ee-6526-4dac-98cf-491a102f1bd0","Type":"ContainerStarted","Data":"90f8f1a1e6d4aacdbaaeb2fe299c90a6583d52074a8c2980b56a214658111730"}
Aug 04 19:11:52.680300 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:52.679742    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v"
Aug 04 19:11:52.698927 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:52.698870    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v" podStartSLOduration=2.976716765 podStartE2EDuration="3.698854133s" totalImagesPullingTime="722.137368ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:11:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:11:52.696534876 +0000 UTC m=+2633.230717968" watchObservedRunningTime="2026-08-04 19:11:52.698854133 +0000 UTC m=+2633.233037261"
Aug 04 19:11:58.696034 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:11:58.690521    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v"
Aug 04 19:12:03.687258 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:03.687229    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp"
Aug 04 19:12:23.709160 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:23.709130    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv"]
Aug 04 19:12:23.712947 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:23.712925    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv"
Aug 04 19:12:23.715292 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:23.715268    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-7afb35-serving-cert\""
Aug 04 19:12:23.725392 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:23.725371    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv"]
Aug 04 19:12:23.787641 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:23.787591    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkskc\" (UniqueName: \"kubernetes.io/projected/b099348a-1365-420d-9cf0-35485ed42916-kube-api-access-jkskc\") pod \"maas-api-e2e-api-b-7afb35-698c4d6646-fblmv\" (UID: \"b099348a-1365-420d-9cf0-35485ed42916\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv"
Aug 04 19:12:23.787864 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:23.787653    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b099348a-1365-420d-9cf0-35485ed42916-openshift-service-ca\") pod \"maas-api-e2e-api-b-7afb35-698c4d6646-fblmv\" (UID: \"b099348a-1365-420d-9cf0-35485ed42916\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv"
Aug 04 19:12:23.787864 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:23.787777    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b099348a-1365-420d-9cf0-35485ed42916-maas-api-tls\") pod \"maas-api-e2e-api-b-7afb35-698c4d6646-fblmv\" (UID: \"b099348a-1365-420d-9cf0-35485ed42916\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv"
Aug 04 19:12:23.889121 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:23.889065    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkskc\" (UniqueName: \"kubernetes.io/projected/b099348a-1365-420d-9cf0-35485ed42916-kube-api-access-jkskc\") pod \"maas-api-e2e-api-b-7afb35-698c4d6646-fblmv\" (UID: \"b099348a-1365-420d-9cf0-35485ed42916\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv"
Aug 04 19:12:23.889431 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:23.889135    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b099348a-1365-420d-9cf0-35485ed42916-openshift-service-ca\") pod \"maas-api-e2e-api-b-7afb35-698c4d6646-fblmv\" (UID: \"b099348a-1365-420d-9cf0-35485ed42916\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv"
Aug 04 19:12:23.889431 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:23.889196    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b099348a-1365-420d-9cf0-35485ed42916-maas-api-tls\") pod \"maas-api-e2e-api-b-7afb35-698c4d6646-fblmv\" (UID: \"b099348a-1365-420d-9cf0-35485ed42916\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv"
Aug 04 19:12:23.889431 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:12:23.889298    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-serving-cert: secret "maas-api-e2e-api-b-7afb35-serving-cert" not found
Aug 04 19:12:23.889431 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:12:23.889387    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b099348a-1365-420d-9cf0-35485ed42916-maas-api-tls podName:b099348a-1365-420d-9cf0-35485ed42916 nodeName:}" failed. No retries permitted until 2026-08-04 19:12:24.38936544 +0000 UTC m=+2664.923548513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b099348a-1365-420d-9cf0-35485ed42916-maas-api-tls") pod "maas-api-e2e-api-b-7afb35-698c4d6646-fblmv" (UID: "b099348a-1365-420d-9cf0-35485ed42916") : secret "maas-api-e2e-api-b-7afb35-serving-cert" not found
Aug 04 19:12:23.889883 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:23.889863    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b099348a-1365-420d-9cf0-35485ed42916-openshift-service-ca\") pod \"maas-api-e2e-api-b-7afb35-698c4d6646-fblmv\" (UID: \"b099348a-1365-420d-9cf0-35485ed42916\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv"
Aug 04 19:12:23.897915 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:23.897885    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkskc\" (UniqueName: \"kubernetes.io/projected/b099348a-1365-420d-9cf0-35485ed42916-kube-api-access-jkskc\") pod \"maas-api-e2e-api-b-7afb35-698c4d6646-fblmv\" (UID: \"b099348a-1365-420d-9cf0-35485ed42916\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv"
Aug 04 19:12:24.395312 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:24.395279    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b099348a-1365-420d-9cf0-35485ed42916-maas-api-tls\") pod \"maas-api-e2e-api-b-7afb35-698c4d6646-fblmv\" (UID: \"b099348a-1365-420d-9cf0-35485ed42916\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv"
Aug 04 19:12:24.397840 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:24.397819    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b099348a-1365-420d-9cf0-35485ed42916-maas-api-tls\") pod \"maas-api-e2e-api-b-7afb35-698c4d6646-fblmv\" (UID: \"b099348a-1365-420d-9cf0-35485ed42916\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv"
Aug 04 19:12:24.533234 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:24.533199    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6"]
Aug 04 19:12:24.536822 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:24.536805    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6"
Aug 04 19:12:24.539646 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:24.539604    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-7afb35\""
Aug 04 19:12:24.539771 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:24.539604    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-7afb35-dockercfg-92h84\""
Aug 04 19:12:24.547953 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:24.547931    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6"]
Aug 04 19:12:24.625418 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:24.625380    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv"
Aug 04 19:12:24.698970 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:24.698931    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d47dcf05-1e05-49fd-a3c9-48e1e2037252-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6\" (UID: \"d47dcf05-1e05-49fd-a3c9-48e1e2037252\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6"
Aug 04 19:12:24.699165 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:24.699019    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph5ft\" (UniqueName: \"kubernetes.io/projected/d47dcf05-1e05-49fd-a3c9-48e1e2037252-kube-api-access-ph5ft\") pod \"payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6\" (UID: \"d47dcf05-1e05-49fd-a3c9-48e1e2037252\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6"
Aug 04 19:12:24.772143 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:24.772119    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv"]
Aug 04 19:12:24.774797 ip-10-0-132-214 kubenswrapper[2558]: W0804 19:12:24.774770    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb099348a_1365_420d_9cf0_35485ed42916.slice/crio-4a6195c204146406908aaf2fb893282b3a1a45d26f88ccbb80a03084b4b4b209 WatchSource:0}: Error finding container 4a6195c204146406908aaf2fb893282b3a1a45d26f88ccbb80a03084b4b4b209: Status 404 returned error can't find the container with id 4a6195c204146406908aaf2fb893282b3a1a45d26f88ccbb80a03084b4b4b209
Aug 04 19:12:24.799503 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:24.799479    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d47dcf05-1e05-49fd-a3c9-48e1e2037252-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6\" (UID: \"d47dcf05-1e05-49fd-a3c9-48e1e2037252\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6"
Aug 04 19:12:24.799618 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:24.799538    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph5ft\" (UniqueName: \"kubernetes.io/projected/d47dcf05-1e05-49fd-a3c9-48e1e2037252-kube-api-access-ph5ft\") pod \"payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6\" (UID: \"d47dcf05-1e05-49fd-a3c9-48e1e2037252\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6"
Aug 04 19:12:24.800198 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:24.800178    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d47dcf05-1e05-49fd-a3c9-48e1e2037252-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6\" (UID: \"d47dcf05-1e05-49fd-a3c9-48e1e2037252\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6"
Aug 04 19:12:24.808072 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:24.808047    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph5ft\" (UniqueName: \"kubernetes.io/projected/d47dcf05-1e05-49fd-a3c9-48e1e2037252-kube-api-access-ph5ft\") pod \"payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6\" (UID: \"d47dcf05-1e05-49fd-a3c9-48e1e2037252\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6"
Aug 04 19:12:24.830724 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:24.830697    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv" event={"ID":"b099348a-1365-420d-9cf0-35485ed42916","Type":"ContainerStarted","Data":"4a6195c204146406908aaf2fb893282b3a1a45d26f88ccbb80a03084b4b4b209"}
Aug 04 19:12:24.847975 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:24.847950    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6"
Aug 04 19:12:24.991117 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:24.991088    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6"]
Aug 04 19:12:24.993627 ip-10-0-132-214 kubenswrapper[2558]: W0804 19:12:24.993602    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd47dcf05_1e05_49fd_a3c9_48e1e2037252.slice/crio-e702aac9ed6050d49e89a302872edda5ba1879c2ad6d1de197e6c9ae52a8228b WatchSource:0}: Error finding container e702aac9ed6050d49e89a302872edda5ba1879c2ad6d1de197e6c9ae52a8228b: Status 404 returned error can't find the container with id e702aac9ed6050d49e89a302872edda5ba1879c2ad6d1de197e6c9ae52a8228b
Aug 04 19:12:25.837706 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:25.837667    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6" event={"ID":"d47dcf05-1e05-49fd-a3c9-48e1e2037252","Type":"ContainerStarted","Data":"551607c98fccbdd8056ef5c4e37e37c70e885f427cd9380944ad7eb797ebbad7"}
Aug 04 19:12:25.838190 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:25.837730    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6" event={"ID":"d47dcf05-1e05-49fd-a3c9-48e1e2037252","Type":"ContainerStarted","Data":"e702aac9ed6050d49e89a302872edda5ba1879c2ad6d1de197e6c9ae52a8228b"}
Aug 04 19:12:25.838190 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:25.837845    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6"
Aug 04 19:12:25.839234 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:25.839214    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv" event={"ID":"b099348a-1365-420d-9cf0-35485ed42916","Type":"ContainerStarted","Data":"f79e9b3d08997cdff32e77f34c8ca75412978aefc468591236f7e0b397dce8e5"}
Aug 04 19:12:25.839323 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:25.839277    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv"
Aug 04 19:12:25.855656 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:25.855585    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6" podStartSLOduration=1.855569546 podStartE2EDuration="1.855569546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:12:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:12:25.853329245 +0000 UTC m=+2666.387512349" watchObservedRunningTime="2026-08-04 19:12:25.855569546 +0000 UTC m=+2666.389752647"
Aug 04 19:12:25.873113 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:25.873063    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv" podStartSLOduration=2.519235432 podStartE2EDuration="2.873048244s" totalImagesPullingTime="353.812812ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:12:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:12:25.870509171 +0000 UTC m=+2666.404692257" watchObservedRunningTime="2026-08-04 19:12:25.873048244 +0000 UTC m=+2666.407231375"
Aug 04 19:12:31.849031 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:31.849001    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv"
Aug 04 19:12:36.845801 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:36.845770    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6"
Aug 04 19:12:52.311184 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.311108    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v"]
Aug 04 19:12:52.311666 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.311315    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v" podUID="5b8cf6ee-6526-4dac-98cf-491a102f1bd0" containerName="maas-api" containerID="cri-o://90f8f1a1e6d4aacdbaaeb2fe299c90a6583d52074a8c2980b56a214658111730" gracePeriod=30
Aug 04 19:12:52.385992 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.385949    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp"]
Aug 04 19:12:52.386196 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.386162    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp" podUID="47b35651-d486-49a6-a647-23da04a9842e" containerName="payload-processing" containerID="cri-o://ed0ee11c15dee05e354b22694d4efbdc2eb7ac60428cd6a2ceee2f4701ae316a" gracePeriod=30
Aug 04 19:12:52.642778 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.642754    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v"
Aug 04 19:12:52.674962 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.674936    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp"
Aug 04 19:12:52.762503 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.762471    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b8cf6ee-6526-4dac-98cf-491a102f1bd0-openshift-service-ca\") pod \"5b8cf6ee-6526-4dac-98cf-491a102f1bd0\" (UID: \"5b8cf6ee-6526-4dac-98cf-491a102f1bd0\") "
Aug 04 19:12:52.762503 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.762506    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b8cf6ee-6526-4dac-98cf-491a102f1bd0-maas-api-tls\") pod \"5b8cf6ee-6526-4dac-98cf-491a102f1bd0\" (UID: \"5b8cf6ee-6526-4dac-98cf-491a102f1bd0\") "
Aug 04 19:12:52.762790 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.762568    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqplg\" (UniqueName: \"kubernetes.io/projected/47b35651-d486-49a6-a647-23da04a9842e-kube-api-access-vqplg\") pod \"47b35651-d486-49a6-a647-23da04a9842e\" (UID: \"47b35651-d486-49a6-a647-23da04a9842e\") "
Aug 04 19:12:52.762790 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.762622    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dn5xf\" (UniqueName: \"kubernetes.io/projected/5b8cf6ee-6526-4dac-98cf-491a102f1bd0-kube-api-access-dn5xf\") pod \"5b8cf6ee-6526-4dac-98cf-491a102f1bd0\" (UID: \"5b8cf6ee-6526-4dac-98cf-491a102f1bd0\") "
Aug 04 19:12:52.762790 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.762697    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47b35651-d486-49a6-a647-23da04a9842e-plugins-config-volume\") pod \"47b35651-d486-49a6-a647-23da04a9842e\" (UID: \"47b35651-d486-49a6-a647-23da04a9842e\") "
Aug 04 19:12:52.762960 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.762906    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b8cf6ee-6526-4dac-98cf-491a102f1bd0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5b8cf6ee-6526-4dac-98cf-491a102f1bd0" (UID: "5b8cf6ee-6526-4dac-98cf-491a102f1bd0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:12:52.763042 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.763023    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b8cf6ee-6526-4dac-98cf-491a102f1bd0-openshift-service-ca\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:12:52.763113 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.763088    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47b35651-d486-49a6-a647-23da04a9842e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "47b35651-d486-49a6-a647-23da04a9842e" (UID: "47b35651-d486-49a6-a647-23da04a9842e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:12:52.764748 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.764727    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b8cf6ee-6526-4dac-98cf-491a102f1bd0-kube-api-access-dn5xf" (OuterVolumeSpecName: "kube-api-access-dn5xf") pod "5b8cf6ee-6526-4dac-98cf-491a102f1bd0" (UID: "5b8cf6ee-6526-4dac-98cf-491a102f1bd0"). InnerVolumeSpecName "kube-api-access-dn5xf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:12:52.764748 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.764741    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b8cf6ee-6526-4dac-98cf-491a102f1bd0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5b8cf6ee-6526-4dac-98cf-491a102f1bd0" (UID: "5b8cf6ee-6526-4dac-98cf-491a102f1bd0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:12:52.764867 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.764787    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47b35651-d486-49a6-a647-23da04a9842e-kube-api-access-vqplg" (OuterVolumeSpecName: "kube-api-access-vqplg") pod "47b35651-d486-49a6-a647-23da04a9842e" (UID: "47b35651-d486-49a6-a647-23da04a9842e"). InnerVolumeSpecName "kube-api-access-vqplg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:12:52.863953 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.863869    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b8cf6ee-6526-4dac-98cf-491a102f1bd0-maas-api-tls\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:12:52.863953 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.863895    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqplg\" (UniqueName: \"kubernetes.io/projected/47b35651-d486-49a6-a647-23da04a9842e-kube-api-access-vqplg\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:12:52.863953 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.863905    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dn5xf\" (UniqueName: \"kubernetes.io/projected/5b8cf6ee-6526-4dac-98cf-491a102f1bd0-kube-api-access-dn5xf\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:12:52.863953 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.863915    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47b35651-d486-49a6-a647-23da04a9842e-plugins-config-volume\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:12:52.965181 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.965150    2558 generic.go:356] "Generic (PLEG): container finished" podID="47b35651-d486-49a6-a647-23da04a9842e" containerID="ed0ee11c15dee05e354b22694d4efbdc2eb7ac60428cd6a2ceee2f4701ae316a" exitCode=0
Aug 04 19:12:52.965379 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.965190    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp"
Aug 04 19:12:52.965379 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.965224    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp" event={"ID":"47b35651-d486-49a6-a647-23da04a9842e","Type":"ContainerDied","Data":"ed0ee11c15dee05e354b22694d4efbdc2eb7ac60428cd6a2ceee2f4701ae316a"}
Aug 04 19:12:52.965379 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.965272    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp" event={"ID":"47b35651-d486-49a6-a647-23da04a9842e","Type":"ContainerDied","Data":"c621d436b87b1a62e8cafc5c8e3661f6f0fac9e73e06bc58ba1d40999416a893"}
Aug 04 19:12:52.965379 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.965294    2558 scope.go:117] "RemoveContainer" containerID="ed0ee11c15dee05e354b22694d4efbdc2eb7ac60428cd6a2ceee2f4701ae316a"
Aug 04 19:12:52.966706 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.966683    2558 generic.go:356] "Generic (PLEG): container finished" podID="5b8cf6ee-6526-4dac-98cf-491a102f1bd0" containerID="90f8f1a1e6d4aacdbaaeb2fe299c90a6583d52074a8c2980b56a214658111730" exitCode=0
Aug 04 19:12:52.966820 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.966729    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v" event={"ID":"5b8cf6ee-6526-4dac-98cf-491a102f1bd0","Type":"ContainerDied","Data":"90f8f1a1e6d4aacdbaaeb2fe299c90a6583d52074a8c2980b56a214658111730"}
Aug 04 19:12:52.966820 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.966746    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v"
Aug 04 19:12:52.966820 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.966774    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v" event={"ID":"5b8cf6ee-6526-4dac-98cf-491a102f1bd0","Type":"ContainerDied","Data":"f51e4697b28db031444b32880a2b9c2c5f0cc46e2fcb94859755033f59aa983a"}
Aug 04 19:12:52.975583 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.975563    2558 scope.go:117] "RemoveContainer" containerID="ed0ee11c15dee05e354b22694d4efbdc2eb7ac60428cd6a2ceee2f4701ae316a"
Aug 04 19:12:52.975927 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:12:52.975903    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed0ee11c15dee05e354b22694d4efbdc2eb7ac60428cd6a2ceee2f4701ae316a\": container with ID starting with ed0ee11c15dee05e354b22694d4efbdc2eb7ac60428cd6a2ceee2f4701ae316a not found: ID does not exist" containerID="ed0ee11c15dee05e354b22694d4efbdc2eb7ac60428cd6a2ceee2f4701ae316a"
Aug 04 19:12:52.976034 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.975934    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed0ee11c15dee05e354b22694d4efbdc2eb7ac60428cd6a2ceee2f4701ae316a"} err="failed to get container status \"ed0ee11c15dee05e354b22694d4efbdc2eb7ac60428cd6a2ceee2f4701ae316a\": rpc error: code = NotFound desc = could not find container \"ed0ee11c15dee05e354b22694d4efbdc2eb7ac60428cd6a2ceee2f4701ae316a\": container with ID starting with ed0ee11c15dee05e354b22694d4efbdc2eb7ac60428cd6a2ceee2f4701ae316a not found: ID does not exist"
Aug 04 19:12:52.976034 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.975952    2558 scope.go:117] "RemoveContainer" containerID="90f8f1a1e6d4aacdbaaeb2fe299c90a6583d52074a8c2980b56a214658111730"
Aug 04 19:12:52.984508 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.984488    2558 scope.go:117] "RemoveContainer" containerID="90f8f1a1e6d4aacdbaaeb2fe299c90a6583d52074a8c2980b56a214658111730"
Aug 04 19:12:52.984793 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:12:52.984773    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90f8f1a1e6d4aacdbaaeb2fe299c90a6583d52074a8c2980b56a214658111730\": container with ID starting with 90f8f1a1e6d4aacdbaaeb2fe299c90a6583d52074a8c2980b56a214658111730 not found: ID does not exist" containerID="90f8f1a1e6d4aacdbaaeb2fe299c90a6583d52074a8c2980b56a214658111730"
Aug 04 19:12:52.984853 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.984802    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90f8f1a1e6d4aacdbaaeb2fe299c90a6583d52074a8c2980b56a214658111730"} err="failed to get container status \"90f8f1a1e6d4aacdbaaeb2fe299c90a6583d52074a8c2980b56a214658111730\": rpc error: code = NotFound desc = could not find container \"90f8f1a1e6d4aacdbaaeb2fe299c90a6583d52074a8c2980b56a214658111730\": container with ID starting with 90f8f1a1e6d4aacdbaaeb2fe299c90a6583d52074a8c2980b56a214658111730 not found: ID does not exist"
Aug 04 19:12:52.987816 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.987792    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp"]
Aug 04 19:12:52.991910 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:52.991888    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp"]
Aug 04 19:12:53.001843 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:53.001814    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v"]
Aug 04 19:12:53.007838 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:53.007803    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c028db-7d4bbc694b-5dm2v"]
Aug 04 19:12:53.963907 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:53.963868    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47b35651-d486-49a6-a647-23da04a9842e" path="/var/lib/kubelet/pods/47b35651-d486-49a6-a647-23da04a9842e/volumes"
Aug 04 19:12:53.964468 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:12:53.964445    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b8cf6ee-6526-4dac-98cf-491a102f1bd0" path="/var/lib/kubelet/pods/5b8cf6ee-6526-4dac-98cf-491a102f1bd0/volumes"
Aug 04 19:13:10.216207 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:10.216169    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv"]
Aug 04 19:13:10.216698 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:10.216441    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv" podUID="b099348a-1365-420d-9cf0-35485ed42916" containerName="maas-api" containerID="cri-o://f79e9b3d08997cdff32e77f34c8ca75412978aefc468591236f7e0b397dce8e5" gracePeriod=30
Aug 04 19:13:10.277662 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:10.277616    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6"]
Aug 04 19:13:10.277881 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:10.277856    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6" podUID="d47dcf05-1e05-49fd-a3c9-48e1e2037252" containerName="payload-pre-processing" containerID="cri-o://551607c98fccbdd8056ef5c4e37e37c70e885f427cd9380944ad7eb797ebbad7" gracePeriod=30
Aug 04 19:13:10.526185 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:10.526150    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv"
Aug 04 19:13:10.555832 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:10.555806    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6"
Aug 04 19:13:10.625941 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:10.625912    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d47dcf05-1e05-49fd-a3c9-48e1e2037252-plugins-config-volume\") pod \"d47dcf05-1e05-49fd-a3c9-48e1e2037252\" (UID: \"d47dcf05-1e05-49fd-a3c9-48e1e2037252\") "
Aug 04 19:13:10.626092 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:10.625960    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph5ft\" (UniqueName: \"kubernetes.io/projected/d47dcf05-1e05-49fd-a3c9-48e1e2037252-kube-api-access-ph5ft\") pod \"d47dcf05-1e05-49fd-a3c9-48e1e2037252\" (UID: \"d47dcf05-1e05-49fd-a3c9-48e1e2037252\") "
Aug 04 19:13:10.626184 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:10.626087    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkskc\" (UniqueName: \"kubernetes.io/projected/b099348a-1365-420d-9cf0-35485ed42916-kube-api-access-jkskc\") pod \"b099348a-1365-420d-9cf0-35485ed42916\" (UID: \"b099348a-1365-420d-9cf0-35485ed42916\") "
Aug 04 19:13:10.626184 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:10.626131    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b099348a-1365-420d-9cf0-35485ed42916-maas-api-tls\") pod \"b099348a-1365-420d-9cf0-35485ed42916\" (UID: \"b099348a-1365-420d-9cf0-35485ed42916\") "
Aug 04 19:13:10.626317 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:10.626183    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b099348a-1365-420d-9cf0-35485ed42916-openshift-service-ca\") pod \"b099348a-1365-420d-9cf0-35485ed42916\" (UID: \"b099348a-1365-420d-9cf0-35485ed42916\") "
Aug 04 19:13:10.626382 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:10.626363    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d47dcf05-1e05-49fd-a3c9-48e1e2037252-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d47dcf05-1e05-49fd-a3c9-48e1e2037252" (UID: "d47dcf05-1e05-49fd-a3c9-48e1e2037252"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:13:10.626559 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:10.626534    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d47dcf05-1e05-49fd-a3c9-48e1e2037252-plugins-config-volume\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:13:10.626719 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:10.626560    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b099348a-1365-420d-9cf0-35485ed42916-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b099348a-1365-420d-9cf0-35485ed42916" (UID: "b099348a-1365-420d-9cf0-35485ed42916"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:13:10.628171 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:10.628148    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b099348a-1365-420d-9cf0-35485ed42916-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b099348a-1365-420d-9cf0-35485ed42916" (UID: "b099348a-1365-420d-9cf0-35485ed42916"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:13:10.628171 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:10.628161    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b099348a-1365-420d-9cf0-35485ed42916-kube-api-access-jkskc" (OuterVolumeSpecName: "kube-api-access-jkskc") pod "b099348a-1365-420d-9cf0-35485ed42916" (UID: "b099348a-1365-420d-9cf0-35485ed42916"). InnerVolumeSpecName "kube-api-access-jkskc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:13:10.628289 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:10.628186    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d47dcf05-1e05-49fd-a3c9-48e1e2037252-kube-api-access-ph5ft" (OuterVolumeSpecName: "kube-api-access-ph5ft") pod "d47dcf05-1e05-49fd-a3c9-48e1e2037252" (UID: "d47dcf05-1e05-49fd-a3c9-48e1e2037252"). InnerVolumeSpecName "kube-api-access-ph5ft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:13:10.727985 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:10.727949    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b099348a-1365-420d-9cf0-35485ed42916-openshift-service-ca\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:13:10.727985 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:10.727978    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph5ft\" (UniqueName: \"kubernetes.io/projected/d47dcf05-1e05-49fd-a3c9-48e1e2037252-kube-api-access-ph5ft\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:13:10.727985 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:10.727988    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkskc\" (UniqueName: \"kubernetes.io/projected/b099348a-1365-420d-9cf0-35485ed42916-kube-api-access-jkskc\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:13:10.728225 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:10.727997    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b099348a-1365-420d-9cf0-35485ed42916-maas-api-tls\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:13:11.052576 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:11.052541    2558 generic.go:356] "Generic (PLEG): container finished" podID="d47dcf05-1e05-49fd-a3c9-48e1e2037252" containerID="551607c98fccbdd8056ef5c4e37e37c70e885f427cd9380944ad7eb797ebbad7" exitCode=0
Aug 04 19:13:11.052576 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:11.052580    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6"
Aug 04 19:13:11.052878 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:11.052607    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6" event={"ID":"d47dcf05-1e05-49fd-a3c9-48e1e2037252","Type":"ContainerDied","Data":"551607c98fccbdd8056ef5c4e37e37c70e885f427cd9380944ad7eb797ebbad7"}
Aug 04 19:13:11.052878 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:11.052684    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6" event={"ID":"d47dcf05-1e05-49fd-a3c9-48e1e2037252","Type":"ContainerDied","Data":"e702aac9ed6050d49e89a302872edda5ba1879c2ad6d1de197e6c9ae52a8228b"}
Aug 04 19:13:11.052878 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:11.052719    2558 scope.go:117] "RemoveContainer" containerID="551607c98fccbdd8056ef5c4e37e37c70e885f427cd9380944ad7eb797ebbad7"
Aug 04 19:13:11.053924 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:11.053905    2558 generic.go:356] "Generic (PLEG): container finished" podID="b099348a-1365-420d-9cf0-35485ed42916" containerID="f79e9b3d08997cdff32e77f34c8ca75412978aefc468591236f7e0b397dce8e5" exitCode=0
Aug 04 19:13:11.054004 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:11.053947    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv"
Aug 04 19:13:11.054004 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:11.053953    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv" event={"ID":"b099348a-1365-420d-9cf0-35485ed42916","Type":"ContainerDied","Data":"f79e9b3d08997cdff32e77f34c8ca75412978aefc468591236f7e0b397dce8e5"}
Aug 04 19:13:11.054004 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:11.053986    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv" event={"ID":"b099348a-1365-420d-9cf0-35485ed42916","Type":"ContainerDied","Data":"4a6195c204146406908aaf2fb893282b3a1a45d26f88ccbb80a03084b4b4b209"}
Aug 04 19:13:11.061347 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:11.061335    2558 scope.go:117] "RemoveContainer" containerID="551607c98fccbdd8056ef5c4e37e37c70e885f427cd9380944ad7eb797ebbad7"
Aug 04 19:13:11.061647 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:13:11.061609    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"551607c98fccbdd8056ef5c4e37e37c70e885f427cd9380944ad7eb797ebbad7\": container with ID starting with 551607c98fccbdd8056ef5c4e37e37c70e885f427cd9380944ad7eb797ebbad7 not found: ID does not exist" containerID="551607c98fccbdd8056ef5c4e37e37c70e885f427cd9380944ad7eb797ebbad7"
Aug 04 19:13:11.061755 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:11.061659    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"551607c98fccbdd8056ef5c4e37e37c70e885f427cd9380944ad7eb797ebbad7"} err="failed to get container status \"551607c98fccbdd8056ef5c4e37e37c70e885f427cd9380944ad7eb797ebbad7\": rpc error: code = NotFound desc = could not find container \"551607c98fccbdd8056ef5c4e37e37c70e885f427cd9380944ad7eb797ebbad7\": container with ID starting with 551607c98fccbdd8056ef5c4e37e37c70e885f427cd9380944ad7eb797ebbad7 not found: ID does not exist"
Aug 04 19:13:11.061755 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:11.061681    2558 scope.go:117] "RemoveContainer" containerID="f79e9b3d08997cdff32e77f34c8ca75412978aefc468591236f7e0b397dce8e5"
Aug 04 19:13:11.069583 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:11.069567    2558 scope.go:117] "RemoveContainer" containerID="f79e9b3d08997cdff32e77f34c8ca75412978aefc468591236f7e0b397dce8e5"
Aug 04 19:13:11.069834 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:13:11.069818    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f79e9b3d08997cdff32e77f34c8ca75412978aefc468591236f7e0b397dce8e5\": container with ID starting with f79e9b3d08997cdff32e77f34c8ca75412978aefc468591236f7e0b397dce8e5 not found: ID does not exist" containerID="f79e9b3d08997cdff32e77f34c8ca75412978aefc468591236f7e0b397dce8e5"
Aug 04 19:13:11.069887 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:11.069841    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f79e9b3d08997cdff32e77f34c8ca75412978aefc468591236f7e0b397dce8e5"} err="failed to get container status \"f79e9b3d08997cdff32e77f34c8ca75412978aefc468591236f7e0b397dce8e5\": rpc error: code = NotFound desc = could not find container \"f79e9b3d08997cdff32e77f34c8ca75412978aefc468591236f7e0b397dce8e5\": container with ID starting with f79e9b3d08997cdff32e77f34c8ca75412978aefc468591236f7e0b397dce8e5 not found: ID does not exist"
Aug 04 19:13:11.076001 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:11.075980    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv"]
Aug 04 19:13:11.080123 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:11.080104    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7afb35-698c4d6646-fblmv"]
Aug 04 19:13:11.089765 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:11.089744    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6"]
Aug 04 19:13:11.095724 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:11.095706    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6"]
Aug 04 19:13:11.963006 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:11.962975    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b099348a-1365-420d-9cf0-35485ed42916" path="/var/lib/kubelet/pods/b099348a-1365-420d-9cf0-35485ed42916/volumes"
Aug 04 19:13:11.963387 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:11.963333    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d47dcf05-1e05-49fd-a3c9-48e1e2037252" path="/var/lib/kubelet/pods/d47dcf05-1e05-49fd-a3c9-48e1e2037252/volumes"
Aug 04 19:13:21.996220 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:21.996180    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6"]
Aug 04 19:13:21.999078 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:21.996725    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47b35651-d486-49a6-a647-23da04a9842e" containerName="payload-processing"
Aug 04 19:13:21.999078 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:21.996764    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="47b35651-d486-49a6-a647-23da04a9842e" containerName="payload-processing"
Aug 04 19:13:21.999078 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:21.996777    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b8cf6ee-6526-4dac-98cf-491a102f1bd0" containerName="maas-api"
Aug 04 19:13:21.999078 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:21.996786    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b8cf6ee-6526-4dac-98cf-491a102f1bd0" containerName="maas-api"
Aug 04 19:13:21.999078 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:21.996796    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d47dcf05-1e05-49fd-a3c9-48e1e2037252" containerName="payload-pre-processing"
Aug 04 19:13:21.999078 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:21.996806    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d47dcf05-1e05-49fd-a3c9-48e1e2037252" containerName="payload-pre-processing"
Aug 04 19:13:21.999078 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:21.996816    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b099348a-1365-420d-9cf0-35485ed42916" containerName="maas-api"
Aug 04 19:13:21.999078 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:21.996823    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b099348a-1365-420d-9cf0-35485ed42916" containerName="maas-api"
Aug 04 19:13:21.999078 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:21.996926    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d47dcf05-1e05-49fd-a3c9-48e1e2037252" containerName="payload-pre-processing"
Aug 04 19:13:21.999078 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:21.996940    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="47b35651-d486-49a6-a647-23da04a9842e" containerName="payload-processing"
Aug 04 19:13:21.999078 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:21.996951    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b8cf6ee-6526-4dac-98cf-491a102f1bd0" containerName="maas-api"
Aug 04 19:13:21.999078 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:21.996960    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b099348a-1365-420d-9cf0-35485ed42916" containerName="maas-api"
Aug 04 19:13:22.000120 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.000098    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6"
Aug 04 19:13:22.002551 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.002525    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-1d2c46-serving-cert\""
Aug 04 19:13:22.009358 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.009077    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6"]
Aug 04 19:13:22.131505 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.131469    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bv98\" (UniqueName: \"kubernetes.io/projected/16598780-0242-4059-a70f-a4c08c038219-kube-api-access-9bv98\") pod \"maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6\" (UID: \"16598780-0242-4059-a70f-a4c08c038219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6"
Aug 04 19:13:22.131716 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.131513    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16598780-0242-4059-a70f-a4c08c038219-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6\" (UID: \"16598780-0242-4059-a70f-a4c08c038219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6"
Aug 04 19:13:22.131716 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.131681    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16598780-0242-4059-a70f-a4c08c038219-maas-api-tls\") pod \"maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6\" (UID: \"16598780-0242-4059-a70f-a4c08c038219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6"
Aug 04 19:13:22.232291 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.232250    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16598780-0242-4059-a70f-a4c08c038219-maas-api-tls\") pod \"maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6\" (UID: \"16598780-0242-4059-a70f-a4c08c038219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6"
Aug 04 19:13:22.232487 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.232311    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bv98\" (UniqueName: \"kubernetes.io/projected/16598780-0242-4059-a70f-a4c08c038219-kube-api-access-9bv98\") pod \"maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6\" (UID: \"16598780-0242-4059-a70f-a4c08c038219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6"
Aug 04 19:13:22.232487 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.232344    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16598780-0242-4059-a70f-a4c08c038219-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6\" (UID: \"16598780-0242-4059-a70f-a4c08c038219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6"
Aug 04 19:13:22.232487 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:13:22.232378    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-serving-cert: secret "maas-api-e2e-shared-a-1d2c46-serving-cert" not found
Aug 04 19:13:22.232487 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:13:22.232434    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16598780-0242-4059-a70f-a4c08c038219-maas-api-tls podName:16598780-0242-4059-a70f-a4c08c038219 nodeName:}" failed. No retries permitted until 2026-08-04 19:13:22.732418967 +0000 UTC m=+2723.266602033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/16598780-0242-4059-a70f-a4c08c038219-maas-api-tls") pod "maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6" (UID: "16598780-0242-4059-a70f-a4c08c038219") : secret "maas-api-e2e-shared-a-1d2c46-serving-cert" not found
Aug 04 19:13:22.233144 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.233124    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16598780-0242-4059-a70f-a4c08c038219-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6\" (UID: \"16598780-0242-4059-a70f-a4c08c038219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6"
Aug 04 19:13:22.240955 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.240928    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bv98\" (UniqueName: \"kubernetes.io/projected/16598780-0242-4059-a70f-a4c08c038219-kube-api-access-9bv98\") pod \"maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6\" (UID: \"16598780-0242-4059-a70f-a4c08c038219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6"
Aug 04 19:13:22.675611 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.675573    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt"]
Aug 04 19:13:22.679560 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.679533    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt"
Aug 04 19:13:22.683166 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.683136    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-1d2c46\""
Aug 04 19:13:22.683319 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.683224    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-1d2c46-dockercfg-qlkfz\""
Aug 04 19:13:22.688667 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.688643    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt"]
Aug 04 19:13:22.737548 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.737515    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16598780-0242-4059-a70f-a4c08c038219-maas-api-tls\") pod \"maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6\" (UID: \"16598780-0242-4059-a70f-a4c08c038219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6"
Aug 04 19:13:22.739983 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.739960    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16598780-0242-4059-a70f-a4c08c038219-maas-api-tls\") pod \"maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6\" (UID: \"16598780-0242-4059-a70f-a4c08c038219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6"
Aug 04 19:13:22.838601 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.838560    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e1e27d1-dabe-485a-861f-57aed52f93dc-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt\" (UID: \"7e1e27d1-dabe-485a-861f-57aed52f93dc\") " pod="openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt"
Aug 04 19:13:22.838826 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.838624    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtsmk\" (UniqueName: \"kubernetes.io/projected/7e1e27d1-dabe-485a-861f-57aed52f93dc-kube-api-access-dtsmk\") pod \"payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt\" (UID: \"7e1e27d1-dabe-485a-861f-57aed52f93dc\") " pod="openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt"
Aug 04 19:13:22.914160 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.914120    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6"
Aug 04 19:13:22.939599 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.939496    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e1e27d1-dabe-485a-861f-57aed52f93dc-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt\" (UID: \"7e1e27d1-dabe-485a-861f-57aed52f93dc\") " pod="openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt"
Aug 04 19:13:22.939599 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.939576    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtsmk\" (UniqueName: \"kubernetes.io/projected/7e1e27d1-dabe-485a-861f-57aed52f93dc-kube-api-access-dtsmk\") pod \"payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt\" (UID: \"7e1e27d1-dabe-485a-861f-57aed52f93dc\") " pod="openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt"
Aug 04 19:13:22.940220 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.940199    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e1e27d1-dabe-485a-861f-57aed52f93dc-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt\" (UID: \"7e1e27d1-dabe-485a-861f-57aed52f93dc\") " pod="openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt"
Aug 04 19:13:22.949318 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.949284    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtsmk\" (UniqueName: \"kubernetes.io/projected/7e1e27d1-dabe-485a-861f-57aed52f93dc-kube-api-access-dtsmk\") pod \"payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt\" (UID: \"7e1e27d1-dabe-485a-861f-57aed52f93dc\") " pod="openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt"
Aug 04 19:13:22.992593 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:22.992561    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt"
Aug 04 19:13:23.062996 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:23.062509    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6"]
Aug 04 19:13:23.066851 ip-10-0-132-214 kubenswrapper[2558]: W0804 19:13:23.066823    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16598780_0242_4059_a70f_a4c08c038219.slice/crio-50b7964c0a8e92744868358408f1b8d172d3278351a34b4ae53b65ecbb6d3d40 WatchSource:0}: Error finding container 50b7964c0a8e92744868358408f1b8d172d3278351a34b4ae53b65ecbb6d3d40: Status 404 returned error can't find the container with id 50b7964c0a8e92744868358408f1b8d172d3278351a34b4ae53b65ecbb6d3d40
Aug 04 19:13:23.114684 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:23.114649    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6" event={"ID":"16598780-0242-4059-a70f-a4c08c038219","Type":"ContainerStarted","Data":"50b7964c0a8e92744868358408f1b8d172d3278351a34b4ae53b65ecbb6d3d40"}
Aug 04 19:13:23.150446 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:23.150413    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt"]
Aug 04 19:13:23.152430 ip-10-0-132-214 kubenswrapper[2558]: W0804 19:13:23.152405    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e1e27d1_dabe_485a_861f_57aed52f93dc.slice/crio-ddb1ea742f43002490114ad3610322af5a2088d1e949f70faae0fecb8e14b121 WatchSource:0}: Error finding container ddb1ea742f43002490114ad3610322af5a2088d1e949f70faae0fecb8e14b121: Status 404 returned error can't find the container with id ddb1ea742f43002490114ad3610322af5a2088d1e949f70faae0fecb8e14b121
Aug 04 19:13:24.121034 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:24.120997    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt" event={"ID":"7e1e27d1-dabe-485a-861f-57aed52f93dc","Type":"ContainerStarted","Data":"d5e05e8b7e25dd3d1cdeaccd063c9717ae05feb22a78152456b5893c53965c49"}
Aug 04 19:13:24.121596 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:24.121049    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt" event={"ID":"7e1e27d1-dabe-485a-861f-57aed52f93dc","Type":"ContainerStarted","Data":"ddb1ea742f43002490114ad3610322af5a2088d1e949f70faae0fecb8e14b121"}
Aug 04 19:13:24.121596 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:24.121136    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt"
Aug 04 19:13:24.138678 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:24.138561    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt" podStartSLOduration=2.138542817 podStartE2EDuration="2.138542817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:13:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:13:24.135929813 +0000 UTC m=+2724.670112903" watchObservedRunningTime="2026-08-04 19:13:24.138542817 +0000 UTC m=+2724.672725909"
Aug 04 19:13:25.128009 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:25.127972    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6" event={"ID":"16598780-0242-4059-a70f-a4c08c038219","Type":"ContainerStarted","Data":"2f8a9f81632fa13392bbe834f8369fea28ce017ccea3c7f54527c9a8fc1596af"}
Aug 04 19:13:25.128448 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:25.128245    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6"
Aug 04 19:13:25.144960 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:25.144913    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6" podStartSLOduration=2.728408529 podStartE2EDuration="4.144898487s" totalImagesPullingTime="1.416489958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:13:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:13:25.143873447 +0000 UTC m=+2725.678056536" watchObservedRunningTime="2026-08-04 19:13:25.144898487 +0000 UTC m=+2725.679081576"
Aug 04 19:13:31.139109 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:31.139081    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6"
Aug 04 19:13:35.130474 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:35.130436    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt"
Aug 04 19:13:55.217435 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:55.217400    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb"]
Aug 04 19:13:55.221767 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:55.221740    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb"
Aug 04 19:13:55.223937 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:55.223912    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-1a00f6-serving-cert\""
Aug 04 19:13:55.230198 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:55.230101    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb"]
Aug 04 19:13:55.331041 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:55.331006    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4ls8\" (UniqueName: \"kubernetes.io/projected/e883720f-7589-4cb8-8f74-2486f4f1d094-kube-api-access-n4ls8\") pod \"maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb\" (UID: \"e883720f-7589-4cb8-8f74-2486f4f1d094\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb"
Aug 04 19:13:55.331233 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:55.331154    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e883720f-7589-4cb8-8f74-2486f4f1d094-maas-api-tls\") pod \"maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb\" (UID: \"e883720f-7589-4cb8-8f74-2486f4f1d094\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb"
Aug 04 19:13:55.331233 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:55.331182    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e883720f-7589-4cb8-8f74-2486f4f1d094-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb\" (UID: \"e883720f-7589-4cb8-8f74-2486f4f1d094\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb"
Aug 04 19:13:55.431677 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:55.431619    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e883720f-7589-4cb8-8f74-2486f4f1d094-maas-api-tls\") pod \"maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb\" (UID: \"e883720f-7589-4cb8-8f74-2486f4f1d094\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb"
Aug 04 19:13:55.431677 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:55.431680    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e883720f-7589-4cb8-8f74-2486f4f1d094-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb\" (UID: \"e883720f-7589-4cb8-8f74-2486f4f1d094\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb"
Aug 04 19:13:55.431939 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:55.431714    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4ls8\" (UniqueName: \"kubernetes.io/projected/e883720f-7589-4cb8-8f74-2486f4f1d094-kube-api-access-n4ls8\") pod \"maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb\" (UID: \"e883720f-7589-4cb8-8f74-2486f4f1d094\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb"
Aug 04 19:13:55.431939 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:13:55.431748    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-serving-cert: secret "maas-api-e2e-shared-b-1a00f6-serving-cert" not found
Aug 04 19:13:55.431939 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:13:55.431811    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e883720f-7589-4cb8-8f74-2486f4f1d094-maas-api-tls podName:e883720f-7589-4cb8-8f74-2486f4f1d094 nodeName:}" failed. No retries permitted until 2026-08-04 19:13:55.931793032 +0000 UTC m=+2756.465976099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e883720f-7589-4cb8-8f74-2486f4f1d094-maas-api-tls") pod "maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb" (UID: "e883720f-7589-4cb8-8f74-2486f4f1d094") : secret "maas-api-e2e-shared-b-1a00f6-serving-cert" not found
Aug 04 19:13:55.432324 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:55.432306    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e883720f-7589-4cb8-8f74-2486f4f1d094-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb\" (UID: \"e883720f-7589-4cb8-8f74-2486f4f1d094\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb"
Aug 04 19:13:55.440271 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:55.440243    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4ls8\" (UniqueName: \"kubernetes.io/projected/e883720f-7589-4cb8-8f74-2486f4f1d094-kube-api-access-n4ls8\") pod \"maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb\" (UID: \"e883720f-7589-4cb8-8f74-2486f4f1d094\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb"
Aug 04 19:13:55.938041 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:55.938006    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e883720f-7589-4cb8-8f74-2486f4f1d094-maas-api-tls\") pod \"maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb\" (UID: \"e883720f-7589-4cb8-8f74-2486f4f1d094\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb"
Aug 04 19:13:55.940568 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:55.940543    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e883720f-7589-4cb8-8f74-2486f4f1d094-maas-api-tls\") pod \"maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb\" (UID: \"e883720f-7589-4cb8-8f74-2486f4f1d094\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb"
Aug 04 19:13:56.137141 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:56.137105    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb"
Aug 04 19:13:56.286609 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:56.283286    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb"]
Aug 04 19:13:56.288323 ip-10-0-132-214 kubenswrapper[2558]: W0804 19:13:56.288295    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode883720f_7589_4cb8_8f74_2486f4f1d094.slice/crio-00041bc94de0c1b685db30b8f0f7cdab510ac4d14eef3d496e3f97c6837ae345 WatchSource:0}: Error finding container 00041bc94de0c1b685db30b8f0f7cdab510ac4d14eef3d496e3f97c6837ae345: Status 404 returned error can't find the container with id 00041bc94de0c1b685db30b8f0f7cdab510ac4d14eef3d496e3f97c6837ae345
Aug 04 19:13:57.282509 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:57.282469    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb" event={"ID":"e883720f-7589-4cb8-8f74-2486f4f1d094","Type":"ContainerStarted","Data":"60abf70c917c6e58d99f727da2de68449197e0983ad6762766dd5ad7182a3f31"}
Aug 04 19:13:57.282710 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:57.282529    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb" event={"ID":"e883720f-7589-4cb8-8f74-2486f4f1d094","Type":"ContainerStarted","Data":"00041bc94de0c1b685db30b8f0f7cdab510ac4d14eef3d496e3f97c6837ae345"}
Aug 04 19:13:57.282710 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:57.282597    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb"
Aug 04 19:13:57.299652 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:13:57.299584    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb" podStartSLOduration=1.7613881089999999 podStartE2EDuration="2.299567196s" totalImagesPullingTime="538.179087ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:13:57.298093256 +0000 UTC m=+2757.832276356" watchObservedRunningTime="2026-08-04 19:13:57.299567196 +0000 UTC m=+2757.833750284"
Aug 04 19:14:03.292923 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:14:03.292893    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb"
Aug 04 19:16:00.254225 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:16:00.254126    2558 scope.go:117] "RemoveContainer" containerID="14c47f12bfa0a63a3f1f7812d0b3643c628c642f16b795062e3901dd4000e21d"
Aug 04 19:22:16.400854 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:16.400771    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq"]
Aug 04 19:22:16.404745 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:16.404719    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq"
Aug 04 19:22:16.407138 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:16.407120    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-f3a5e8-serving-cert\""
Aug 04 19:22:16.423495 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:16.423466    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq"]
Aug 04 19:22:16.532824 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:16.532787    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4b6a6b8-a1d4-4e77-a077-07c564d00d01-maas-api-tls\") pod \"maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq\" (UID: \"a4b6a6b8-a1d4-4e77-a077-07c564d00d01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq"
Aug 04 19:22:16.533019 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:16.532850    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq8f2\" (UniqueName: \"kubernetes.io/projected/a4b6a6b8-a1d4-4e77-a077-07c564d00d01-kube-api-access-hq8f2\") pod \"maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq\" (UID: \"a4b6a6b8-a1d4-4e77-a077-07c564d00d01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq"
Aug 04 19:22:16.533019 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:16.532948    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4b6a6b8-a1d4-4e77-a077-07c564d00d01-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq\" (UID: \"a4b6a6b8-a1d4-4e77-a077-07c564d00d01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq"
Aug 04 19:22:16.633736 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:16.633701    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4b6a6b8-a1d4-4e77-a077-07c564d00d01-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq\" (UID: \"a4b6a6b8-a1d4-4e77-a077-07c564d00d01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq"
Aug 04 19:22:16.633959 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:16.633759    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4b6a6b8-a1d4-4e77-a077-07c564d00d01-maas-api-tls\") pod \"maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq\" (UID: \"a4b6a6b8-a1d4-4e77-a077-07c564d00d01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq"
Aug 04 19:22:16.633959 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:16.633809    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq8f2\" (UniqueName: \"kubernetes.io/projected/a4b6a6b8-a1d4-4e77-a077-07c564d00d01-kube-api-access-hq8f2\") pod \"maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq\" (UID: \"a4b6a6b8-a1d4-4e77-a077-07c564d00d01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq"
Aug 04 19:22:16.633959 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:22:16.633933    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-serving-cert: secret "maas-api-e2e-ipp-a-f3a5e8-serving-cert" not found
Aug 04 19:22:16.634131 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:22:16.633995    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4b6a6b8-a1d4-4e77-a077-07c564d00d01-maas-api-tls podName:a4b6a6b8-a1d4-4e77-a077-07c564d00d01 nodeName:}" failed. No retries permitted until 2026-08-04 19:22:17.133979288 +0000 UTC m=+3257.668162355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a4b6a6b8-a1d4-4e77-a077-07c564d00d01-maas-api-tls") pod "maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq" (UID: "a4b6a6b8-a1d4-4e77-a077-07c564d00d01") : secret "maas-api-e2e-ipp-a-f3a5e8-serving-cert" not found
Aug 04 19:22:16.634366 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:16.634340    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4b6a6b8-a1d4-4e77-a077-07c564d00d01-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq\" (UID: \"a4b6a6b8-a1d4-4e77-a077-07c564d00d01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq"
Aug 04 19:22:16.642234 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:16.642209    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq8f2\" (UniqueName: \"kubernetes.io/projected/a4b6a6b8-a1d4-4e77-a077-07c564d00d01-kube-api-access-hq8f2\") pod \"maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq\" (UID: \"a4b6a6b8-a1d4-4e77-a077-07c564d00d01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq"
Aug 04 19:22:17.139721 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:17.139685    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4b6a6b8-a1d4-4e77-a077-07c564d00d01-maas-api-tls\") pod \"maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq\" (UID: \"a4b6a6b8-a1d4-4e77-a077-07c564d00d01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq"
Aug 04 19:22:17.142363 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:17.142335    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4b6a6b8-a1d4-4e77-a077-07c564d00d01-maas-api-tls\") pod \"maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq\" (UID: \"a4b6a6b8-a1d4-4e77-a077-07c564d00d01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq"
Aug 04 19:22:17.201809 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:17.201775    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5"]
Aug 04 19:22:17.205215 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:17.205198    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5"
Aug 04 19:22:17.207427 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:17.207400    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-f3a5e8-dockercfg-7xms5\""
Aug 04 19:22:17.207583 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:17.207560    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-f3a5e8\""
Aug 04 19:22:17.225740 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:17.225706    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5"]
Aug 04 19:22:17.317879 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:17.317842    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq"
Aug 04 19:22:17.341165 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:17.341131    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srmw9\" (UniqueName: \"kubernetes.io/projected/c00c769d-1ff3-4a46-967f-ae9a3a015486-kube-api-access-srmw9\") pod \"payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5\" (UID: \"c00c769d-1ff3-4a46-967f-ae9a3a015486\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5"
Aug 04 19:22:17.341315 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:17.341267    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c00c769d-1ff3-4a46-967f-ae9a3a015486-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5\" (UID: \"c00c769d-1ff3-4a46-967f-ae9a3a015486\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5"
Aug 04 19:22:17.442235 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:17.442199    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c00c769d-1ff3-4a46-967f-ae9a3a015486-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5\" (UID: \"c00c769d-1ff3-4a46-967f-ae9a3a015486\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5"
Aug 04 19:22:17.442672 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:17.442308    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srmw9\" (UniqueName: \"kubernetes.io/projected/c00c769d-1ff3-4a46-967f-ae9a3a015486-kube-api-access-srmw9\") pod \"payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5\" (UID: \"c00c769d-1ff3-4a46-967f-ae9a3a015486\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5"
Aug 04 19:22:17.443174 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:17.443148    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c00c769d-1ff3-4a46-967f-ae9a3a015486-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5\" (UID: \"c00c769d-1ff3-4a46-967f-ae9a3a015486\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5"
Aug 04 19:22:17.450655 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:17.450617    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srmw9\" (UniqueName: \"kubernetes.io/projected/c00c769d-1ff3-4a46-967f-ae9a3a015486-kube-api-access-srmw9\") pod \"payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5\" (UID: \"c00c769d-1ff3-4a46-967f-ae9a3a015486\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5"
Aug 04 19:22:17.455756 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:17.455729    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq"]
Aug 04 19:22:17.458513 ip-10-0-132-214 kubenswrapper[2558]: W0804 19:22:17.458489    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4b6a6b8_a1d4_4e77_a077_07c564d00d01.slice/crio-dc65595f795592b2933aa7cc40ac347f57c3003b9c0ee7f430c92477e109acca WatchSource:0}: Error finding container dc65595f795592b2933aa7cc40ac347f57c3003b9c0ee7f430c92477e109acca: Status 404 returned error can't find the container with id dc65595f795592b2933aa7cc40ac347f57c3003b9c0ee7f430c92477e109acca
Aug 04 19:22:17.460061 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:17.460042    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 19:22:17.525192 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:17.525158    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5"
Aug 04 19:22:17.594295 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:17.594255    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq" event={"ID":"a4b6a6b8-a1d4-4e77-a077-07c564d00d01","Type":"ContainerStarted","Data":"dc65595f795592b2933aa7cc40ac347f57c3003b9c0ee7f430c92477e109acca"}
Aug 04 19:22:17.672801 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:17.672778    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5"]
Aug 04 19:22:17.675360 ip-10-0-132-214 kubenswrapper[2558]: W0804 19:22:17.675329    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc00c769d_1ff3_4a46_967f_ae9a3a015486.slice/crio-6e52984bae8ed9e0d5a2538827dc6edf75d7dc6ab8ee176d7d8412aeb7f7002f WatchSource:0}: Error finding container 6e52984bae8ed9e0d5a2538827dc6edf75d7dc6ab8ee176d7d8412aeb7f7002f: Status 404 returned error can't find the container with id 6e52984bae8ed9e0d5a2538827dc6edf75d7dc6ab8ee176d7d8412aeb7f7002f
Aug 04 19:22:18.601060 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:18.601022    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq" event={"ID":"a4b6a6b8-a1d4-4e77-a077-07c564d00d01","Type":"ContainerStarted","Data":"15555eb0c29ebd7dc3442a1883a02c126cfcc2b2e8e897ee7e7293a3315da715"}
Aug 04 19:22:18.601562 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:18.601092    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq"
Aug 04 19:22:18.602739 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:18.602714    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5" event={"ID":"c00c769d-1ff3-4a46-967f-ae9a3a015486","Type":"ContainerStarted","Data":"50fc28e64ee86dc500612f04e61af333709fdd6d640a74bdfe1b51ab1e9c7704"}
Aug 04 19:22:18.602851 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:18.602754    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5" event={"ID":"c00c769d-1ff3-4a46-967f-ae9a3a015486","Type":"ContainerStarted","Data":"6e52984bae8ed9e0d5a2538827dc6edf75d7dc6ab8ee176d7d8412aeb7f7002f"}
Aug 04 19:22:18.602851 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:18.602842    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5"
Aug 04 19:22:18.621743 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:18.621690    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq" podStartSLOduration=2.095141611 podStartE2EDuration="2.621674231s" totalImagesPullingTime="526.53262ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:22:18.62031228 +0000 UTC m=+3259.154495391" watchObservedRunningTime="2026-08-04 19:22:18.621674231 +0000 UTC m=+3259.155857345"
Aug 04 19:22:18.638529 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:18.638479    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5" podStartSLOduration=1.638465171 podStartE2EDuration="1.638465171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:22:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:22:18.637325315 +0000 UTC m=+3259.171508404" watchObservedRunningTime="2026-08-04 19:22:18.638465171 +0000 UTC m=+3259.172648259"
Aug 04 19:22:24.614489 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:24.614459    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq"
Aug 04 19:22:29.610137 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:29.610104    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5"
Aug 04 19:22:46.399825 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:46.399785    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk"]
Aug 04 19:22:46.404283 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:46.404248    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk"
Aug 04 19:22:46.407276 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:46.407249    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-f18332\""
Aug 04 19:22:46.407419 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:46.407294    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-f18332-dockercfg-5gz27\""
Aug 04 19:22:46.411888 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:46.411862    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk"]
Aug 04 19:22:46.506746 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:46.506713    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e7cd54e-e8c8-4ade-b381-18f70319bf74-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk\" (UID: \"3e7cd54e-e8c8-4ade-b381-18f70319bf74\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk"
Aug 04 19:22:46.506924 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:46.506791    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dmzf\" (UniqueName: \"kubernetes.io/projected/3e7cd54e-e8c8-4ade-b381-18f70319bf74-kube-api-access-7dmzf\") pod \"payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk\" (UID: \"3e7cd54e-e8c8-4ade-b381-18f70319bf74\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk"
Aug 04 19:22:46.608066 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:46.608025    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dmzf\" (UniqueName: \"kubernetes.io/projected/3e7cd54e-e8c8-4ade-b381-18f70319bf74-kube-api-access-7dmzf\") pod \"payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk\" (UID: \"3e7cd54e-e8c8-4ade-b381-18f70319bf74\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk"
Aug 04 19:22:46.608246 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:46.608112    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e7cd54e-e8c8-4ade-b381-18f70319bf74-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk\" (UID: \"3e7cd54e-e8c8-4ade-b381-18f70319bf74\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk"
Aug 04 19:22:46.608872 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:46.608853    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e7cd54e-e8c8-4ade-b381-18f70319bf74-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk\" (UID: \"3e7cd54e-e8c8-4ade-b381-18f70319bf74\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk"
Aug 04 19:22:46.618771 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:46.618743    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dmzf\" (UniqueName: \"kubernetes.io/projected/3e7cd54e-e8c8-4ade-b381-18f70319bf74-kube-api-access-7dmzf\") pod \"payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk\" (UID: \"3e7cd54e-e8c8-4ade-b381-18f70319bf74\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk"
Aug 04 19:22:46.717746 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:46.717662    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk"
Aug 04 19:22:46.863262 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:46.863227    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk"]
Aug 04 19:22:46.865356 ip-10-0-132-214 kubenswrapper[2558]: W0804 19:22:46.865332    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e7cd54e_e8c8_4ade_b381_18f70319bf74.slice/crio-0548cf6be5b13d31a6ecd4c4be64005a6cf8f1451b32021ece6c6bf645e24715 WatchSource:0}: Error finding container 0548cf6be5b13d31a6ecd4c4be64005a6cf8f1451b32021ece6c6bf645e24715: Status 404 returned error can't find the container with id 0548cf6be5b13d31a6ecd4c4be64005a6cf8f1451b32021ece6c6bf645e24715
Aug 04 19:22:47.751863 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:47.751789    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk" event={"ID":"3e7cd54e-e8c8-4ade-b381-18f70319bf74","Type":"ContainerStarted","Data":"155c50369b002a8e99f1a2f8d6593ae4ebfdcfe038d0688d2b972cd26108a8d6"}
Aug 04 19:22:47.751863 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:47.751861    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk"
Aug 04 19:22:47.752541 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:47.751884    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk" event={"ID":"3e7cd54e-e8c8-4ade-b381-18f70319bf74","Type":"ContainerStarted","Data":"0548cf6be5b13d31a6ecd4c4be64005a6cf8f1451b32021ece6c6bf645e24715"}
Aug 04 19:22:47.767820 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:47.767754    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk" podStartSLOduration=1.767727059 podStartE2EDuration="1.767727059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:22:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:22:47.765945704 +0000 UTC m=+3288.300128803" watchObservedRunningTime="2026-08-04 19:22:47.767727059 +0000 UTC m=+3288.301910181"
Aug 04 19:22:58.759560 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:22:58.759529    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk"
Aug 04 19:23:21.467006 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:23:21.466976    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-km5dc_c846dd43-dccc-4edf-9893-358dd6e879c1/payload-processing/0.log"
Aug 04 19:24:06.263853 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:06.263794    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5_c00c769d-1ff3-4a46-967f-ae9a3a015486/payload-processing/0.log"
Aug 04 19:24:06.378616 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:06.378578    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-km5dc_c846dd43-dccc-4edf-9893-358dd6e879c1/payload-processing/0.log"
Aug 04 19:24:11.183283 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.183245    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx"]
Aug 04 19:24:11.187602 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.187572    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx"
Aug 04 19:24:11.190089 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.190065    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-249eef-serving-cert\""
Aug 04 19:24:11.196966 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.196248    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38844ba6-f29a-4804-abe7-06c4e46aa049-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx\" (UID: \"38844ba6-f29a-4804-abe7-06c4e46aa049\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx"
Aug 04 19:24:11.196966 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.196370    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38844ba6-f29a-4804-abe7-06c4e46aa049-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx\" (UID: \"38844ba6-f29a-4804-abe7-06c4e46aa049\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx"
Aug 04 19:24:11.196966 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.196441    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tggk\" (UniqueName: \"kubernetes.io/projected/38844ba6-f29a-4804-abe7-06c4e46aa049-kube-api-access-6tggk\") pod \"maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx\" (UID: \"38844ba6-f29a-4804-abe7-06c4e46aa049\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx"
Aug 04 19:24:11.196966 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.196470    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx"]
Aug 04 19:24:11.297399 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.297364    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38844ba6-f29a-4804-abe7-06c4e46aa049-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx\" (UID: \"38844ba6-f29a-4804-abe7-06c4e46aa049\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx"
Aug 04 19:24:11.297569 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.297429    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38844ba6-f29a-4804-abe7-06c4e46aa049-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx\" (UID: \"38844ba6-f29a-4804-abe7-06c4e46aa049\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx"
Aug 04 19:24:11.297569 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.297465    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tggk\" (UniqueName: \"kubernetes.io/projected/38844ba6-f29a-4804-abe7-06c4e46aa049-kube-api-access-6tggk\") pod \"maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx\" (UID: \"38844ba6-f29a-4804-abe7-06c4e46aa049\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx"
Aug 04 19:24:11.297662 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:24:11.297572    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-serving-cert: secret "maas-api-e2e-ipp-cleanup-249eef-serving-cert" not found
Aug 04 19:24:11.297703 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:24:11.297686    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38844ba6-f29a-4804-abe7-06c4e46aa049-maas-api-tls podName:38844ba6-f29a-4804-abe7-06c4e46aa049 nodeName:}" failed. No retries permitted until 2026-08-04 19:24:11.797663526 +0000 UTC m=+3372.331846596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/38844ba6-f29a-4804-abe7-06c4e46aa049-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx" (UID: "38844ba6-f29a-4804-abe7-06c4e46aa049") : secret "maas-api-e2e-ipp-cleanup-249eef-serving-cert" not found
Aug 04 19:24:11.298042 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.298023    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38844ba6-f29a-4804-abe7-06c4e46aa049-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx\" (UID: \"38844ba6-f29a-4804-abe7-06c4e46aa049\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx"
Aug 04 19:24:11.305853 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.305830    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tggk\" (UniqueName: \"kubernetes.io/projected/38844ba6-f29a-4804-abe7-06c4e46aa049-kube-api-access-6tggk\") pod \"maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx\" (UID: \"38844ba6-f29a-4804-abe7-06c4e46aa049\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx"
Aug 04 19:24:11.805653 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.802469    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38844ba6-f29a-4804-abe7-06c4e46aa049-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx\" (UID: \"38844ba6-f29a-4804-abe7-06c4e46aa049\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx"
Aug 04 19:24:11.806650 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.805862    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38844ba6-f29a-4804-abe7-06c4e46aa049-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx\" (UID: \"38844ba6-f29a-4804-abe7-06c4e46aa049\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx"
Aug 04 19:24:11.813695 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.813659    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w"]
Aug 04 19:24:11.817389 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.817368    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w"
Aug 04 19:24:11.820023 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.820003    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-249eef-dockercfg-q8w7h\""
Aug 04 19:24:11.820151 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.820074    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-249eef\""
Aug 04 19:24:11.828456 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.828433    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w"]
Aug 04 19:24:11.837444 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.837411    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm"]
Aug 04 19:24:11.841719 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.841698    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm"
Aug 04 19:24:11.851939 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.851911    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm"]
Aug 04 19:24:11.903558 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.903522    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vbqj\" (UniqueName: \"kubernetes.io/projected/7e23e099-0e47-4671-a2a1-e08c1cccbc10-kube-api-access-7vbqj\") pod \"payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm\" (UID: \"7e23e099-0e47-4671-a2a1-e08c1cccbc10\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm"
Aug 04 19:24:11.903558 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.903562    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e23e099-0e47-4671-a2a1-e08c1cccbc10-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm\" (UID: \"7e23e099-0e47-4671-a2a1-e08c1cccbc10\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm"
Aug 04 19:24:11.903816 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.903623    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e15d7b24-f581-4253-be52-ec32461ea183-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w\" (UID: \"e15d7b24-f581-4253-be52-ec32461ea183\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w"
Aug 04 19:24:11.903816 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:11.903767    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsd7k\" (UniqueName: \"kubernetes.io/projected/e15d7b24-f581-4253-be52-ec32461ea183-kube-api-access-gsd7k\") pod \"payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w\" (UID: \"e15d7b24-f581-4253-be52-ec32461ea183\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w"
Aug 04 19:24:12.005198 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:12.005157    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsd7k\" (UniqueName: \"kubernetes.io/projected/e15d7b24-f581-4253-be52-ec32461ea183-kube-api-access-gsd7k\") pod \"payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w\" (UID: \"e15d7b24-f581-4253-be52-ec32461ea183\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w"
Aug 04 19:24:12.005404 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:12.005242    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vbqj\" (UniqueName: \"kubernetes.io/projected/7e23e099-0e47-4671-a2a1-e08c1cccbc10-kube-api-access-7vbqj\") pod \"payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm\" (UID: \"7e23e099-0e47-4671-a2a1-e08c1cccbc10\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm"
Aug 04 19:24:12.005404 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:12.005264    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e23e099-0e47-4671-a2a1-e08c1cccbc10-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm\" (UID: \"7e23e099-0e47-4671-a2a1-e08c1cccbc10\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm"
Aug 04 19:24:12.005404 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:12.005308    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e15d7b24-f581-4253-be52-ec32461ea183-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w\" (UID: \"e15d7b24-f581-4253-be52-ec32461ea183\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w"
Aug 04 19:24:12.006067 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:12.006044    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e23e099-0e47-4671-a2a1-e08c1cccbc10-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm\" (UID: \"7e23e099-0e47-4671-a2a1-e08c1cccbc10\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm"
Aug 04 19:24:12.006067 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:12.006062    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e15d7b24-f581-4253-be52-ec32461ea183-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w\" (UID: \"e15d7b24-f581-4253-be52-ec32461ea183\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w"
Aug 04 19:24:12.013260 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:12.013237    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsd7k\" (UniqueName: \"kubernetes.io/projected/e15d7b24-f581-4253-be52-ec32461ea183-kube-api-access-gsd7k\") pod \"payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w\" (UID: \"e15d7b24-f581-4253-be52-ec32461ea183\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w"
Aug 04 19:24:12.013372 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:12.013308    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vbqj\" (UniqueName: \"kubernetes.io/projected/7e23e099-0e47-4671-a2a1-e08c1cccbc10-kube-api-access-7vbqj\") pod \"payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm\" (UID: \"7e23e099-0e47-4671-a2a1-e08c1cccbc10\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm"
Aug 04 19:24:12.100869 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:12.100778    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx"
Aug 04 19:24:12.128876 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:12.128843    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w"
Aug 04 19:24:12.154366 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:12.154338    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm"
Aug 04 19:24:12.281827 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:12.281658    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx"]
Aug 04 19:24:12.284969 ip-10-0-132-214 kubenswrapper[2558]: W0804 19:24:12.284872    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38844ba6_f29a_4804_abe7_06c4e46aa049.slice/crio-89c38e93935f2c99d5485a46acda6610bf85db9c3a2d74a60565b55b1089806f WatchSource:0}: Error finding container 89c38e93935f2c99d5485a46acda6610bf85db9c3a2d74a60565b55b1089806f: Status 404 returned error can't find the container with id 89c38e93935f2c99d5485a46acda6610bf85db9c3a2d74a60565b55b1089806f
Aug 04 19:24:12.312289 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:12.312259    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w"]
Aug 04 19:24:12.315088 ip-10-0-132-214 kubenswrapper[2558]: W0804 19:24:12.315059    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode15d7b24_f581_4253_be52_ec32461ea183.slice/crio-5dd58f853da8d592d646328eb9d510e3bf6c9235ce4236b72b96ef8fe5858607 WatchSource:0}: Error finding container 5dd58f853da8d592d646328eb9d510e3bf6c9235ce4236b72b96ef8fe5858607: Status 404 returned error can't find the container with id 5dd58f853da8d592d646328eb9d510e3bf6c9235ce4236b72b96ef8fe5858607
Aug 04 19:24:12.575477 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:12.575451    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm"]
Aug 04 19:24:12.576902 ip-10-0-132-214 kubenswrapper[2558]: W0804 19:24:12.576845    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e23e099_0e47_4671_a2a1_e08c1cccbc10.slice/crio-c350070fdff98e7d1d830eec2c7953a520405066609c1c69097583de902f54d6 WatchSource:0}: Error finding container c350070fdff98e7d1d830eec2c7953a520405066609c1c69097583de902f54d6: Status 404 returned error can't find the container with id c350070fdff98e7d1d830eec2c7953a520405066609c1c69097583de902f54d6
Aug 04 19:24:13.157306 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:13.157267    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w" event={"ID":"e15d7b24-f581-4253-be52-ec32461ea183","Type":"ContainerStarted","Data":"308027f42b7a78f28bfabbf6d358b6d6937df64f02ce090571949699418424d7"}
Aug 04 19:24:13.157523 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:13.157327    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w" event={"ID":"e15d7b24-f581-4253-be52-ec32461ea183","Type":"ContainerStarted","Data":"5dd58f853da8d592d646328eb9d510e3bf6c9235ce4236b72b96ef8fe5858607"}
Aug 04 19:24:13.157523 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:13.157389    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w"
Aug 04 19:24:13.158971 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:13.158945    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx" event={"ID":"38844ba6-f29a-4804-abe7-06c4e46aa049","Type":"ContainerStarted","Data":"3e61e7fd199be7a0ce3a9537d1479928c62a5acbab2b455fb8299a7ac3fcecd3"}
Aug 04 19:24:13.159095 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:13.158983    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx" event={"ID":"38844ba6-f29a-4804-abe7-06c4e46aa049","Type":"ContainerStarted","Data":"89c38e93935f2c99d5485a46acda6610bf85db9c3a2d74a60565b55b1089806f"}
Aug 04 19:24:13.159095 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:13.159036    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx"
Aug 04 19:24:13.160458 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:13.160437    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm" event={"ID":"7e23e099-0e47-4671-a2a1-e08c1cccbc10","Type":"ContainerStarted","Data":"5f4d3011078675a21ec50b1c6512af7621b7cf5e19964c0276ffde2d7045a36d"}
Aug 04 19:24:13.160570 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:13.160473    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm" event={"ID":"7e23e099-0e47-4671-a2a1-e08c1cccbc10","Type":"ContainerStarted","Data":"c350070fdff98e7d1d830eec2c7953a520405066609c1c69097583de902f54d6"}
Aug 04 19:24:13.160570 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:13.160511    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm"
Aug 04 19:24:13.172802 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:13.172752    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w" podStartSLOduration=2.172734445 podStartE2EDuration="2.172734445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:24:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:24:13.172621874 +0000 UTC m=+3373.706804978" watchObservedRunningTime="2026-08-04 19:24:13.172734445 +0000 UTC m=+3373.706917534"
Aug 04 19:24:13.191651 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:13.191584    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx" podStartSLOduration=1.658557181 podStartE2EDuration="2.19156943s" totalImagesPullingTime="533.012249ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:24:13.19028274 +0000 UTC m=+3373.724465812" watchObservedRunningTime="2026-08-04 19:24:13.19156943 +0000 UTC m=+3373.725752518"
Aug 04 19:24:13.207135 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:13.207085    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm" podStartSLOduration=2.207070889 podStartE2EDuration="2.207070889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:24:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:24:13.205837649 +0000 UTC m=+3373.740020738" watchObservedRunningTime="2026-08-04 19:24:13.207070889 +0000 UTC m=+3373.741253978"
Aug 04 19:24:19.172952 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:19.172920    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx"
Aug 04 19:24:24.168840 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:24.168810    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm"
Aug 04 19:24:24.169220 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:24.168979    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w"
Aug 04 19:24:41.783476 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:41.783443    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx"]
Aug 04 19:24:41.784102 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:41.783699    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx" podUID="38844ba6-f29a-4804-abe7-06c4e46aa049" containerName="maas-api" containerID="cri-o://3e61e7fd199be7a0ce3a9537d1479928c62a5acbab2b455fb8299a7ac3fcecd3" gracePeriod=30
Aug 04 19:24:41.852170 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:41.852137    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm"]
Aug 04 19:24:41.852427 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:41.852399    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm" podUID="7e23e099-0e47-4671-a2a1-e08c1cccbc10" containerName="payload-processing" containerID="cri-o://5f4d3011078675a21ec50b1c6512af7621b7cf5e19964c0276ffde2d7045a36d" gracePeriod=30
Aug 04 19:24:41.857752 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:41.857695    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w"]
Aug 04 19:24:41.857923 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:41.857899    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w" podUID="e15d7b24-f581-4253-be52-ec32461ea183" containerName="payload-pre-processing" containerID="cri-o://308027f42b7a78f28bfabbf6d358b6d6937df64f02ce090571949699418424d7" gracePeriod=30
Aug 04 19:24:42.116406 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.116371    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx"
Aug 04 19:24:42.150847 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.150819    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm"
Aug 04 19:24:42.166797 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.166771    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w"
Aug 04 19:24:42.204284 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.204259    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38844ba6-f29a-4804-abe7-06c4e46aa049-maas-api-tls\") pod \"38844ba6-f29a-4804-abe7-06c4e46aa049\" (UID: \"38844ba6-f29a-4804-abe7-06c4e46aa049\") "
Aug 04 19:24:42.204460 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.204293    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tggk\" (UniqueName: \"kubernetes.io/projected/38844ba6-f29a-4804-abe7-06c4e46aa049-kube-api-access-6tggk\") pod \"38844ba6-f29a-4804-abe7-06c4e46aa049\" (UID: \"38844ba6-f29a-4804-abe7-06c4e46aa049\") "
Aug 04 19:24:42.204460 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.204321    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38844ba6-f29a-4804-abe7-06c4e46aa049-openshift-service-ca\") pod \"38844ba6-f29a-4804-abe7-06c4e46aa049\" (UID: \"38844ba6-f29a-4804-abe7-06c4e46aa049\") "
Aug 04 19:24:42.204710 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.204686    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38844ba6-f29a-4804-abe7-06c4e46aa049-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "38844ba6-f29a-4804-abe7-06c4e46aa049" (UID: "38844ba6-f29a-4804-abe7-06c4e46aa049"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:24:42.206376 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.206353    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38844ba6-f29a-4804-abe7-06c4e46aa049-kube-api-access-6tggk" (OuterVolumeSpecName: "kube-api-access-6tggk") pod "38844ba6-f29a-4804-abe7-06c4e46aa049" (UID: "38844ba6-f29a-4804-abe7-06c4e46aa049"). InnerVolumeSpecName "kube-api-access-6tggk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:24:42.206376 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.206371    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38844ba6-f29a-4804-abe7-06c4e46aa049-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "38844ba6-f29a-4804-abe7-06c4e46aa049" (UID: "38844ba6-f29a-4804-abe7-06c4e46aa049"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:24:42.305344 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.305317    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e23e099-0e47-4671-a2a1-e08c1cccbc10-plugins-config-volume\") pod \"7e23e099-0e47-4671-a2a1-e08c1cccbc10\" (UID: \"7e23e099-0e47-4671-a2a1-e08c1cccbc10\") "
Aug 04 19:24:42.305528 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.305357    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsd7k\" (UniqueName: \"kubernetes.io/projected/e15d7b24-f581-4253-be52-ec32461ea183-kube-api-access-gsd7k\") pod \"e15d7b24-f581-4253-be52-ec32461ea183\" (UID: \"e15d7b24-f581-4253-be52-ec32461ea183\") "
Aug 04 19:24:42.305528 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.305418    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vbqj\" (UniqueName: \"kubernetes.io/projected/7e23e099-0e47-4671-a2a1-e08c1cccbc10-kube-api-access-7vbqj\") pod \"7e23e099-0e47-4671-a2a1-e08c1cccbc10\" (UID: \"7e23e099-0e47-4671-a2a1-e08c1cccbc10\") "
Aug 04 19:24:42.305702 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.305536    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e15d7b24-f581-4253-be52-ec32461ea183-plugins-config-volume\") pod \"e15d7b24-f581-4253-be52-ec32461ea183\" (UID: \"e15d7b24-f581-4253-be52-ec32461ea183\") "
Aug 04 19:24:42.305819 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.305790    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e23e099-0e47-4671-a2a1-e08c1cccbc10-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7e23e099-0e47-4671-a2a1-e08c1cccbc10" (UID: "7e23e099-0e47-4671-a2a1-e08c1cccbc10"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:24:42.306011 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.305990    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38844ba6-f29a-4804-abe7-06c4e46aa049-maas-api-tls\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:24:42.306125 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.306014    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tggk\" (UniqueName: \"kubernetes.io/projected/38844ba6-f29a-4804-abe7-06c4e46aa049-kube-api-access-6tggk\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:24:42.306125 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.306027    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e23e099-0e47-4671-a2a1-e08c1cccbc10-plugins-config-volume\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:24:42.306125 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.306040    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38844ba6-f29a-4804-abe7-06c4e46aa049-openshift-service-ca\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:24:42.306125 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.306061    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e15d7b24-f581-4253-be52-ec32461ea183-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e15d7b24-f581-4253-be52-ec32461ea183" (UID: "e15d7b24-f581-4253-be52-ec32461ea183"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:24:42.306802 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.306782    2558 generic.go:356] "Generic (PLEG): container finished" podID="e15d7b24-f581-4253-be52-ec32461ea183" containerID="308027f42b7a78f28bfabbf6d358b6d6937df64f02ce090571949699418424d7" exitCode=0
Aug 04 19:24:42.306905 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.306837    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w"
Aug 04 19:24:42.306905 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.306872    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w" event={"ID":"e15d7b24-f581-4253-be52-ec32461ea183","Type":"ContainerDied","Data":"308027f42b7a78f28bfabbf6d358b6d6937df64f02ce090571949699418424d7"}
Aug 04 19:24:42.307011 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.306951    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w" event={"ID":"e15d7b24-f581-4253-be52-ec32461ea183","Type":"ContainerDied","Data":"5dd58f853da8d592d646328eb9d510e3bf6c9235ce4236b72b96ef8fe5858607"}
Aug 04 19:24:42.307011 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.306977    2558 scope.go:117] "RemoveContainer" containerID="308027f42b7a78f28bfabbf6d358b6d6937df64f02ce090571949699418424d7"
Aug 04 19:24:42.307912 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.307885    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e23e099-0e47-4671-a2a1-e08c1cccbc10-kube-api-access-7vbqj" (OuterVolumeSpecName: "kube-api-access-7vbqj") pod "7e23e099-0e47-4671-a2a1-e08c1cccbc10" (UID: "7e23e099-0e47-4671-a2a1-e08c1cccbc10"). InnerVolumeSpecName "kube-api-access-7vbqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:24:42.308002 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.307934    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e15d7b24-f581-4253-be52-ec32461ea183-kube-api-access-gsd7k" (OuterVolumeSpecName: "kube-api-access-gsd7k") pod "e15d7b24-f581-4253-be52-ec32461ea183" (UID: "e15d7b24-f581-4253-be52-ec32461ea183"). InnerVolumeSpecName "kube-api-access-gsd7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:24:42.308225 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.308197    2558 generic.go:356] "Generic (PLEG): container finished" podID="38844ba6-f29a-4804-abe7-06c4e46aa049" containerID="3e61e7fd199be7a0ce3a9537d1479928c62a5acbab2b455fb8299a7ac3fcecd3" exitCode=0
Aug 04 19:24:42.308331 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.308239    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx"
Aug 04 19:24:42.308331 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.308275    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx" event={"ID":"38844ba6-f29a-4804-abe7-06c4e46aa049","Type":"ContainerDied","Data":"3e61e7fd199be7a0ce3a9537d1479928c62a5acbab2b455fb8299a7ac3fcecd3"}
Aug 04 19:24:42.308331 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.308321    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx" event={"ID":"38844ba6-f29a-4804-abe7-06c4e46aa049","Type":"ContainerDied","Data":"89c38e93935f2c99d5485a46acda6610bf85db9c3a2d74a60565b55b1089806f"}
Aug 04 19:24:42.309647 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.309617    2558 generic.go:356] "Generic (PLEG): container finished" podID="7e23e099-0e47-4671-a2a1-e08c1cccbc10" containerID="5f4d3011078675a21ec50b1c6512af7621b7cf5e19964c0276ffde2d7045a36d" exitCode=0
Aug 04 19:24:42.309733 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.309691    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm"
Aug 04 19:24:42.309796 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.309757    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm" event={"ID":"7e23e099-0e47-4671-a2a1-e08c1cccbc10","Type":"ContainerDied","Data":"5f4d3011078675a21ec50b1c6512af7621b7cf5e19964c0276ffde2d7045a36d"}
Aug 04 19:24:42.309796 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.309794    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm" event={"ID":"7e23e099-0e47-4671-a2a1-e08c1cccbc10","Type":"ContainerDied","Data":"c350070fdff98e7d1d830eec2c7953a520405066609c1c69097583de902f54d6"}
Aug 04 19:24:42.318113 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.318090    2558 scope.go:117] "RemoveContainer" containerID="308027f42b7a78f28bfabbf6d358b6d6937df64f02ce090571949699418424d7"
Aug 04 19:24:42.318377 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:24:42.318360    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"308027f42b7a78f28bfabbf6d358b6d6937df64f02ce090571949699418424d7\": container with ID starting with 308027f42b7a78f28bfabbf6d358b6d6937df64f02ce090571949699418424d7 not found: ID does not exist" containerID="308027f42b7a78f28bfabbf6d358b6d6937df64f02ce090571949699418424d7"
Aug 04 19:24:42.318434 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.318385    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"308027f42b7a78f28bfabbf6d358b6d6937df64f02ce090571949699418424d7"} err="failed to get container status \"308027f42b7a78f28bfabbf6d358b6d6937df64f02ce090571949699418424d7\": rpc error: code = NotFound desc = could not find container \"308027f42b7a78f28bfabbf6d358b6d6937df64f02ce090571949699418424d7\": container with ID starting with 308027f42b7a78f28bfabbf6d358b6d6937df64f02ce090571949699418424d7 not found: ID does not exist"
Aug 04 19:24:42.318434 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.318400    2558 scope.go:117] "RemoveContainer" containerID="3e61e7fd199be7a0ce3a9537d1479928c62a5acbab2b455fb8299a7ac3fcecd3"
Aug 04 19:24:42.326898 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.326882    2558 scope.go:117] "RemoveContainer" containerID="3e61e7fd199be7a0ce3a9537d1479928c62a5acbab2b455fb8299a7ac3fcecd3"
Aug 04 19:24:42.327157 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:24:42.327139    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e61e7fd199be7a0ce3a9537d1479928c62a5acbab2b455fb8299a7ac3fcecd3\": container with ID starting with 3e61e7fd199be7a0ce3a9537d1479928c62a5acbab2b455fb8299a7ac3fcecd3 not found: ID does not exist" containerID="3e61e7fd199be7a0ce3a9537d1479928c62a5acbab2b455fb8299a7ac3fcecd3"
Aug 04 19:24:42.327247 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.327162    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e61e7fd199be7a0ce3a9537d1479928c62a5acbab2b455fb8299a7ac3fcecd3"} err="failed to get container status \"3e61e7fd199be7a0ce3a9537d1479928c62a5acbab2b455fb8299a7ac3fcecd3\": rpc error: code = NotFound desc = could not find container \"3e61e7fd199be7a0ce3a9537d1479928c62a5acbab2b455fb8299a7ac3fcecd3\": container with ID starting with 3e61e7fd199be7a0ce3a9537d1479928c62a5acbab2b455fb8299a7ac3fcecd3 not found: ID does not exist"
Aug 04 19:24:42.327247 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.327178    2558 scope.go:117] "RemoveContainer" containerID="5f4d3011078675a21ec50b1c6512af7621b7cf5e19964c0276ffde2d7045a36d"
Aug 04 19:24:42.334579 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.334562    2558 scope.go:117] "RemoveContainer" containerID="5f4d3011078675a21ec50b1c6512af7621b7cf5e19964c0276ffde2d7045a36d"
Aug 04 19:24:42.334912 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:24:42.334892    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f4d3011078675a21ec50b1c6512af7621b7cf5e19964c0276ffde2d7045a36d\": container with ID starting with 5f4d3011078675a21ec50b1c6512af7621b7cf5e19964c0276ffde2d7045a36d not found: ID does not exist" containerID="5f4d3011078675a21ec50b1c6512af7621b7cf5e19964c0276ffde2d7045a36d"
Aug 04 19:24:42.334988 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.334920    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f4d3011078675a21ec50b1c6512af7621b7cf5e19964c0276ffde2d7045a36d"} err="failed to get container status \"5f4d3011078675a21ec50b1c6512af7621b7cf5e19964c0276ffde2d7045a36d\": rpc error: code = NotFound desc = could not find container \"5f4d3011078675a21ec50b1c6512af7621b7cf5e19964c0276ffde2d7045a36d\": container with ID starting with 5f4d3011078675a21ec50b1c6512af7621b7cf5e19964c0276ffde2d7045a36d not found: ID does not exist"
Aug 04 19:24:42.348327 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.348306    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx"]
Aug 04 19:24:42.364905 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.364883    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-249eef-9b867c498-t2nbx"]
Aug 04 19:24:42.388672 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.388644    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm"]
Aug 04 19:24:42.397675 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.397653    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm"]
Aug 04 19:24:42.407065 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.407045    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e15d7b24-f581-4253-be52-ec32461ea183-plugins-config-volume\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:24:42.407065 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.407066    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsd7k\" (UniqueName: \"kubernetes.io/projected/e15d7b24-f581-4253-be52-ec32461ea183-kube-api-access-gsd7k\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:24:42.407187 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.407077    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vbqj\" (UniqueName: \"kubernetes.io/projected/7e23e099-0e47-4671-a2a1-e08c1cccbc10-kube-api-access-7vbqj\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:24:42.634201 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.634165    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w"]
Aug 04 19:24:42.638169 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:42.638140    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w"]
Aug 04 19:24:43.963818 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:43.963790    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38844ba6-f29a-4804-abe7-06c4e46aa049" path="/var/lib/kubelet/pods/38844ba6-f29a-4804-abe7-06c4e46aa049/volumes"
Aug 04 19:24:43.964195 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:43.964135    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e23e099-0e47-4671-a2a1-e08c1cccbc10" path="/var/lib/kubelet/pods/7e23e099-0e47-4671-a2a1-e08c1cccbc10/volumes"
Aug 04 19:24:43.964446 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:24:43.964433    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e15d7b24-f581-4253-be52-ec32461ea183" path="/var/lib/kubelet/pods/e15d7b24-f581-4253-be52-ec32461ea183/volumes"
Aug 04 19:25:07.965310 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:07.965273    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq"]
Aug 04 19:25:07.965794 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:07.965485    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq" podUID="a4b6a6b8-a1d4-4e77-a077-07c564d00d01" containerName="maas-api" containerID="cri-o://15555eb0c29ebd7dc3442a1883a02c126cfcc2b2e8e897ee7e7293a3315da715" gracePeriod=30
Aug 04 19:25:08.012217 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.012183    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5"]
Aug 04 19:25:08.012834 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.012783    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5" podUID="c00c769d-1ff3-4a46-967f-ae9a3a015486" containerName="payload-processing" containerID="cri-o://50fc28e64ee86dc500612f04e61af333709fdd6d640a74bdfe1b51ab1e9c7704" gracePeriod=30
Aug 04 19:25:08.282290 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.282255    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5"
Aug 04 19:25:08.312393 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.312367    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq"
Aug 04 19:25:08.334506 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.334477    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c00c769d-1ff3-4a46-967f-ae9a3a015486-plugins-config-volume\") pod \"c00c769d-1ff3-4a46-967f-ae9a3a015486\" (UID: \"c00c769d-1ff3-4a46-967f-ae9a3a015486\") "
Aug 04 19:25:08.334710 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.334569    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srmw9\" (UniqueName: \"kubernetes.io/projected/c00c769d-1ff3-4a46-967f-ae9a3a015486-kube-api-access-srmw9\") pod \"c00c769d-1ff3-4a46-967f-ae9a3a015486\" (UID: \"c00c769d-1ff3-4a46-967f-ae9a3a015486\") "
Aug 04 19:25:08.335044 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.335018    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c00c769d-1ff3-4a46-967f-ae9a3a015486-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c00c769d-1ff3-4a46-967f-ae9a3a015486" (UID: "c00c769d-1ff3-4a46-967f-ae9a3a015486"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:25:08.336853 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.336830    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c00c769d-1ff3-4a46-967f-ae9a3a015486-kube-api-access-srmw9" (OuterVolumeSpecName: "kube-api-access-srmw9") pod "c00c769d-1ff3-4a46-967f-ae9a3a015486" (UID: "c00c769d-1ff3-4a46-967f-ae9a3a015486"). InnerVolumeSpecName "kube-api-access-srmw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:25:08.436187 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.436148    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hq8f2\" (UniqueName: \"kubernetes.io/projected/a4b6a6b8-a1d4-4e77-a077-07c564d00d01-kube-api-access-hq8f2\") pod \"a4b6a6b8-a1d4-4e77-a077-07c564d00d01\" (UID: \"a4b6a6b8-a1d4-4e77-a077-07c564d00d01\") "
Aug 04 19:25:08.436187 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.436192    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4b6a6b8-a1d4-4e77-a077-07c564d00d01-openshift-service-ca\") pod \"a4b6a6b8-a1d4-4e77-a077-07c564d00d01\" (UID: \"a4b6a6b8-a1d4-4e77-a077-07c564d00d01\") "
Aug 04 19:25:08.436443 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.436222    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4b6a6b8-a1d4-4e77-a077-07c564d00d01-maas-api-tls\") pod \"a4b6a6b8-a1d4-4e77-a077-07c564d00d01\" (UID: \"a4b6a6b8-a1d4-4e77-a077-07c564d00d01\") "
Aug 04 19:25:08.436443 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.436389    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srmw9\" (UniqueName: \"kubernetes.io/projected/c00c769d-1ff3-4a46-967f-ae9a3a015486-kube-api-access-srmw9\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:25:08.436443 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.436404    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c00c769d-1ff3-4a46-967f-ae9a3a015486-plugins-config-volume\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:25:08.436716 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.436686    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4b6a6b8-a1d4-4e77-a077-07c564d00d01-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a4b6a6b8-a1d4-4e77-a077-07c564d00d01" (UID: "a4b6a6b8-a1d4-4e77-a077-07c564d00d01"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:25:08.438473 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.438448    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4b6a6b8-a1d4-4e77-a077-07c564d00d01-kube-api-access-hq8f2" (OuterVolumeSpecName: "kube-api-access-hq8f2") pod "a4b6a6b8-a1d4-4e77-a077-07c564d00d01" (UID: "a4b6a6b8-a1d4-4e77-a077-07c564d00d01"). InnerVolumeSpecName "kube-api-access-hq8f2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:25:08.438588 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.438474    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4b6a6b8-a1d4-4e77-a077-07c564d00d01-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a4b6a6b8-a1d4-4e77-a077-07c564d00d01" (UID: "a4b6a6b8-a1d4-4e77-a077-07c564d00d01"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:25:08.441748 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.441727    2558 generic.go:356] "Generic (PLEG): container finished" podID="c00c769d-1ff3-4a46-967f-ae9a3a015486" containerID="50fc28e64ee86dc500612f04e61af333709fdd6d640a74bdfe1b51ab1e9c7704" exitCode=0
Aug 04 19:25:08.441812 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.441769    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5"
Aug 04 19:25:08.441863 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.441802    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5" event={"ID":"c00c769d-1ff3-4a46-967f-ae9a3a015486","Type":"ContainerDied","Data":"50fc28e64ee86dc500612f04e61af333709fdd6d640a74bdfe1b51ab1e9c7704"}
Aug 04 19:25:08.441863 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.441850    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5" event={"ID":"c00c769d-1ff3-4a46-967f-ae9a3a015486","Type":"ContainerDied","Data":"6e52984bae8ed9e0d5a2538827dc6edf75d7dc6ab8ee176d7d8412aeb7f7002f"}
Aug 04 19:25:08.441965 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.441876    2558 scope.go:117] "RemoveContainer" containerID="50fc28e64ee86dc500612f04e61af333709fdd6d640a74bdfe1b51ab1e9c7704"
Aug 04 19:25:08.443190 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.443171    2558 generic.go:356] "Generic (PLEG): container finished" podID="a4b6a6b8-a1d4-4e77-a077-07c564d00d01" containerID="15555eb0c29ebd7dc3442a1883a02c126cfcc2b2e8e897ee7e7293a3315da715" exitCode=0
Aug 04 19:25:08.443277 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.443204    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq" event={"ID":"a4b6a6b8-a1d4-4e77-a077-07c564d00d01","Type":"ContainerDied","Data":"15555eb0c29ebd7dc3442a1883a02c126cfcc2b2e8e897ee7e7293a3315da715"}
Aug 04 19:25:08.443277 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.443236    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq" event={"ID":"a4b6a6b8-a1d4-4e77-a077-07c564d00d01","Type":"ContainerDied","Data":"dc65595f795592b2933aa7cc40ac347f57c3003b9c0ee7f430c92477e109acca"}
Aug 04 19:25:08.443277 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.443251    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq"
Aug 04 19:25:08.450597 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.450557    2558 scope.go:117] "RemoveContainer" containerID="50fc28e64ee86dc500612f04e61af333709fdd6d640a74bdfe1b51ab1e9c7704"
Aug 04 19:25:08.450888 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:25:08.450854    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50fc28e64ee86dc500612f04e61af333709fdd6d640a74bdfe1b51ab1e9c7704\": container with ID starting with 50fc28e64ee86dc500612f04e61af333709fdd6d640a74bdfe1b51ab1e9c7704 not found: ID does not exist" containerID="50fc28e64ee86dc500612f04e61af333709fdd6d640a74bdfe1b51ab1e9c7704"
Aug 04 19:25:08.450957 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.450887    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50fc28e64ee86dc500612f04e61af333709fdd6d640a74bdfe1b51ab1e9c7704"} err="failed to get container status \"50fc28e64ee86dc500612f04e61af333709fdd6d640a74bdfe1b51ab1e9c7704\": rpc error: code = NotFound desc = could not find container \"50fc28e64ee86dc500612f04e61af333709fdd6d640a74bdfe1b51ab1e9c7704\": container with ID starting with 50fc28e64ee86dc500612f04e61af333709fdd6d640a74bdfe1b51ab1e9c7704 not found: ID does not exist"
Aug 04 19:25:08.450957 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.450927    2558 scope.go:117] "RemoveContainer" containerID="15555eb0c29ebd7dc3442a1883a02c126cfcc2b2e8e897ee7e7293a3315da715"
Aug 04 19:25:08.458921 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.458905    2558 scope.go:117] "RemoveContainer" containerID="15555eb0c29ebd7dc3442a1883a02c126cfcc2b2e8e897ee7e7293a3315da715"
Aug 04 19:25:08.459198 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:25:08.459179    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15555eb0c29ebd7dc3442a1883a02c126cfcc2b2e8e897ee7e7293a3315da715\": container with ID starting with 15555eb0c29ebd7dc3442a1883a02c126cfcc2b2e8e897ee7e7293a3315da715 not found: ID does not exist" containerID="15555eb0c29ebd7dc3442a1883a02c126cfcc2b2e8e897ee7e7293a3315da715"
Aug 04 19:25:08.459246 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.459207    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15555eb0c29ebd7dc3442a1883a02c126cfcc2b2e8e897ee7e7293a3315da715"} err="failed to get container status \"15555eb0c29ebd7dc3442a1883a02c126cfcc2b2e8e897ee7e7293a3315da715\": rpc error: code = NotFound desc = could not find container \"15555eb0c29ebd7dc3442a1883a02c126cfcc2b2e8e897ee7e7293a3315da715\": container with ID starting with 15555eb0c29ebd7dc3442a1883a02c126cfcc2b2e8e897ee7e7293a3315da715 not found: ID does not exist"
Aug 04 19:25:08.465910 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.465881    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq"]
Aug 04 19:25:08.470154 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.470131    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-f3a5e8-784774864d-mv8rq"]
Aug 04 19:25:08.483362 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.483291    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5"]
Aug 04 19:25:08.486944 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.486918    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5"]
Aug 04 19:25:08.537122 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.537090    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hq8f2\" (UniqueName: \"kubernetes.io/projected/a4b6a6b8-a1d4-4e77-a077-07c564d00d01-kube-api-access-hq8f2\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:25:08.537122 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.537118    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4b6a6b8-a1d4-4e77-a077-07c564d00d01-openshift-service-ca\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:25:08.537122 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:08.537129    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4b6a6b8-a1d4-4e77-a077-07c564d00d01-maas-api-tls\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:25:09.965345 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:09.965312    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4b6a6b8-a1d4-4e77-a077-07c564d00d01" path="/var/lib/kubelet/pods/a4b6a6b8-a1d4-4e77-a077-07c564d00d01/volumes"
Aug 04 19:25:09.965737 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:25:09.965693    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c00c769d-1ff3-4a46-967f-ae9a3a015486" path="/var/lib/kubelet/pods/c00c769d-1ff3-4a46-967f-ae9a3a015486/volumes"
Aug 04 19:26:14.273502 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:14.273465    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk"]
Aug 04 19:26:14.274319 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:14.274261    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk" podUID="3e7cd54e-e8c8-4ade-b381-18f70319bf74" containerName="payload-pre-processing" containerID="cri-o://155c50369b002a8e99f1a2f8d6593ae4ebfdcfe038d0688d2b972cd26108a8d6" gracePeriod=30
Aug 04 19:26:14.535885 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:14.535825    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk"
Aug 04 19:26:14.633399 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:14.633368    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dmzf\" (UniqueName: \"kubernetes.io/projected/3e7cd54e-e8c8-4ade-b381-18f70319bf74-kube-api-access-7dmzf\") pod \"3e7cd54e-e8c8-4ade-b381-18f70319bf74\" (UID: \"3e7cd54e-e8c8-4ade-b381-18f70319bf74\") "
Aug 04 19:26:14.633580 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:14.633480    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e7cd54e-e8c8-4ade-b381-18f70319bf74-plugins-config-volume\") pod \"3e7cd54e-e8c8-4ade-b381-18f70319bf74\" (UID: \"3e7cd54e-e8c8-4ade-b381-18f70319bf74\") "
Aug 04 19:26:14.633865 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:14.633840    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e7cd54e-e8c8-4ade-b381-18f70319bf74-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3e7cd54e-e8c8-4ade-b381-18f70319bf74" (UID: "3e7cd54e-e8c8-4ade-b381-18f70319bf74"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:26:14.635503 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:14.635482    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e7cd54e-e8c8-4ade-b381-18f70319bf74-kube-api-access-7dmzf" (OuterVolumeSpecName: "kube-api-access-7dmzf") pod "3e7cd54e-e8c8-4ade-b381-18f70319bf74" (UID: "3e7cd54e-e8c8-4ade-b381-18f70319bf74"). InnerVolumeSpecName "kube-api-access-7dmzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:26:14.735002 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:14.734968    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e7cd54e-e8c8-4ade-b381-18f70319bf74-plugins-config-volume\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:26:14.735002 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:14.734993    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dmzf\" (UniqueName: \"kubernetes.io/projected/3e7cd54e-e8c8-4ade-b381-18f70319bf74-kube-api-access-7dmzf\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:26:14.756137 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:14.756108    2558 generic.go:356] "Generic (PLEG): container finished" podID="3e7cd54e-e8c8-4ade-b381-18f70319bf74" containerID="155c50369b002a8e99f1a2f8d6593ae4ebfdcfe038d0688d2b972cd26108a8d6" exitCode=0
Aug 04 19:26:14.756285 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:14.756155    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk"
Aug 04 19:26:14.756285 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:14.756153    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk" event={"ID":"3e7cd54e-e8c8-4ade-b381-18f70319bf74","Type":"ContainerDied","Data":"155c50369b002a8e99f1a2f8d6593ae4ebfdcfe038d0688d2b972cd26108a8d6"}
Aug 04 19:26:14.756285 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:14.756269    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk" event={"ID":"3e7cd54e-e8c8-4ade-b381-18f70319bf74","Type":"ContainerDied","Data":"0548cf6be5b13d31a6ecd4c4be64005a6cf8f1451b32021ece6c6bf645e24715"}
Aug 04 19:26:14.756447 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:14.756292    2558 scope.go:117] "RemoveContainer" containerID="155c50369b002a8e99f1a2f8d6593ae4ebfdcfe038d0688d2b972cd26108a8d6"
Aug 04 19:26:14.764788 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:14.764770    2558 scope.go:117] "RemoveContainer" containerID="155c50369b002a8e99f1a2f8d6593ae4ebfdcfe038d0688d2b972cd26108a8d6"
Aug 04 19:26:14.764999 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:26:14.764981    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"155c50369b002a8e99f1a2f8d6593ae4ebfdcfe038d0688d2b972cd26108a8d6\": container with ID starting with 155c50369b002a8e99f1a2f8d6593ae4ebfdcfe038d0688d2b972cd26108a8d6 not found: ID does not exist" containerID="155c50369b002a8e99f1a2f8d6593ae4ebfdcfe038d0688d2b972cd26108a8d6"
Aug 04 19:26:14.765085 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:14.765007    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"155c50369b002a8e99f1a2f8d6593ae4ebfdcfe038d0688d2b972cd26108a8d6"} err="failed to get container status \"155c50369b002a8e99f1a2f8d6593ae4ebfdcfe038d0688d2b972cd26108a8d6\": rpc error: code = NotFound desc = could not find container \"155c50369b002a8e99f1a2f8d6593ae4ebfdcfe038d0688d2b972cd26108a8d6\": container with ID starting with 155c50369b002a8e99f1a2f8d6593ae4ebfdcfe038d0688d2b972cd26108a8d6 not found: ID does not exist"
Aug 04 19:26:14.776770 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:14.776748    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk"]
Aug 04 19:26:14.780747 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:14.780727    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk"]
Aug 04 19:26:15.963417 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:15.963387    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e7cd54e-e8c8-4ade-b381-18f70319bf74" path="/var/lib/kubelet/pods/3e7cd54e-e8c8-4ade-b381-18f70319bf74/volumes"
Aug 04 19:26:32.781476 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:32.781439    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6"]
Aug 04 19:26:32.782025 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:32.781664    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6" podUID="16598780-0242-4059-a70f-a4c08c038219" containerName="maas-api" containerID="cri-o://2f8a9f81632fa13392bbe834f8369fea28ce017ccea3c7f54527c9a8fc1596af" gracePeriod=30
Aug 04 19:26:32.845027 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:32.844995    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt"]
Aug 04 19:26:32.845242 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:32.845218    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt" podUID="7e1e27d1-dabe-485a-861f-57aed52f93dc" containerName="payload-processing" containerID="cri-o://d5e05e8b7e25dd3d1cdeaccd063c9717ae05feb22a78152456b5893c53965c49" gracePeriod=30
Aug 04 19:26:33.097083 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.097060    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6"
Aug 04 19:26:33.129889 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.129868    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt"
Aug 04 19:26:33.196753 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.196722    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e1e27d1-dabe-485a-861f-57aed52f93dc-plugins-config-volume\") pod \"7e1e27d1-dabe-485a-861f-57aed52f93dc\" (UID: \"7e1e27d1-dabe-485a-861f-57aed52f93dc\") "
Aug 04 19:26:33.196925 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.196783    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bv98\" (UniqueName: \"kubernetes.io/projected/16598780-0242-4059-a70f-a4c08c038219-kube-api-access-9bv98\") pod \"16598780-0242-4059-a70f-a4c08c038219\" (UID: \"16598780-0242-4059-a70f-a4c08c038219\") "
Aug 04 19:26:33.196992 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.196962    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16598780-0242-4059-a70f-a4c08c038219-maas-api-tls\") pod \"16598780-0242-4059-a70f-a4c08c038219\" (UID: \"16598780-0242-4059-a70f-a4c08c038219\") "
Aug 04 19:26:33.197050 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.197016    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtsmk\" (UniqueName: \"kubernetes.io/projected/7e1e27d1-dabe-485a-861f-57aed52f93dc-kube-api-access-dtsmk\") pod \"7e1e27d1-dabe-485a-861f-57aed52f93dc\" (UID: \"7e1e27d1-dabe-485a-861f-57aed52f93dc\") "
Aug 04 19:26:33.197109 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.197083    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16598780-0242-4059-a70f-a4c08c038219-openshift-service-ca\") pod \"16598780-0242-4059-a70f-a4c08c038219\" (UID: \"16598780-0242-4059-a70f-a4c08c038219\") "
Aug 04 19:26:33.197197 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.197172    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e1e27d1-dabe-485a-861f-57aed52f93dc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7e1e27d1-dabe-485a-861f-57aed52f93dc" (UID: "7e1e27d1-dabe-485a-861f-57aed52f93dc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:26:33.197482 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.197451    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e1e27d1-dabe-485a-861f-57aed52f93dc-plugins-config-volume\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:26:33.197596 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.197488    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16598780-0242-4059-a70f-a4c08c038219-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "16598780-0242-4059-a70f-a4c08c038219" (UID: "16598780-0242-4059-a70f-a4c08c038219"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:26:33.198967 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.198937    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16598780-0242-4059-a70f-a4c08c038219-kube-api-access-9bv98" (OuterVolumeSpecName: "kube-api-access-9bv98") pod "16598780-0242-4059-a70f-a4c08c038219" (UID: "16598780-0242-4059-a70f-a4c08c038219"). InnerVolumeSpecName "kube-api-access-9bv98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:26:33.199075 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.199010    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16598780-0242-4059-a70f-a4c08c038219-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "16598780-0242-4059-a70f-a4c08c038219" (UID: "16598780-0242-4059-a70f-a4c08c038219"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:26:33.199124 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.199069    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e1e27d1-dabe-485a-861f-57aed52f93dc-kube-api-access-dtsmk" (OuterVolumeSpecName: "kube-api-access-dtsmk") pod "7e1e27d1-dabe-485a-861f-57aed52f93dc" (UID: "7e1e27d1-dabe-485a-861f-57aed52f93dc"). InnerVolumeSpecName "kube-api-access-dtsmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:26:33.298891 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.298854    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtsmk\" (UniqueName: \"kubernetes.io/projected/7e1e27d1-dabe-485a-861f-57aed52f93dc-kube-api-access-dtsmk\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:26:33.298891 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.298884    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16598780-0242-4059-a70f-a4c08c038219-openshift-service-ca\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:26:33.298891 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.298896    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bv98\" (UniqueName: \"kubernetes.io/projected/16598780-0242-4059-a70f-a4c08c038219-kube-api-access-9bv98\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:26:33.299126 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.298910    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16598780-0242-4059-a70f-a4c08c038219-maas-api-tls\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:26:33.846884 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.846848    2558 generic.go:356] "Generic (PLEG): container finished" podID="16598780-0242-4059-a70f-a4c08c038219" containerID="2f8a9f81632fa13392bbe834f8369fea28ce017ccea3c7f54527c9a8fc1596af" exitCode=0
Aug 04 19:26:33.847371 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.846893    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6"
Aug 04 19:26:33.847371 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.846926    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6" event={"ID":"16598780-0242-4059-a70f-a4c08c038219","Type":"ContainerDied","Data":"2f8a9f81632fa13392bbe834f8369fea28ce017ccea3c7f54527c9a8fc1596af"}
Aug 04 19:26:33.847371 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.846980    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6" event={"ID":"16598780-0242-4059-a70f-a4c08c038219","Type":"ContainerDied","Data":"50b7964c0a8e92744868358408f1b8d172d3278351a34b4ae53b65ecbb6d3d40"}
Aug 04 19:26:33.847371 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.847010    2558 scope.go:117] "RemoveContainer" containerID="2f8a9f81632fa13392bbe834f8369fea28ce017ccea3c7f54527c9a8fc1596af"
Aug 04 19:26:33.848409 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.848395    2558 generic.go:356] "Generic (PLEG): container finished" podID="7e1e27d1-dabe-485a-861f-57aed52f93dc" containerID="d5e05e8b7e25dd3d1cdeaccd063c9717ae05feb22a78152456b5893c53965c49" exitCode=0
Aug 04 19:26:33.848491 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.848436    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt" event={"ID":"7e1e27d1-dabe-485a-861f-57aed52f93dc","Type":"ContainerDied","Data":"d5e05e8b7e25dd3d1cdeaccd063c9717ae05feb22a78152456b5893c53965c49"}
Aug 04 19:26:33.850716 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.848854    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt" event={"ID":"7e1e27d1-dabe-485a-861f-57aed52f93dc","Type":"ContainerDied","Data":"ddb1ea742f43002490114ad3610322af5a2088d1e949f70faae0fecb8e14b121"}
Aug 04 19:26:33.850716 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.848856    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt"
Aug 04 19:26:33.858851 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.858827    2558 scope.go:117] "RemoveContainer" containerID="2f8a9f81632fa13392bbe834f8369fea28ce017ccea3c7f54527c9a8fc1596af"
Aug 04 19:26:33.859269 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:26:33.859242    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f8a9f81632fa13392bbe834f8369fea28ce017ccea3c7f54527c9a8fc1596af\": container with ID starting with 2f8a9f81632fa13392bbe834f8369fea28ce017ccea3c7f54527c9a8fc1596af not found: ID does not exist" containerID="2f8a9f81632fa13392bbe834f8369fea28ce017ccea3c7f54527c9a8fc1596af"
Aug 04 19:26:33.859359 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.859280    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f8a9f81632fa13392bbe834f8369fea28ce017ccea3c7f54527c9a8fc1596af"} err="failed to get container status \"2f8a9f81632fa13392bbe834f8369fea28ce017ccea3c7f54527c9a8fc1596af\": rpc error: code = NotFound desc = could not find container \"2f8a9f81632fa13392bbe834f8369fea28ce017ccea3c7f54527c9a8fc1596af\": container with ID starting with 2f8a9f81632fa13392bbe834f8369fea28ce017ccea3c7f54527c9a8fc1596af not found: ID does not exist"
Aug 04 19:26:33.859359 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.859306    2558 scope.go:117] "RemoveContainer" containerID="d5e05e8b7e25dd3d1cdeaccd063c9717ae05feb22a78152456b5893c53965c49"
Aug 04 19:26:33.870510 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.870489    2558 scope.go:117] "RemoveContainer" containerID="d5e05e8b7e25dd3d1cdeaccd063c9717ae05feb22a78152456b5893c53965c49"
Aug 04 19:26:33.870975 ip-10-0-132-214 kubenswrapper[2558]: E0804 19:26:33.870954    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5e05e8b7e25dd3d1cdeaccd063c9717ae05feb22a78152456b5893c53965c49\": container with ID starting with d5e05e8b7e25dd3d1cdeaccd063c9717ae05feb22a78152456b5893c53965c49 not found: ID does not exist" containerID="d5e05e8b7e25dd3d1cdeaccd063c9717ae05feb22a78152456b5893c53965c49"
Aug 04 19:26:33.871061 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.870985    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5e05e8b7e25dd3d1cdeaccd063c9717ae05feb22a78152456b5893c53965c49"} err="failed to get container status \"d5e05e8b7e25dd3d1cdeaccd063c9717ae05feb22a78152456b5893c53965c49\": rpc error: code = NotFound desc = could not find container \"d5e05e8b7e25dd3d1cdeaccd063c9717ae05feb22a78152456b5893c53965c49\": container with ID starting with d5e05e8b7e25dd3d1cdeaccd063c9717ae05feb22a78152456b5893c53965c49 not found: ID does not exist"
Aug 04 19:26:33.877483 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.877428    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6"]
Aug 04 19:26:33.879334 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.879313    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1d2c46-c996756bb-mtnm6"]
Aug 04 19:26:33.895210 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.895188    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt"]
Aug 04 19:26:33.898533 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.898512    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt"]
Aug 04 19:26:33.963661 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.963616    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16598780-0242-4059-a70f-a4c08c038219" path="/var/lib/kubelet/pods/16598780-0242-4059-a70f-a4c08c038219/volumes"
Aug 04 19:26:33.964012 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:33.963999    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e1e27d1-dabe-485a-861f-57aed52f93dc" path="/var/lib/kubelet/pods/7e1e27d1-dabe-485a-861f-57aed52f93dc/volumes"
Aug 04 19:26:50.783620 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:50.783568    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb"]
Aug 04 19:26:50.784099 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:50.783847    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb" podUID="e883720f-7589-4cb8-8f74-2486f4f1d094" containerName="maas-api" containerID="cri-o://60abf70c917c6e58d99f727da2de68449197e0983ad6762766dd5ad7182a3f31" gracePeriod=30
Aug 04 19:26:50.932162 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:50.932119    2558 generic.go:356] "Generic (PLEG): container finished" podID="e883720f-7589-4cb8-8f74-2486f4f1d094" containerID="60abf70c917c6e58d99f727da2de68449197e0983ad6762766dd5ad7182a3f31" exitCode=0
Aug 04 19:26:50.932340 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:50.932194    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb" event={"ID":"e883720f-7589-4cb8-8f74-2486f4f1d094","Type":"ContainerDied","Data":"60abf70c917c6e58d99f727da2de68449197e0983ad6762766dd5ad7182a3f31"}
Aug 04 19:26:51.044078 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:51.044013    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb"
Aug 04 19:26:51.161729 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:51.161671    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e883720f-7589-4cb8-8f74-2486f4f1d094-maas-api-tls\") pod \"e883720f-7589-4cb8-8f74-2486f4f1d094\" (UID: \"e883720f-7589-4cb8-8f74-2486f4f1d094\") "
Aug 04 19:26:51.161729 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:51.161731    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4ls8\" (UniqueName: \"kubernetes.io/projected/e883720f-7589-4cb8-8f74-2486f4f1d094-kube-api-access-n4ls8\") pod \"e883720f-7589-4cb8-8f74-2486f4f1d094\" (UID: \"e883720f-7589-4cb8-8f74-2486f4f1d094\") "
Aug 04 19:26:51.162077 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:51.161849    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e883720f-7589-4cb8-8f74-2486f4f1d094-openshift-service-ca\") pod \"e883720f-7589-4cb8-8f74-2486f4f1d094\" (UID: \"e883720f-7589-4cb8-8f74-2486f4f1d094\") "
Aug 04 19:26:51.162350 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:51.162270    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e883720f-7589-4cb8-8f74-2486f4f1d094-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e883720f-7589-4cb8-8f74-2486f4f1d094" (UID: "e883720f-7589-4cb8-8f74-2486f4f1d094"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:26:51.164350 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:51.164307    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e883720f-7589-4cb8-8f74-2486f4f1d094-kube-api-access-n4ls8" (OuterVolumeSpecName: "kube-api-access-n4ls8") pod "e883720f-7589-4cb8-8f74-2486f4f1d094" (UID: "e883720f-7589-4cb8-8f74-2486f4f1d094"). InnerVolumeSpecName "kube-api-access-n4ls8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:26:51.164467 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:51.164370    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e883720f-7589-4cb8-8f74-2486f4f1d094-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e883720f-7589-4cb8-8f74-2486f4f1d094" (UID: "e883720f-7589-4cb8-8f74-2486f4f1d094"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:26:51.263310 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:51.263254    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e883720f-7589-4cb8-8f74-2486f4f1d094-openshift-service-ca\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:26:51.263310 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:51.263304    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e883720f-7589-4cb8-8f74-2486f4f1d094-maas-api-tls\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:26:51.263310 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:51.263313    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4ls8\" (UniqueName: \"kubernetes.io/projected/e883720f-7589-4cb8-8f74-2486f4f1d094-kube-api-access-n4ls8\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\""
Aug 04 19:26:51.938703 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:51.938666    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb" event={"ID":"e883720f-7589-4cb8-8f74-2486f4f1d094","Type":"ContainerDied","Data":"00041bc94de0c1b685db30b8f0f7cdab510ac4d14eef3d496e3f97c6837ae345"}
Aug 04 19:26:51.939181 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:51.938717    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb"
Aug 04 19:26:51.939181 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:51.938758    2558 scope.go:117] "RemoveContainer" containerID="60abf70c917c6e58d99f727da2de68449197e0983ad6762766dd5ad7182a3f31"
Aug 04 19:26:51.963993 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:51.963954    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb"]
Aug 04 19:26:51.965876 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:51.965849    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1a00f6-d9dbd5567-j2fhb"]
Aug 04 19:26:53.962929 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:26:53.962899    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e883720f-7589-4cb8-8f74-2486f4f1d094" path="/var/lib/kubelet/pods/e883720f-7589-4cb8-8f74-2486f4f1d094/volumes"
Aug 04 19:27:04.187820 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:04.187786    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-549599b85-k65h8_93984f28-492d-4655-aeb6-8347387196de/manager/0.log"
Aug 04 19:27:04.511201 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:04.511122    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5556d6485b-b9m4z_41f767fb-2927-4157-b2e4-4c00fb41bfa5/copy-manifests/0.log"
Aug 04 19:27:04.517673 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:04.517623    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5556d6485b-b9m4z_41f767fb-2927-4157-b2e4-4c00fb41bfa5/manager/0.log"
Aug 04 19:27:05.091124 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:05.091096    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6cbd958b9d-rmhd8_6b0fc874-c6be-4667-8361-c68235b4174b/maas-api/0.log"
Aug 04 19:27:05.548377 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:05.548350    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-mcff7_e78ebb59-7ab9-4460-aa75-1d8cd044639d/postgres/0.log"
Aug 04 19:27:07.382390 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:07.382355    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-znd67_99cab7b9-099b-4b1f-bfd5-ae34ca916791/discovery/0.log"
Aug 04 19:27:07.945578 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:07.945546    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-km5dc_c846dd43-dccc-4edf-9893-358dd6e879c1/payload-processing/0.log"
Aug 04 19:27:08.051218 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:08.051187    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cd44fddd-7k9f2_0319a4e0-2f16-49bb-863b-c563db4af7f4/router/0.log"
Aug 04 19:27:08.376743 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:08.376667    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-h669v_5feecb2c-b22d-4b99-b32d-4cbb02e1759d/main/0.log"
Aug 04 19:27:08.695535 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:08.695508    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqr5fw_8d4fc0cd-6416-4d06-bfbe-2044bfedd486/main/0.log"
Aug 04 19:27:08.804352 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:08.804318    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-5ptcb_fa20364a-e43d-4cc0-90db-d25b8d2532c4/main/0.log"
Aug 04 19:27:17.892274 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:17.892233    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9jgn2_587a9fe3-615e-41e1-bebf-6291030112c3/global-pull-secret-syncer/0.log"
Aug 04 19:27:18.172463 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:18.172376    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-q6q26_31ea8e3e-777a-458b-93bf-67b8e504709c/konnectivity-agent/0.log"
Aug 04 19:27:18.299688 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:18.299656    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-214.ec2.internal_5e707b88f4e7c983d7d792d407b11403/haproxy/0.log"
Aug 04 19:27:25.098976 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:25.098943    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-48gmb_dbe35e11-686b-4b4d-8211-ab29d33e0de3/cluster-monitoring-operator/0.log"
Aug 04 19:27:25.266468 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:25.266438    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-2mn69_bcc52925-e69f-449e-a577-30c998155b50/monitoring-plugin/0.log"
Aug 04 19:27:25.533432 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:25.533393    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kv5wg_db101da5-7c37-432e-933f-ab952094713e/node-exporter/0.log"
Aug 04 19:27:25.564783 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:25.564755    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kv5wg_db101da5-7c37-432e-933f-ab952094713e/kube-rbac-proxy/0.log"
Aug 04 19:27:25.600131 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:25.600108    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kv5wg_db101da5-7c37-432e-933f-ab952094713e/init-textfile/0.log"
Aug 04 19:27:25.751481 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:25.751460    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3f3f3709-a748-46e9-9e4f-85827cfef2ab/prometheus/0.log"
Aug 04 19:27:25.778652 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:25.778606    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3f3f3709-a748-46e9-9e4f-85827cfef2ab/config-reloader/0.log"
Aug 04 19:27:25.806992 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:25.806949    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3f3f3709-a748-46e9-9e4f-85827cfef2ab/thanos-sidecar/0.log"
Aug 04 19:27:25.840643 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:25.840617    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3f3f3709-a748-46e9-9e4f-85827cfef2ab/kube-rbac-proxy-web/0.log"
Aug 04 19:27:25.874919 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:25.874894    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3f3f3709-a748-46e9-9e4f-85827cfef2ab/kube-rbac-proxy/0.log"
Aug 04 19:27:25.906183 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:25.906161    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3f3f3709-a748-46e9-9e4f-85827cfef2ab/kube-rbac-proxy-thanos/0.log"
Aug 04 19:27:25.948029 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:25.947980    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3f3f3709-a748-46e9-9e4f-85827cfef2ab/init-config-reloader/0.log"
Aug 04 19:27:28.596188 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596157    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf"]
Aug 04 19:27:28.596570 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596521    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e883720f-7589-4cb8-8f74-2486f4f1d094" containerName="maas-api"
Aug 04 19:27:28.596570 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596532    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e883720f-7589-4cb8-8f74-2486f4f1d094" containerName="maas-api"
Aug 04 19:27:28.596570 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596545    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e15d7b24-f581-4253-be52-ec32461ea183" containerName="payload-pre-processing"
Aug 04 19:27:28.596570 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596551    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e15d7b24-f581-4253-be52-ec32461ea183" containerName="payload-pre-processing"
Aug 04 19:27:28.596570 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596561    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38844ba6-f29a-4804-abe7-06c4e46aa049" containerName="maas-api"
Aug 04 19:27:28.596570 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596567    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="38844ba6-f29a-4804-abe7-06c4e46aa049" containerName="maas-api"
Aug 04 19:27:28.596772 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596575    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c00c769d-1ff3-4a46-967f-ae9a3a015486" containerName="payload-processing"
Aug 04 19:27:28.596772 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596580    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c00c769d-1ff3-4a46-967f-ae9a3a015486" containerName="payload-processing"
Aug 04 19:27:28.596772 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596588    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e1e27d1-dabe-485a-861f-57aed52f93dc" containerName="payload-processing"
Aug 04 19:27:28.596772 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596594    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e1e27d1-dabe-485a-861f-57aed52f93dc" containerName="payload-processing"
Aug 04 19:27:28.596772 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596600    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e23e099-0e47-4671-a2a1-e08c1cccbc10" containerName="payload-processing"
Aug 04 19:27:28.596772 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596605    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e23e099-0e47-4671-a2a1-e08c1cccbc10" containerName="payload-processing"
Aug 04 19:27:28.596772 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596612    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16598780-0242-4059-a70f-a4c08c038219" containerName="maas-api"
Aug 04 19:27:28.596772 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596617    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="16598780-0242-4059-a70f-a4c08c038219" containerName="maas-api"
Aug 04 19:27:28.596772 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596624    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e7cd54e-e8c8-4ade-b381-18f70319bf74" containerName="payload-pre-processing"
Aug 04 19:27:28.596772 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596646    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e7cd54e-e8c8-4ade-b381-18f70319bf74" containerName="payload-pre-processing"
Aug 04 19:27:28.596772 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596660    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4b6a6b8-a1d4-4e77-a077-07c564d00d01" containerName="maas-api"
Aug 04 19:27:28.596772 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596665    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4b6a6b8-a1d4-4e77-a077-07c564d00d01" containerName="maas-api"
Aug 04 19:27:28.596772 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596714    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4b6a6b8-a1d4-4e77-a077-07c564d00d01" containerName="maas-api"
Aug 04 19:27:28.596772 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596721    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="38844ba6-f29a-4804-abe7-06c4e46aa049" containerName="maas-api"
Aug 04 19:27:28.596772 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596728    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c00c769d-1ff3-4a46-967f-ae9a3a015486" containerName="payload-processing"
Aug 04 19:27:28.596772 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596735    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e883720f-7589-4cb8-8f74-2486f4f1d094" containerName="maas-api"
Aug 04 19:27:28.596772 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596739    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="16598780-0242-4059-a70f-a4c08c038219" containerName="maas-api"
Aug 04 19:27:28.596772 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596744    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e15d7b24-f581-4253-be52-ec32461ea183" containerName="payload-pre-processing"
Aug 04 19:27:28.596772 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596749    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e23e099-0e47-4671-a2a1-e08c1cccbc10" containerName="payload-processing"
Aug 04 19:27:28.596772 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596754    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e7cd54e-e8c8-4ade-b381-18f70319bf74" containerName="payload-pre-processing"
Aug 04 19:27:28.596772 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.596761    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e1e27d1-dabe-485a-861f-57aed52f93dc" containerName="payload-processing"
Aug 04 19:27:28.599890 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.599870    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf"
Aug 04 19:27:28.603755 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.603709    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-szqsg\"/\"kube-root-ca.crt\""
Aug 04 19:27:28.603922 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.603871    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-szqsg\"/\"default-dockercfg-7dnkb\""
Aug 04 19:27:28.604089 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.604064    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-szqsg\"/\"openshift-service-ca.crt\""
Aug 04 19:27:28.624725 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.624696    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf"]
Aug 04 19:27:28.698466 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.698429    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b63539bf-643c-47c0-a5a9-259dbcfa04fd-lib-modules\") pod \"perf-node-gather-daemonset-w6fzf\" (UID: \"b63539bf-643c-47c0-a5a9-259dbcfa04fd\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf"
Aug 04 19:27:28.698694 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.698490    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b63539bf-643c-47c0-a5a9-259dbcfa04fd-podres\") pod \"perf-node-gather-daemonset-w6fzf\" (UID: \"b63539bf-643c-47c0-a5a9-259dbcfa04fd\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf"
Aug 04 19:27:28.698694 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.698575    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b63539bf-643c-47c0-a5a9-259dbcfa04fd-sys\") pod \"perf-node-gather-daemonset-w6fzf\" (UID: \"b63539bf-643c-47c0-a5a9-259dbcfa04fd\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf"
Aug 04 19:27:28.698694 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.698623    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqvkq\" (UniqueName: \"kubernetes.io/projected/b63539bf-643c-47c0-a5a9-259dbcfa04fd-kube-api-access-cqvkq\") pod \"perf-node-gather-daemonset-w6fzf\" (UID: \"b63539bf-643c-47c0-a5a9-259dbcfa04fd\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf"
Aug 04 19:27:28.698694 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.698677    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b63539bf-643c-47c0-a5a9-259dbcfa04fd-proc\") pod \"perf-node-gather-daemonset-w6fzf\" (UID: \"b63539bf-643c-47c0-a5a9-259dbcfa04fd\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf"
Aug 04 19:27:28.799527 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.799464    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b63539bf-643c-47c0-a5a9-259dbcfa04fd-lib-modules\") pod \"perf-node-gather-daemonset-w6fzf\" (UID: \"b63539bf-643c-47c0-a5a9-259dbcfa04fd\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf"
Aug 04 19:27:28.799760 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.799561    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b63539bf-643c-47c0-a5a9-259dbcfa04fd-podres\") pod \"perf-node-gather-daemonset-w6fzf\" (UID: \"b63539bf-643c-47c0-a5a9-259dbcfa04fd\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf"
Aug 04 19:27:28.799760 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.799610    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b63539bf-643c-47c0-a5a9-259dbcfa04fd-sys\") pod \"perf-node-gather-daemonset-w6fzf\" (UID: \"b63539bf-643c-47c0-a5a9-259dbcfa04fd\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf"
Aug 04 19:27:28.799760 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.799672    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqvkq\" (UniqueName: \"kubernetes.io/projected/b63539bf-643c-47c0-a5a9-259dbcfa04fd-kube-api-access-cqvkq\") pod \"perf-node-gather-daemonset-w6fzf\" (UID: \"b63539bf-643c-47c0-a5a9-259dbcfa04fd\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf"
Aug 04 19:27:28.799760 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.799698    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b63539bf-643c-47c0-a5a9-259dbcfa04fd-proc\") pod \"perf-node-gather-daemonset-w6fzf\" (UID: \"b63539bf-643c-47c0-a5a9-259dbcfa04fd\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf"
Aug 04 19:27:28.799760 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.799707    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b63539bf-643c-47c0-a5a9-259dbcfa04fd-lib-modules\") pod \"perf-node-gather-daemonset-w6fzf\" (UID: \"b63539bf-643c-47c0-a5a9-259dbcfa04fd\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf"
Aug 04 19:27:28.799952 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.799767    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b63539bf-643c-47c0-a5a9-259dbcfa04fd-proc\") pod \"perf-node-gather-daemonset-w6fzf\" (UID: \"b63539bf-643c-47c0-a5a9-259dbcfa04fd\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf"
Aug 04 19:27:28.799952 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.799766    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b63539bf-643c-47c0-a5a9-259dbcfa04fd-sys\") pod \"perf-node-gather-daemonset-w6fzf\" (UID: \"b63539bf-643c-47c0-a5a9-259dbcfa04fd\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf"
Aug 04 19:27:28.799952 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.799767    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b63539bf-643c-47c0-a5a9-259dbcfa04fd-podres\") pod \"perf-node-gather-daemonset-w6fzf\" (UID: \"b63539bf-643c-47c0-a5a9-259dbcfa04fd\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf"
Aug 04 19:27:28.816789 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.816761    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqvkq\" (UniqueName: \"kubernetes.io/projected/b63539bf-643c-47c0-a5a9-259dbcfa04fd-kube-api-access-cqvkq\") pod \"perf-node-gather-daemonset-w6fzf\" (UID: \"b63539bf-643c-47c0-a5a9-259dbcfa04fd\") " pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf"
Aug 04 19:27:28.910715 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:28.910676    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf"
Aug 04 19:27:29.063730 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:29.063699    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf"]
Aug 04 19:27:29.065359 ip-10-0-132-214 kubenswrapper[2558]: W0804 19:27:29.065333    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb63539bf_643c_47c0_a5a9_259dbcfa04fd.slice/crio-9b26474763cb4d40444ec5c262f4d1a356fa4339b3a362f41a582659b84dcc28 WatchSource:0}: Error finding container 9b26474763cb4d40444ec5c262f4d1a356fa4339b3a362f41a582659b84dcc28: Status 404 returned error can't find the container with id 9b26474763cb4d40444ec5c262f4d1a356fa4339b3a362f41a582659b84dcc28
Aug 04 19:27:29.110843 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:29.110809    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf" event={"ID":"b63539bf-643c-47c0-a5a9-259dbcfa04fd","Type":"ContainerStarted","Data":"9b26474763cb4d40444ec5c262f4d1a356fa4339b3a362f41a582659b84dcc28"}
Aug 04 19:27:30.116926 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:30.116885    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf" event={"ID":"b63539bf-643c-47c0-a5a9-259dbcfa04fd","Type":"ContainerStarted","Data":"62b5f8f1d600c21829c83dcf396586182b4936f2c9e1b22b120e6ef793ec4efc"}
Aug 04 19:27:30.117355 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:30.116999    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf"
Aug 04 19:27:30.137114 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:30.137061    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf" podStartSLOduration=2.137046265 podStartE2EDuration="2.137046265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 19:27:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:27:30.136466261 +0000 UTC m=+3570.670649349" watchObservedRunningTime="2026-08-04 19:27:30.137046265 +0000 UTC m=+3570.671229352"
Aug 04 19:27:30.249793 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:30.249765    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-5d4wq_48a0eece-a584-4a2e-83d5-ea0a82b42f85/volume-data-source-validator/0.log"
Aug 04 19:27:31.629597 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:31.629565    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mw7k5_ac598b4f-20e2-402e-90d9-b57c4c511880/dns/0.log"
Aug 04 19:27:31.677024 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:31.676999    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mw7k5_ac598b4f-20e2-402e-90d9-b57c4c511880/kube-rbac-proxy/0.log"
Aug 04 19:27:31.798608 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:31.798574    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z4mcd_e4dac435-5ca9-41af-b8f0-e3aaa5b57d7d/dns-node-resolver/0.log"
Aug 04 19:27:32.462486 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:32.462459    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-77d9fc6d5f-9v958_ca6410ad-8cc7-4dc7-a6b1-50d28f87d2bc/registry/0.log"
Aug 04 19:27:32.518821 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:32.518788    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-txv8p_9bd4223d-7a9a-4ec4-9dea-c4ad74c6aa72/node-ca/0.log"
Aug 04 19:27:33.847282 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:33.847247    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-znd67_99cab7b9-099b-4b1f-bfd5-ae34ca916791/discovery/0.log"
Aug 04 19:27:34.021665 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:34.021622    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-km5dc_c846dd43-dccc-4edf-9893-358dd6e879c1/payload-processing/0.log"
Aug 04 19:27:34.064242 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:34.064209    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cd44fddd-7k9f2_0319a4e0-2f16-49bb-863b-c563db4af7f4/router/0.log"
Aug 04 19:27:35.036871 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:35.036845    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xzrg5_5e7ba757-2c66-4408-9bf9-4ba84e9ea85d/serve-healthcheck-canary/0.log"
Aug 04 19:27:35.703324 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:35.703295    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gdx9z_26d48b41-f890-442b-8ac3-63e065232cf3/kube-rbac-proxy/0.log"
Aug 04 19:27:35.733138 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:35.733106    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gdx9z_26d48b41-f890-442b-8ac3-63e065232cf3/exporter/0.log"
Aug 04 19:27:35.760087 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:35.760061    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gdx9z_26d48b41-f890-442b-8ac3-63e065232cf3/extractor/0.log"
Aug 04 19:27:36.131365 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:36.131294    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-szqsg/perf-node-gather-daemonset-w6fzf"
Aug 04 19:27:38.910185 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:38.910150    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-549599b85-k65h8_93984f28-492d-4655-aeb6-8347387196de/manager/0.log"
Aug 04 19:27:39.198338 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:39.198303    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5556d6485b-b9m4z_41f767fb-2927-4157-b2e4-4c00fb41bfa5/manager/0.log"
Aug 04 19:27:39.244908 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:39.244885    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5556d6485b-b9m4z_41f767fb-2927-4157-b2e4-4c00fb41bfa5/copy-manifests/0.log"
Aug 04 19:27:39.867595 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:39.867559    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-znd67_99cab7b9-099b-4b1f-bfd5-ae34ca916791/discovery/0.log"
Aug 04 19:27:40.084266 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:40.084232    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-km5dc_c846dd43-dccc-4edf-9893-358dd6e879c1/payload-processing/0.log"
Aug 04 19:27:40.110739 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:40.110708    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cd44fddd-7k9f2_0319a4e0-2f16-49bb-863b-c563db4af7f4/router/0.log"
Aug 04 19:27:41.000380 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:41.000349    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6f7c986d68-88m26_a7cb3c09-668b-415f-bf35-508257c49ad6/manager/0.log"
Aug 04 19:27:41.910837 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:41.910806    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-znd67_99cab7b9-099b-4b1f-bfd5-ae34ca916791/discovery/0.log"
Aug 04 19:27:42.026601 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:42.026564    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-km5dc_c846dd43-dccc-4edf-9893-358dd6e879c1/payload-processing/0.log"
Aug 04 19:27:42.044792 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:42.044769    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cd44fddd-7k9f2_0319a4e0-2f16-49bb-863b-c563db4af7f4/router/0.log"
Aug 04 19:27:46.699873 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:46.699844    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-kvgmn_68eccac8-1e33-4075-96d7-820bb0ab0484/migrator/0.log"
Aug 04 19:27:46.729076 ip-10-0-132-214 kubenswrapper[2558]: I0804 19:27:46.729056    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-kvgmn_68eccac8-1e33-4075-96d7-820bb0ab0484/graceful-termination/0.log"